2023-10-18T19:15:32.879 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T19:15:32.880 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223 --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223/orig.config.yaml 2023-10-18T19:15:32.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:15:33.022 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223 branch: wip-vshankar-testing-pacific-20231016.091648 description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: vshankar@redhat.com first_in_suite: false job_id: '7429223' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/nautilus latest ' name: vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi no_nested_subset: false nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-pacific-20231016.091648 ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 nuke-on-error: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-pacific-20231016.091648 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 7825 sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 sleep_before_teardown: 0 subset: 33/1024 suite: fs suite_branch: wip-vshankar-testing-pacific-20231016.091648 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFt0g5Q4OgUHhB5cw796zIX47qXgr2dQA4m5UOLeC9pcM6mYrb9ZLXQK9NShWjQzb0Un4HGRNRAXe+LA5i6JBmE= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8appbTjUKCc3niUwRRMpz+htaicXI1nGLwB5HQKAOuguEfn1y+POhWxzYdhlId7HM0Ooi4VlYz4Ha1jxgiEbk= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB38AQK1lRoWjNW7OKta5o0Jfgm+A5OQ4tdZZose4MI4JYrSI294B6LfstPTshPpXapNHZO4tQRuOb8ihxF9tnk= tasks: - install: branch: nautilus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - librados2 - print: '**** done installing nautilus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client nautilus - print: '**** done ceph' - ceph-fuse: null - print: '**** done nautilus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null mon.b: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release pacific - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:48:28 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-18T19:15:33.023 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa; will attempt to use it 2023-10-18T19:15:33.024 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks 2023-10-18T19:15:33.024 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T19:15:33.026 INFO:teuthology.task.internal:Checking packages... 2023-10-18T19:15:33.048 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5' 2023-10-18T19:15:33.048 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:15:33.049 INFO:teuthology.packaging:ref: None 2023-10-18T19:15:33.049 INFO:teuthology.packaging:tag: None 2023-10-18T19:15:33.049 INFO:teuthology.packaging:branch: wip-vshankar-testing-pacific-20231016.091648 2023-10-18T19:15:33.050 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:15:33.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-pacific-20231016.091648 2023-10-18T19:15:33.201 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-100.gb4ddd52c 2023-10-18T19:15:33.201 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T19:15:33.209 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T19:15:33.209 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T19:15:33.237 INFO:teuthology.task.internal:Saving configuration 2023-10-18T19:15:33.260 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T19:15:33.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T19:15:33.292 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 19:09:48.397709', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFt0g5Q4OgUHhB5cw796zIX47qXgr2dQA4m5UOLeC9pcM6mYrb9ZLXQK9NShWjQzb0Un4HGRNRAXe+LA5i6JBmE='} 2023-10-18T19:15:33.313 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 19:09:48.396083', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8appbTjUKCc3niUwRRMpz+htaicXI1nGLwB5HQKAOuguEfn1y+POhWxzYdhlId7HM0Ooi4VlYz4Ha1jxgiEbk='} 2023-10-18T19:15:33.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 19:09:48.394296', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB38AQK1lRoWjNW7OKta5o0Jfgm+A5OQ4tdZZose4MI4JYrSI294B6LfstPTshPpXapNHZO4tQRuOb8ihxF9tnk='} 2023-10-18T19:15:33.337 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T19:15:33.343 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-18T19:15:33.343 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['client.0'] 2023-10-18T19:15:33.343 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['client.1'] 2023-10-18T19:15:33.343 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T19:15:33.465 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d9becba60>, signals=[15]) 2023-10-18T19:15:33.466 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T19:15:33.472 INFO:teuthology.task.internal:Opening connections... 2023-10-18T19:15:33.472 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:15:33.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:15:33.541 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-10-18T19:15:33.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:15:33.612 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-10-18T19:15:33.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:15:33.681 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T19:15:33.688 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-10-18T19:15:33.710 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-10-18T19:15:33.711 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-10-18T19:15:33.772 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-10-18T19:15:33.772 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-10-18T19:15:33.773 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-10-18T19:15:33.773 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-10-18T19:15:33.773 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-10-18T19:15:33.773 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-10-18T19:15:33.773 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T19:15:33.774 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-10-18T19:15:33.774 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T19:15:33.774 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-10-18T19:15:33.774 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T19:15:33.774 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T19:15:33.775 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T19:15:33.775 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-10-18T19:15:33.800 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-10-18T19:15:33.822 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-10-18T19:15:33.822 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-18T19:15:33.882 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-10-18T19:15:33.883 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-10-18T19:15:33.883 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-10-18T19:15:33.883 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-10-18T19:15:33.883 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-10-18T19:15:33.883 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-10-18T19:15:33.884 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T19:15:33.884 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-10-18T19:15:33.884 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T19:15:33.884 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-10-18T19:15:33.885 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T19:15:33.885 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T19:15:33.885 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T19:15:33.885 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-18T19:15:33.908 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-18T19:15:33.931 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-18T19:15:33.932 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-18T19:15:33.994 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-10-18T19:15:33.994 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-10-18T19:15:33.994 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-10-18T19:15:33.994 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-10-18T19:15:33.995 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-10-18T19:15:33.995 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-18T19:15:33.995 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-18T19:15:33.995 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-18T19:15:33.995 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-18T19:15:33.996 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-10-18T19:15:33.996 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T19:15:33.996 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-18T19:15:33.996 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T19:15:33.996 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-18T19:15:34.017 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T19:15:34.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T19:15:34.046 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T19:15:34.046 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-10-18T19:15:34.049 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-10-18T19:15:34.052 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-10-18T19:15:34.071 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T19:15:34.078 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T19:15:34.078 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-10-18T19:15:34.110 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-10-18T19:15:34.112 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-10-18T19:15:34.148 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T19:15:34.228 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T19:15:34.242 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-18T19:15:34.242 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'client.0': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'client.1': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-18T19:15:34.243 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T19:15:34.244 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T19:15:34.244 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T19:15:34.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:15:34.264 DEBUG:teuthology.task.kernel:sha1 for client.1 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.264 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T19:15:34.264 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-10-18T19:15:34.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:15:34.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:15:34.267 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T19:15:34.267 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-18T19:15:34.268 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.268 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T19:15:34.268 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-18T19:15:34.323 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-489.el8.x86_64 2023-10-18T19:15:34.323 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.323 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T19:15:34.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.328 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-489.el8.x86_64 2023-10-18T19:15:34.328 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-489.el8.x86_64 2023-10-18T19:15:34.329 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.329 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T19:15:34.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.330 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.331 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T19:15:34.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:15:34.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum upgrade -y linux-firmware 2023-10-18T19:15:34.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum upgrade -y linux-firmware 2023-10-18T19:15:34.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum upgrade -y linux-firmware 2023-10-18T19:15:38.164 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 32 MB/s | 33 MB 00:01 2023-10-18T19:15:38.183 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - AppStream 28 MB/s | 33 MB 00:01 2023-10-18T19:15:39.093 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 17 MB/s | 33 MB 00:01 2023-10-18T19:15:46.164 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 50 MB 00:01 2023-10-18T19:15:46.408 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 50 MB 00:02 2023-10-18T19:15:47.912 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 50 MB 00:02 2023-10-18T19:15:53.546 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 83 kB/s | 18 kB 00:00 2023-10-18T19:15:54.066 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2023-10-18T19:15:54.533 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-10-18T19:15:54.860 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-18T19:15:55.014 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 5.4 kB/s | 6.9 kB 00:01 2023-10-18T19:15:55.332 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-18T19:15:55.336 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 89 kB/s | 18 kB 00:00 2023-10-18T19:15:55.637 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 56 kB/s | 6.9 kB 00:00 2023-10-18T19:15:55.931 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-18T19:15:56.546 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-18T19:15:57.542 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-18T19:15:58.624 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 16 MB 00:03 2023-10-18T19:16:00.494 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 139 kB/s | 24 kB 00:00 2023-10-18T19:16:01.448 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 415 kB/s | 24 kB 00:00 2023-10-18T19:16:02.457 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 430 kB/s | 24 kB 00:00 2023-10-18T19:16:04.366 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:16:04.367 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:16:04.367 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2023-10-18T19:16:04.367 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:16:04.367 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-10-18T19:16:04.368 INFO:teuthology.orchestra.run.smithi192.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-18T19:16:04.368 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:16:04.368 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:16:04.368 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:16:04.369 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 1 Package 2023-10-18T19:16:04.369 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:16:04.369 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 286 M 2023-10-18T19:16:04.369 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:16:05.349 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:16:05.350 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:16:05.350 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2023-10-18T19:16:05.350 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:16:05.350 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-10-18T19:16:05.350 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-18T19:16:05.351 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:16:05.351 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:16:05.351 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:16:05.351 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 1 Package 2023-10-18T19:16:05.351 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:16:05.352 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 286 M 2023-10-18T19:16:05.352 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:16:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:16:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:16:06.323 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-10-18T19:16:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:16:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-10-18T19:16:06.323 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-10-18T19:16:06.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:16:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:16:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:16:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 1 Package 2023-10-18T19:16:06.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:16:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 286 M 2023-10-18T19:16:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:16:14.561 INFO:teuthology.orchestra.run.smithi192.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 29 MB/s | 286 MB 00:09 2023-10-18T19:16:14.562 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:16:14.562 INFO:teuthology.orchestra.run.smithi192.stdout:Total 28 MB/s | 286 MB 00:10 2023-10-18T19:16:16.265 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:16:16.346 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:16:16.346 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:16:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 25 MB/s | 286 MB 00:11 2023-10-18T19:16:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:16:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:Total 25 MB/s | 286 MB 00:11 2023-10-18T19:16:16.889 INFO:teuthology.orchestra.run.smithi088.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 28 MB/s | 286 MB 00:10 2023-10-18T19:16:16.890 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:16:16.890 INFO:teuthology.orchestra.run.smithi088.stdout:Total 27 MB/s | 286 MB 00:10 2023-10-18T19:16:18.216 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:16:18.257 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:16:18.425 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:16:18.492 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:16:18.493 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:16:18.592 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:16:18.675 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:16:18.675 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:16:20.272 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:16:20.295 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:16:20.470 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:16:20.503 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:16:37.387 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:16:37.742 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:38.237 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:38.237 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:39.031 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:39.031 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:16:39.031 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-10-18T19:16:39.031 INFO:teuthology.orchestra.run.smithi192.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-18T19:16:39.032 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:16:39.032 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:16:39.219 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-18T19:16:39.220 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:16:39.432 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:16:39.501 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-18T19:16:39.501 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-18T19:16:39.504 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi192.front.sepia.ceph.com to complete... 2023-10-18T19:16:39.528 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:16:39.779 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:39.891 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:39.999 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:40.255 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:40.255 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:40.385 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:40.386 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-10-18T19:16:41.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:16:41.004 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-10-18T19:16:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-18T19:16:41.004 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:16:41.005 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:16:41.181 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T19:16:41.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:16:41.188 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-10-18T19:16:41.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:16:41.189 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-10-18T19:16:41.189 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-10-18T19:16:41.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:16:41.189 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:16:41.366 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-18T19:16:41.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T19:16:41.447 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-18T19:16:41.447 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-18T19:16:41.450 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-10-18T19:16:41.602 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ 2023-10-18T19:16:41.602 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-18T19:16:41.605 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-10-18T19:17:05.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:17:05 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T19:17:05.311 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-10-18 19:17:05-- 2023-10-18T19:17:05.311 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 24s 2023-10-18T19:17:05.312 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 365M in 23s (15.7 MB/s) 2023-10-18T19:17:05.313 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-18T19:17:05.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T19:17:06.987 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying... ######################################## 2023-10-18T19:17:07.030 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing... ######################################## 2023-10-18T19:17:07.139 INFO:teuthology.orchestra.run.smithi088.stdout:Updating / installing... 2023-10-18T19:17:10.011 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:17:10 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T19:17:10.012 INFO:teuthology.orchestra.run.smithi192.stderr:FINISHED --2023-10-18 19:17:10-- 2023-10-18T19:17:10.012 INFO:teuthology.orchestra.run.smithi192.stderr:Total wall clock time: 30s 2023-10-18T19:17:10.012 INFO:teuthology.orchestra.run.smithi192.stderr:Downloaded: 1 files, 365M in 30s (12.1 MB/s) 2023-10-18T19:17:10.013 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-18T19:17:10.014 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T19:17:11.685 INFO:teuthology.orchestra.run.smithi192.stdout:Verifying... ######################################## 2023-10-18T19:17:11.729 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing... ######################################## 2023-10-18T19:17:11.838 INFO:teuthology.orchestra.run.smithi192.stdout:Updating / installing... 2023-10-18T19:17:28.261 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:17:28 URL:https://3.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/8/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [383161052/383161052] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-18T19:17:28.262 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2023-10-18 19:17:28-- 2023-10-18T19:17:28.262 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 47s 2023-10-18T19:17:28.262 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 365M in 46s (7.88 MB/s) 2023-10-18T19:17:28.263 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T19:17:28.264 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-18T19:17:29.944 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying... ######################################## 2023-10-18T19:17:29.988 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing... ######################################## 2023-10-18T19:17:30.097 INFO:teuthology.orchestra.run.smithi184.stdout:Updating / installing... 2023-10-18T19:17:45.443 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T19:17:46.840 INFO:teuthology.orchestra.run.smithi088.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T19:17:50.337 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T19:17:51.690 INFO:teuthology.orchestra.run.smithi192.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T19:18:08.253 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-18T19:18:10.514 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T19:18:10.515 DEBUG:teuthology.orchestra.run.smithi088:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:10.573 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.573 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.573 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.573 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.574 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T19:18:10.574 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T19:18:10.574 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T19:18:10.574 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T19:18:10.574 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T19:18:10.575 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T19:18:10.576 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T19:18:10.576 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T19:18:10.576 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T19:18:10.576 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T19:18:10.576 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T19:18:10.577 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T19:18:10.578 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T19:18:10.578 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T19:18:10.578 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T19:18:10.578 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T19:18:10.579 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T19:18:10.579 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T19:18:10.579 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T19:18:10.579 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T19:18:10.579 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T19:18:10.580 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T19:18:10.581 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T19:18:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T19:18:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T19:18:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T19:18:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T19:18:10.582 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T19:18:10.583 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T19:18:10.583 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T19:18:10.583 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T19:18:10.583 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T19:18:10.583 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T19:18:10.584 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T19:18:10.584 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T19:18:10.584 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T19:18:10.584 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T19:18:10.585 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T19:18:10.586 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T19:18:10.586 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T19:18:10.586 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T19:18:10.586 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T19:18:10.587 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T19:18:10.587 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T19:18:10.587 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T19:18:10.587 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T19:18:10.587 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T19:18:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T19:18:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T19:18:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T19:18:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T19:18:10.588 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T19:18:10.589 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T19:18:10.590 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T19:18:10.590 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T19:18:10.590 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T19:18:10.590 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T19:18:10.590 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T19:18:10.591 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T19:18:10.591 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T19:18:10.591 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T19:18:10.591 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T19:18:10.591 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T19:18:10.592 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T19:18:10.592 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T19:18:10.592 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T19:18:10.592 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T19:18:10.592 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T19:18:10.593 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T19:18:10.593 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T19:18:10.593 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T19:18:10.593 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T19:18:10.593 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T19:18:10.594 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T19:18:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T19:18:10.596 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T19:18:10.596 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T19:18:10.596 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T19:18:10.596 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T19:18:10.596 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T19:18:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T19:18:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T19:18:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T19:18:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T19:18:10.597 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T19:18:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T19:18:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T19:18:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T19:18:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T19:18:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T19:18:10.599 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T19:18:10.599 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T19:18:10.599 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T19:18:10.599 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T19:18:10.600 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T19:18:10.601 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T19:18:10.601 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T19:18:10.601 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T19:18:10.601 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T19:18:10.601 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T19:18:10.602 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T19:18:10.602 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T19:18:10.602 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T19:18:10.602 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T19:18:10.602 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T19:18:10.603 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T19:18:10.604 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T19:18:10.604 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T19:18:10.604 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T19:18:10.604 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T19:18:10.604 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T19:18:10.605 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T19:18:10.605 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T19:18:10.605 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T19:18:10.605 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T19:18:10.605 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T19:18:10.606 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T19:18:10.606 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T19:18:10.606 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T19:18:10.606 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T19:18:10.607 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T19:18:10.607 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T19:18:10.607 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T19:18:10.607 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T19:18:10.607 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T19:18:10.608 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T19:18:10.608 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T19:18:10.608 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T19:18:10.608 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T19:18:10.609 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T19:18:10.609 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T19:18:10.609 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T19:18:10.609 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T19:18:10.609 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T19:18:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T19:18:10.611 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T19:18:10.611 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T19:18:10.611 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T19:18:10.611 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T19:18:10.611 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T19:18:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T19:18:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T19:18:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T19:18:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T19:18:10.612 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T19:18:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T19:18:10.614 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T19:18:10.614 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T19:18:10.614 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T19:18:10.614 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T19:18:10.614 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T19:18:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T19:18:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T19:18:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T19:18:10.615 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T19:18:10.616 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T19:18:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T19:18:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T19:18:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T19:18:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T19:18:10.617 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T19:18:10.618 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T19:18:10.618 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T19:18:10.618 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T19:18:10.618 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T19:18:10.618 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T19:18:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T19:18:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T19:18:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T19:18:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T19:18:10.619 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T19:18:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T19:18:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T19:18:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T19:18:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T19:18:10.620 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T19:18:10.621 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T19:18:10.621 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T19:18:10.621 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T19:18:10.621 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T19:18:10.622 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T19:18:10.623 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T19:18:10.623 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T19:18:10.623 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T19:18:10.623 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T19:18:10.623 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T19:18:10.624 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T19:18:10.624 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T19:18:10.624 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T19:18:10.624 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T19:18:10.625 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T19:18:10.625 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T19:18:10.625 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T19:18:10.625 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T19:18:10.625 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T19:18:10.626 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T19:18:10.626 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T19:18:10.626 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T19:18:10.626 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T19:18:10.626 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T19:18:10.627 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T19:18:10.628 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T19:18:10.629 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T19:18:10.629 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T19:18:10.629 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T19:18:10.629 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T19:18:10.629 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T19:18:10.630 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T19:18:10.630 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T19:18:10.630 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T19:18:10.630 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T19:18:10.630 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T19:18:10.631 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T19:18:10.632 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T19:18:10.632 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T19:18:10.632 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T19:18:10.632 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T19:18:10.632 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T19:18:10.633 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T19:18:10.633 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T19:18:10.633 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T19:18:10.633 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T19:18:10.633 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T19:18:10.634 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T19:18:10.634 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T19:18:10.634 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T19:18:10.634 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T19:18:10.635 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T19:18:10.636 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T19:18:10.637 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T19:18:10.637 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T19:18:10.637 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T19:18:10.637 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T19:18:10.638 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T19:18:10.638 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T19:18:10.638 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T19:18:10.638 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T19:18:10.638 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T19:18:10.639 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T19:18:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T19:18:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T19:18:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T19:18:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T19:18:10.640 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T19:18:10.641 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T19:18:10.641 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T19:18:10.641 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T19:18:10.641 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T19:18:10.641 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T19:18:10.642 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T19:18:10.642 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T19:18:10.642 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T19:18:10.642 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T19:18:10.643 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T19:18:10.643 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T19:18:10.643 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T19:18:10.643 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T19:18:10.643 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T19:18:10.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T19:18:10.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T19:18:10.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T19:18:10.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T19:18:10.644 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T19:18:10.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T19:18:10.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T19:18:10.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T19:18:10.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T19:18:10.645 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T19:18:10.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T19:18:10.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T19:18:10.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T19:18:10.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T19:18:10.646 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T19:18:10.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T19:18:10.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T19:18:10.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T19:18:10.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T19:18:10.647 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T19:18:10.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T19:18:10.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T19:18:10.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T19:18:10.648 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T19:18:10.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T19:18:10.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T19:18:10.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T19:18:10.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T19:18:10.649 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T19:18:10.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T19:18:10.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T19:18:10.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T19:18:10.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T19:18:10.650 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T19:18:10.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T19:18:10.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T19:18:10.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T19:18:10.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T19:18:10.651 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T19:18:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T19:18:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T19:18:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T19:18:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T19:18:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T19:18:10.653 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T19:18:10.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T19:18:10.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T19:18:10.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T19:18:10.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T19:18:10.654 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T19:18:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T19:18:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T19:18:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T19:18:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T19:18:10.655 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T19:18:10.656 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T19:18:10.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T19:18:10.657 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T19:18:10.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T19:18:10.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T19:18:10.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T19:18:10.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T19:18:10.658 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T19:18:10.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T19:18:10.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T19:18:10.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T19:18:10.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T19:18:10.659 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T19:18:10.660 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T19:18:10.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T19:18:10.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T19:18:10.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T19:18:10.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T19:18:10.661 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T19:18:10.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T19:18:10.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T19:18:10.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T19:18:10.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T19:18:10.662 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T19:18:10.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T19:18:10.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T19:18:10.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T19:18:10.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T19:18:10.663 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T19:18:10.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T19:18:10.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T19:18:10.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T19:18:10.664 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T19:18:10.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T19:18:10.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T19:18:10.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T19:18:10.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T19:18:10.665 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T19:18:10.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T19:18:10.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T19:18:10.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T19:18:10.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T19:18:10.666 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T19:18:10.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T19:18:10.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T19:18:10.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T19:18:10.667 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T19:18:10.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T19:18:10.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T19:18:10.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T19:18:10.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T19:18:10.668 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T19:18:10.669 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T19:18:10.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T19:18:10.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T19:18:10.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T19:18:10.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T19:18:10.670 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T19:18:10.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T19:18:10.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T19:18:10.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T19:18:10.671 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T19:18:10.672 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T19:18:10.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T19:18:10.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T19:18:10.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T19:18:10.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T19:18:10.673 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T19:18:10.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T19:18:10.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T19:18:10.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T19:18:10.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T19:18:10.674 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T19:18:10.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T19:18:10.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T19:18:10.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T19:18:10.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T19:18:10.675 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T19:18:10.676 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T19:18:10.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T19:18:10.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T19:18:10.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T19:18:10.677 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T19:18:10.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T19:18:10.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T19:18:10.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T19:18:10.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T19:18:10.678 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T19:18:10.679 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T19:18:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T19:18:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T19:18:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T19:18:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T19:18:10.680 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T19:18:10.681 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T19:18:10.682 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T19:18:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T19:18:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T19:18:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T19:18:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T19:18:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T19:18:10.684 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T19:18:10.685 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T19:18:10.686 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T19:18:10.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T19:18:10.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T19:18:10.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T19:18:10.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T19:18:10.687 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T19:18:10.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T19:18:10.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T19:18:10.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T19:18:10.688 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T19:18:10.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T19:18:10.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T19:18:10.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T19:18:10.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T19:18:10.689 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T19:18:10.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T19:18:10.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T19:18:10.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T19:18:10.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T19:18:10.690 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T19:18:10.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T19:18:10.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T19:18:10.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T19:18:10.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T19:18:10.691 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T19:18:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T19:18:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T19:18:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T19:18:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T19:18:10.692 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T19:18:10.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T19:18:10.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T19:18:10.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T19:18:10.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T19:18:10.693 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T19:18:10.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T19:18:10.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T19:18:10.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T19:18:10.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T19:18:10.694 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T19:18:10.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T19:18:10.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T19:18:10.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T19:18:10.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T19:18:10.695 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T19:18:10.696 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T19:18:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T19:18:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T19:18:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T19:18:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T19:18:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T19:18:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T19:18:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T19:18:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T19:18:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T19:18:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T19:18:10.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T19:18:10.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T19:18:10.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T19:18:10.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T19:18:10.699 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T19:18:10.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T19:18:10.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T19:18:10.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T19:18:10.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T19:18:10.700 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T19:18:10.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T19:18:10.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T19:18:10.701 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T19:18:10.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T19:18:10.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T19:18:10.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T19:18:10.702 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T19:18:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T19:18:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T19:18:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T19:18:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T19:18:10.703 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T19:18:10.704 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T19:18:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T19:18:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T19:18:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T19:18:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T19:18:10.705 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T19:18:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T19:18:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T19:18:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T19:18:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T19:18:10.707 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T19:18:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T19:18:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T19:18:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T19:18:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T19:18:10.708 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T19:18:10.709 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T19:18:10.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T19:18:10.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T19:18:10.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T19:18:10.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T19:18:10.710 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T19:18:10.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T19:18:10.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T19:18:10.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T19:18:10.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T19:18:10.711 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T19:18:10.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T19:18:10.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T19:18:10.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T19:18:10.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T19:18:10.712 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T19:18:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T19:18:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T19:18:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T19:18:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T19:18:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T19:18:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T19:18:10.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T19:18:10.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T19:18:10.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T19:18:10.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T19:18:10.715 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T19:18:10.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T19:18:10.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T19:18:10.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T19:18:10.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T19:18:10.716 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T19:18:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T19:18:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T19:18:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T19:18:10.717 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T19:18:10.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T19:18:10.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T19:18:10.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T19:18:10.718 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T19:18:10.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T19:18:10.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T19:18:10.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T19:18:10.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T19:18:10.719 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T19:18:10.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T19:18:10.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T19:18:10.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T19:18:10.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T19:18:10.720 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T19:18:10.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T19:18:10.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T19:18:10.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T19:18:10.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T19:18:10.721 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T19:18:10.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T19:18:10.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T19:18:10.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T19:18:10.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T19:18:10.722 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T19:18:10.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T19:18:10.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T19:18:10.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T19:18:10.723 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T19:18:10.724 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T19:18:10.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T19:18:10.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T19:18:10.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T19:18:10.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T19:18:10.725 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T19:18:10.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T19:18:10.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T19:18:10.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T19:18:10.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T19:18:10.726 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T19:18:10.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T19:18:10.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T19:18:10.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T19:18:10.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T19:18:10.727 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T19:18:10.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T19:18:10.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T19:18:10.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T19:18:10.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T19:18:10.728 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T19:18:10.729 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T19:18:10.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T19:18:10.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T19:18:10.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T19:18:10.730 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T19:18:10.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T19:18:10.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T19:18:10.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T19:18:10.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T19:18:10.731 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T19:18:10.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T19:18:10.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T19:18:10.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T19:18:10.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T19:18:10.732 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T19:18:10.733 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T19:18:10.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T19:18:10.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T19:18:10.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T19:18:10.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T19:18:10.734 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T19:18:10.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T19:18:10.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T19:18:10.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T19:18:10.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T19:18:10.735 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T19:18:10.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T19:18:10.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T19:18:10.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T19:18:10.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T19:18:10.736 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T19:18:10.737 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T19:18:10.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T19:18:10.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T19:18:10.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T19:18:10.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T19:18:10.738 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T19:18:10.739 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T19:18:10.740 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T19:18:10.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T19:18:10.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T19:18:10.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T19:18:10.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T19:18:10.741 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T19:18:10.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T19:18:10.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T19:18:10.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T19:18:10.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T19:18:10.742 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T19:18:10.743 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T19:18:10.744 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T19:18:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T19:18:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T19:18:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T19:18:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T19:18:10.745 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T19:18:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T19:18:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T19:18:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T19:18:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T19:18:10.746 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T19:18:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T19:18:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T19:18:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T19:18:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T19:18:10.747 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T19:18:10.748 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T19:18:10.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T19:18:10.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T19:18:10.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T19:18:10.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T19:18:10.749 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T19:18:10.750 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T19:18:10.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T19:18:10.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T19:18:10.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T19:18:10.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T19:18:10.751 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T19:18:10.752 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T19:18:10.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T19:18:10.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T19:18:10.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T19:18:10.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T19:18:10.753 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T19:18:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T19:18:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T19:18:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T19:18:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T19:18:10.754 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T19:18:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T19:18:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T19:18:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T19:18:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T19:18:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T19:18:10.756 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T19:18:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T19:18:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T19:18:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T19:18:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T19:18:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T19:18:10.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T19:18:10.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T19:18:10.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T19:18:10.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T19:18:10.758 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T19:18:10.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T19:18:10.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T19:18:10.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T19:18:10.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T19:18:10.759 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T19:18:10.760 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T19:18:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T19:18:10.762 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T19:18:10.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T19:18:10.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T19:18:10.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T19:18:10.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T19:18:10.763 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T19:18:10.764 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T19:18:10.765 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T19:18:10.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T19:18:10.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T19:18:10.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T19:18:10.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T19:18:10.766 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T19:18:10.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T19:18:10.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T19:18:10.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T19:18:10.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T19:18:10.767 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T19:18:10.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T19:18:10.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T19:18:10.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T19:18:10.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T19:18:10.768 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T19:18:10.769 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T19:18:10.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T19:18:10.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T19:18:10.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T19:18:10.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T19:18:10.770 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T19:18:10.771 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T19:18:10.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T19:18:10.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T19:18:10.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T19:18:10.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T19:18:10.772 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T19:18:10.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T19:18:10.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T19:18:10.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T19:18:10.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T19:18:10.773 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T19:18:10.774 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T19:18:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T19:18:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T19:18:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T19:18:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T19:18:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T19:18:10.776 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T19:18:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T19:18:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T19:18:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T19:18:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T19:18:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T19:18:10.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T19:18:10.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T19:18:10.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T19:18:10.778 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T19:18:10.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T19:18:10.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T19:18:10.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T19:18:10.779 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T19:18:10.780 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T19:18:10.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T19:18:10.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T19:18:10.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T19:18:10.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T19:18:10.781 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T19:18:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T19:18:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T19:18:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T19:18:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T19:18:10.782 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T19:18:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T19:18:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T19:18:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T19:18:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T19:18:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T19:18:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T19:18:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T19:18:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T19:18:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T19:18:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T19:18:10.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T19:18:10.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T19:18:10.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T19:18:10.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T19:18:10.785 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T19:18:10.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T19:18:10.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T19:18:10.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T19:18:10.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T19:18:10.786 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T19:18:10.787 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T19:18:10.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T19:18:10.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T19:18:10.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T19:18:10.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T19:18:10.788 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T19:18:10.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T19:18:10.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T19:18:10.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T19:18:10.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T19:18:10.789 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T19:18:10.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T19:18:10.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T19:18:10.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T19:18:10.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T19:18:10.790 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T19:18:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T19:18:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T19:18:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T19:18:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T19:18:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T19:18:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T19:18:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T19:18:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T19:18:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T19:18:10.792 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T19:18:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T19:18:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T19:18:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T19:18:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T19:18:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T19:18:10.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T19:18:10.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T19:18:10.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T19:18:10.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T19:18:10.794 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T19:18:10.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T19:18:10.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T19:18:10.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T19:18:10.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T19:18:10.795 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T19:18:10.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T19:18:10.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T19:18:10.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T19:18:10.796 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T19:18:10.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T19:18:10.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T19:18:10.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T19:18:10.797 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T19:18:10.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T19:18:10.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T19:18:10.798 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T19:18:10.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T19:18:10.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T19:18:10.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T19:18:10.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T19:18:10.799 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T19:18:10.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T19:18:10.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T19:18:10.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T19:18:10.800 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T19:18:10.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T19:18:10.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T19:18:10.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T19:18:10.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T19:18:10.801 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T19:18:10.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T19:18:10.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T19:18:10.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T19:18:10.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T19:18:10.802 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T19:18:10.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T19:18:10.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T19:18:10.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T19:18:10.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T19:18:10.803 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T19:18:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T19:18:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T19:18:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T19:18:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T19:18:10.804 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T19:18:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T19:18:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T19:18:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T19:18:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T19:18:10.805 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T19:18:10.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T19:18:10.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T19:18:10.806 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T19:18:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T19:18:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T19:18:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T19:18:10.807 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T19:18:10.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T19:18:10.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T19:18:10.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T19:18:10.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T19:18:10.808 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T19:18:10.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T19:18:10.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T19:18:10.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T19:18:10.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T19:18:10.809 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T19:18:10.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T19:18:10.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T19:18:10.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T19:18:10.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T19:18:10.810 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T19:18:10.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T19:18:10.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T19:18:10.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T19:18:10.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T19:18:10.811 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T19:18:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T19:18:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T19:18:10.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T19:18:10.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T19:18:10.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T19:18:10.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T19:18:10.814 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T19:18:10.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T19:18:10.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T19:18:10.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T19:18:10.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T19:18:10.815 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T19:18:10.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T19:18:10.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T19:18:10.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T19:18:10.816 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T19:18:10.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T19:18:10.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T19:18:10.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T19:18:10.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T19:18:10.817 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T19:18:10.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T19:18:10.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T19:18:10.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T19:18:10.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T19:18:10.818 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T19:18:10.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T19:18:10.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T19:18:10.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T19:18:10.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T19:18:10.819 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T19:18:10.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T19:18:10.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T19:18:10.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T19:18:10.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T19:18:10.820 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T19:18:10.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T19:18:10.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T19:18:10.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T19:18:10.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T19:18:10.821 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T19:18:10.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T19:18:10.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T19:18:10.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T19:18:10.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T19:18:10.822 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T19:18:10.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T19:18:10.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T19:18:10.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T19:18:10.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T19:18:10.823 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T19:18:10.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T19:18:10.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T19:18:10.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T19:18:10.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T19:18:10.824 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T19:18:10.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T19:18:10.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T19:18:10.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T19:18:10.825 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T19:18:10.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T19:18:10.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T19:18:10.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T19:18:10.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T19:18:10.826 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T19:18:10.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T19:18:10.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T19:18:10.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T19:18:10.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T19:18:10.827 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T19:18:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T19:18:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T19:18:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T19:18:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T19:18:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T19:18:10.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T19:18:10.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T19:18:10.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T19:18:10.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T19:18:10.829 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T19:18:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T19:18:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T19:18:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T19:18:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T19:18:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T19:18:10.831 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T19:18:10.832 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T19:18:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T19:18:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T19:18:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T19:18:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T19:18:10.833 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T19:18:10.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T19:18:10.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T19:18:10.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T19:18:10.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T19:18:10.834 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T19:18:10.835 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T19:18:10.836 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T19:18:10.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T19:18:10.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T19:18:10.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T19:18:10.837 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T19:18:10.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T19:18:10.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T19:18:10.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T19:18:10.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T19:18:10.838 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T19:18:10.839 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T19:18:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T19:18:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T19:18:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T19:18:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T19:18:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T19:18:10.841 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T19:18:10.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T19:18:10.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T19:18:10.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T19:18:10.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T19:18:10.842 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T19:18:10.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T19:18:10.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T19:18:10.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T19:18:10.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T19:18:10.843 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T19:18:10.844 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T19:18:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T19:18:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T19:18:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T19:18:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T19:18:10.845 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T19:18:10.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T19:18:10.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T19:18:10.846 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T19:18:10.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T19:18:10.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T19:18:10.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T19:18:10.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T19:18:10.847 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T19:18:10.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T19:18:10.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T19:18:10.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T19:18:10.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T19:18:10.848 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T19:18:10.849 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T19:18:10.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T19:18:10.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T19:18:10.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T19:18:10.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T19:18:10.850 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T19:18:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T19:18:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T19:18:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T19:18:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T19:18:10.851 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T19:18:10.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T19:18:10.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T19:18:10.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T19:18:10.852 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T19:18:10.853 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T19:18:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T19:18:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T19:18:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T19:18:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T19:18:10.854 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T19:18:10.855 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T19:18:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T19:18:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T19:18:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T19:18:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T19:18:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T19:18:10.857 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T19:18:10.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T19:18:10.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T19:18:10.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T19:18:10.858 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T19:18:10.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T19:18:10.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T19:18:10.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T19:18:10.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T19:18:10.859 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T19:18:10.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T19:18:10.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T19:18:10.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T19:18:10.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T19:18:10.860 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T19:18:10.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T19:18:10.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T19:18:10.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T19:18:10.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T19:18:10.861 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T19:18:10.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T19:18:10.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T19:18:10.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T19:18:10.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T19:18:10.862 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T19:18:10.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T19:18:10.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T19:18:10.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T19:18:10.863 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T19:18:10.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T19:18:10.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T19:18:10.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T19:18:10.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T19:18:10.864 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T19:18:10.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T19:18:10.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T19:18:10.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T19:18:10.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T19:18:10.865 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T19:18:10.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T19:18:10.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T19:18:10.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T19:18:10.866 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T19:18:10.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T19:18:10.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T19:18:10.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T19:18:10.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T19:18:10.867 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T19:18:10.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T19:18:10.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T19:18:10.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T19:18:10.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T19:18:10.868 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T19:18:10.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T19:18:10.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T19:18:10.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T19:18:10.869 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T19:18:10.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T19:18:10.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T19:18:10.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T19:18:10.870 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T19:18:10.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T19:18:10.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T19:18:10.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T19:18:10.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T19:18:10.871 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T19:18:10.872 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T19:18:10.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T19:18:10.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T19:18:10.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T19:18:10.873 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T19:18:10.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T19:18:10.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T19:18:10.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T19:18:10.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T19:18:10.874 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T19:18:10.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T19:18:10.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T19:18:10.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T19:18:10.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T19:18:10.875 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T19:18:10.876 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T19:18:10.877 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T19:18:10.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T19:18:10.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T19:18:10.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T19:18:10.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T19:18:10.878 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T19:18:10.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T19:18:10.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T19:18:10.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T19:18:10.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T19:18:10.879 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T19:18:10.880 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T19:18:10.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T19:18:10.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T19:18:10.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T19:18:10.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T19:18:10.881 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T19:18:10.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T19:18:10.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T19:18:10.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T19:18:10.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T19:18:10.882 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T19:18:10.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T19:18:10.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T19:18:10.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T19:18:10.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T19:18:10.883 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T19:18:10.884 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T19:18:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T19:18:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T19:18:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T19:18:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T19:18:10.885 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T19:18:10.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T19:18:10.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T19:18:10.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T19:18:10.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T19:18:10.886 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T19:18:10.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T19:18:10.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T19:18:10.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T19:18:10.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T19:18:10.887 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T19:18:10.888 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T19:18:10.889 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T19:18:10.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T19:18:10.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T19:18:10.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T19:18:10.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T19:18:10.890 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T19:18:10.891 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T19:18:10.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T19:18:10.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T19:18:10.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T19:18:10.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T19:18:10.892 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T19:18:10.893 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T19:18:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T19:18:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T19:18:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T19:18:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T19:18:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T19:18:10.895 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T19:18:10.896 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T19:18:10.896 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T19:18:10.896 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T19:18:10.896 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T19:18:10.896 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T19:18:10.897 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T19:18:10.898 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T19:18:10.898 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T19:18:10.898 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T19:18:10.898 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T19:18:10.898 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T19:18:10.899 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T19:18:10.900 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T19:18:10.901 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T19:18:10.901 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T19:18:10.901 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T19:18:10.901 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T19:18:10.901 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T19:18:10.902 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T19:18:10.903 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T19:18:10.903 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T19:18:10.903 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T19:18:10.903 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T19:18:10.903 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T19:18:10.904 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T19:18:10.905 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T19:18:10.906 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T19:18:10.906 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T19:18:10.906 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T19:18:10.906 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T19:18:10.906 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T19:18:10.907 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T19:18:10.908 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T19:18:10.909 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T19:18:10.909 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T19:18:10.909 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T19:18:10.909 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T19:18:10.909 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T19:18:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T19:18:10.911 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T19:18:10.911 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T19:18:10.911 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T19:18:10.911 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T19:18:10.911 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T19:18:10.913 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T19:18:10.913 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T19:18:10.914 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T19:18:10.914 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T19:18:10.914 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T19:18:10.914 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T19:18:10.915 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T19:18:10.916 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T19:18:10.917 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T19:18:10.917 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T19:18:10.917 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T19:18:10.917 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T19:18:10.917 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T19:18:10.918 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T19:18:10.918 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T19:18:10.918 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T19:18:10.918 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T19:18:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T19:18:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T19:18:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T19:18:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T19:18:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T19:18:10.920 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T19:18:10.921 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T19:18:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T19:18:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T19:18:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T19:18:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T19:18:10.922 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T19:18:10.923 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T19:18:10.924 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T19:18:10.925 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T19:18:10.925 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T19:18:10.925 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T19:18:10.925 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T19:18:10.925 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T19:18:10.926 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T19:18:10.927 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T19:18:10.928 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T19:18:10.929 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T19:18:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T19:18:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T19:18:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T19:18:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T19:18:10.930 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T19:18:10.931 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T19:18:10.932 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T19:18:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T19:18:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T19:18:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T19:18:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T19:18:10.933 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T19:18:10.934 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T19:18:10.934 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T19:18:10.934 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T19:18:10.934 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T19:18:10.934 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T19:18:10.935 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T19:18:10.935 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T19:18:10.935 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T19:18:10.935 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T19:18:10.935 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T19:18:10.936 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T19:18:10.937 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T19:18:10.937 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T19:18:10.937 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T19:18:10.937 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T19:18:10.938 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T19:18:10.938 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T19:18:10.938 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T19:18:10.938 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T19:18:10.938 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T19:18:10.939 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T19:18:10.940 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T19:18:10.941 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T19:18:10.941 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T19:18:10.941 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T19:18:10.941 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T19:18:10.941 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T19:18:10.942 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T19:18:10.942 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T19:18:10.942 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T19:18:10.942 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T19:18:10.942 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T19:18:10.943 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T19:18:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T19:18:10.945 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T19:18:10.946 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T19:18:10.946 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T19:18:10.946 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T19:18:10.946 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T19:18:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T19:18:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T19:18:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T19:18:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T19:18:10.947 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T19:18:10.948 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T19:18:10.948 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T19:18:10.948 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T19:18:10.948 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T19:18:10.948 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T19:18:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T19:18:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T19:18:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T19:18:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T19:18:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T19:18:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T19:18:10.951 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T19:18:10.952 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T19:18:10.952 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T19:18:10.952 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T19:18:10.952 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T19:18:10.952 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T19:18:10.953 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T19:18:10.954 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.955 DEBUG:teuthology.orchestra.run.smithi088:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:10.984 INFO:teuthology.orchestra.run.smithi088.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T19:18:10.984 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T19:18:10.984 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:10.984 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:10.985 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.985 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:10.985 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:10.985 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-18T19:18:10.985 INFO:teuthology.orchestra.run.smithi088.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T19:18:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T19:18:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T19:18:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-18T19:18:10.987 INFO:teuthology.orchestra.run.smithi088.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:10.987 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T19:18:10.987 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:10.987 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-10-18T19:18:10.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-10-18T19:18:11.068 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-10-18T19:18:11.068 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-10-18T19:18:11.068 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-10-18T19:18:11.069 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2023-10-18T19:18:11.069 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-10-18T19:18:11.069 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-18T19:18:11.069 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-18T19:18:11.070 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-18T19:18:11.071 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-10-18T19:18:11.071 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2023-10-18T19:18:11.071 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-10-18T19:18:11.071 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T19:18:11.071 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-10-18T19:18:11.072 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-10-18T19:18:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:18:11.072 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T19:18:11.072 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T19:18:11.072 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T19:18:11.073 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-10-18T19:18:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:18:11.073 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T19:18:11.074 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T19:18:11.074 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 6.6.0-rc5-g47672119149b 2023-10-18T19:18:11.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T19:18:12.351 INFO:teuthology.orchestra.run.smithi184.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-18T19:18:14.138 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-10-18T19:18:15.150 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T19:18:15.150 DEBUG:teuthology.orchestra.run.smithi192:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:15.211 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.213 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.213 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.214 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.214 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T19:18:15.214 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T19:18:15.214 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T19:18:15.214 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T19:18:15.215 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T19:18:15.215 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T19:18:15.215 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T19:18:15.215 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T19:18:15.215 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T19:18:15.216 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T19:18:15.216 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T19:18:15.216 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T19:18:15.216 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T19:18:15.216 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T19:18:15.217 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T19:18:15.218 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T19:18:15.218 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T19:18:15.218 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T19:18:15.218 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T19:18:15.218 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T19:18:15.219 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T19:18:15.219 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T19:18:15.219 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T19:18:15.219 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T19:18:15.219 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T19:18:15.220 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T19:18:15.220 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T19:18:15.220 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T19:18:15.220 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T19:18:15.220 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T19:18:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T19:18:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T19:18:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T19:18:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T19:18:15.221 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T19:18:15.222 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T19:18:15.222 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T19:18:15.222 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T19:18:15.222 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T19:18:15.222 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T19:18:15.223 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T19:18:15.224 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T19:18:15.224 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T19:18:15.224 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T19:18:15.224 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T19:18:15.224 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T19:18:15.225 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T19:18:15.226 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T19:18:15.226 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T19:18:15.226 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T19:18:15.226 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T19:18:15.226 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T19:18:15.227 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T19:18:15.227 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T19:18:15.227 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T19:18:15.227 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T19:18:15.227 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T19:18:15.228 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T19:18:15.228 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T19:18:15.228 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T19:18:15.228 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T19:18:15.228 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T19:18:15.229 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T19:18:15.230 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T19:18:15.230 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T19:18:15.230 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T19:18:15.230 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T19:18:15.230 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T19:18:15.231 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T19:18:15.231 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T19:18:15.231 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T19:18:15.231 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T19:18:15.231 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T19:18:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T19:18:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T19:18:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T19:18:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T19:18:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T19:18:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T19:18:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T19:18:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T19:18:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T19:18:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T19:18:15.234 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T19:18:15.234 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T19:18:15.234 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T19:18:15.234 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T19:18:15.234 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T19:18:15.235 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T19:18:15.236 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T19:18:15.236 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T19:18:15.236 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T19:18:15.236 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T19:18:15.236 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T19:18:15.237 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T19:18:15.237 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T19:18:15.237 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T19:18:15.237 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T19:18:15.237 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T19:18:15.238 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T19:18:15.239 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T19:18:15.239 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T19:18:15.239 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T19:18:15.239 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T19:18:15.239 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T19:18:15.240 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T19:18:15.241 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T19:18:15.241 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T19:18:15.241 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T19:18:15.241 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T19:18:15.241 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T19:18:15.242 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T19:18:15.242 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T19:18:15.242 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T19:18:15.242 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T19:18:15.242 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T19:18:15.243 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T19:18:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T19:18:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T19:18:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T19:18:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T19:18:15.244 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T19:18:15.245 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T19:18:15.246 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T19:18:15.246 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T19:18:15.246 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T19:18:15.246 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T19:18:15.246 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T19:18:15.247 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T19:18:15.247 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T19:18:15.247 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T19:18:15.247 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T19:18:15.247 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T19:18:15.248 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T19:18:15.249 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T19:18:15.249 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T19:18:15.249 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T19:18:15.249 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T19:18:15.249 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T19:18:15.250 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T19:18:15.250 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T19:18:15.250 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T19:18:15.250 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T19:18:15.250 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T19:18:15.251 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T19:18:15.252 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T19:18:15.252 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T19:18:15.252 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T19:18:15.252 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T19:18:15.252 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T19:18:15.253 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T19:18:15.253 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T19:18:15.253 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T19:18:15.253 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T19:18:15.253 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T19:18:15.254 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T19:18:15.254 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T19:18:15.254 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T19:18:15.254 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T19:18:15.254 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T19:18:15.255 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T19:18:15.256 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T19:18:15.256 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T19:18:15.256 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T19:18:15.256 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T19:18:15.256 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T19:18:15.257 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T19:18:15.257 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T19:18:15.257 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T19:18:15.257 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T19:18:15.257 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T19:18:15.258 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T19:18:15.258 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T19:18:15.258 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T19:18:15.258 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T19:18:15.258 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T19:18:15.259 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T19:18:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T19:18:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T19:18:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T19:18:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T19:18:15.260 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T19:18:15.261 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T19:18:15.262 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T19:18:15.262 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T19:18:15.262 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T19:18:15.262 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T19:18:15.262 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T19:18:15.263 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T19:18:15.263 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T19:18:15.263 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T19:18:15.263 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T19:18:15.263 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T19:18:15.264 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T19:18:15.264 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T19:18:15.264 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T19:18:15.264 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T19:18:15.264 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T19:18:15.265 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T19:18:15.266 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T19:18:15.266 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T19:18:15.266 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T19:18:15.266 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T19:18:15.266 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T19:18:15.267 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T19:18:15.267 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T19:18:15.267 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T19:18:15.267 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T19:18:15.267 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T19:18:15.268 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T19:18:15.269 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T19:18:15.269 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T19:18:15.269 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T19:18:15.269 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T19:18:15.269 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T19:18:15.270 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T19:18:15.270 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T19:18:15.270 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T19:18:15.270 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T19:18:15.270 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T19:18:15.271 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T19:18:15.272 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T19:18:15.272 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T19:18:15.272 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T19:18:15.272 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T19:18:15.272 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T19:18:15.273 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T19:18:15.273 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T19:18:15.273 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T19:18:15.273 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T19:18:15.273 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T19:18:15.274 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T19:18:15.275 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T19:18:15.275 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T19:18:15.275 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T19:18:15.275 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T19:18:15.275 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T19:18:15.276 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T19:18:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T19:18:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T19:18:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T19:18:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T19:18:15.277 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T19:18:15.278 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T19:18:15.278 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T19:18:15.278 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T19:18:15.278 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T19:18:15.278 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T19:18:15.279 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T19:18:15.280 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T19:18:15.280 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T19:18:15.280 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T19:18:15.280 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T19:18:15.281 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T19:18:15.282 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T19:18:15.282 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T19:18:15.282 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T19:18:15.282 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T19:18:15.282 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T19:18:15.283 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T19:18:15.283 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T19:18:15.283 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T19:18:15.283 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T19:18:15.283 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T19:18:15.284 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T19:18:15.285 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T19:18:15.285 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T19:18:15.285 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T19:18:15.285 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T19:18:15.285 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T19:18:15.286 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T19:18:15.287 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T19:18:15.287 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T19:18:15.287 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T19:18:15.287 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T19:18:15.287 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T19:18:15.288 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T19:18:15.288 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T19:18:15.288 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T19:18:15.288 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T19:18:15.289 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T19:18:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T19:18:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T19:18:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T19:18:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T19:18:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T19:18:15.291 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T19:18:15.291 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T19:18:15.291 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T19:18:15.291 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T19:18:15.291 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T19:18:15.292 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T19:18:15.292 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T19:18:15.292 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T19:18:15.292 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T19:18:15.292 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T19:18:15.293 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T19:18:15.294 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T19:18:15.294 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T19:18:15.294 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T19:18:15.294 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T19:18:15.294 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T19:18:15.295 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T19:18:15.295 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T19:18:15.295 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T19:18:15.295 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T19:18:15.295 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T19:18:15.296 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T19:18:15.296 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T19:18:15.296 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T19:18:15.296 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T19:18:15.296 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T19:18:15.297 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T19:18:15.297 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T19:18:15.297 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T19:18:15.297 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T19:18:15.297 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T19:18:15.298 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T19:18:15.298 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T19:18:15.298 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T19:18:15.298 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T19:18:15.298 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T19:18:15.299 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T19:18:15.300 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T19:18:15.300 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T19:18:15.300 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T19:18:15.300 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T19:18:15.300 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T19:18:15.301 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T19:18:15.301 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T19:18:15.301 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T19:18:15.301 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T19:18:15.301 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T19:18:15.302 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T19:18:15.302 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T19:18:15.302 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T19:18:15.302 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T19:18:15.302 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T19:18:15.303 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T19:18:15.303 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T19:18:15.303 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T19:18:15.303 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T19:18:15.303 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T19:18:15.304 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T19:18:15.304 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T19:18:15.304 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T19:18:15.304 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T19:18:15.304 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T19:18:15.305 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T19:18:15.305 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T19:18:15.305 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T19:18:15.305 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T19:18:15.305 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T19:18:15.306 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T19:18:15.306 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T19:18:15.306 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T19:18:15.306 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T19:18:15.306 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T19:18:15.307 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T19:18:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T19:18:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T19:18:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T19:18:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T19:18:15.308 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T19:18:15.309 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T19:18:15.310 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T19:18:15.310 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T19:18:15.310 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T19:18:15.310 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T19:18:15.310 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T19:18:15.311 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T19:18:15.312 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T19:18:15.312 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T19:18:15.312 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T19:18:15.312 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T19:18:15.312 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T19:18:15.313 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T19:18:15.313 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T19:18:15.313 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T19:18:15.313 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T19:18:15.313 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T19:18:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T19:18:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T19:18:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T19:18:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T19:18:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T19:18:15.315 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T19:18:15.316 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T19:18:15.316 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T19:18:15.316 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T19:18:15.316 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T19:18:15.316 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T19:18:15.317 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T19:18:15.317 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T19:18:15.317 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T19:18:15.317 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T19:18:15.317 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T19:18:15.318 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T19:18:15.318 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T19:18:15.318 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T19:18:15.318 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T19:18:15.318 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T19:18:15.319 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T19:18:15.319 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T19:18:15.319 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T19:18:15.319 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T19:18:15.319 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T19:18:15.320 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T19:18:15.320 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T19:18:15.320 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T19:18:15.320 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T19:18:15.320 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T19:18:15.321 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T19:18:15.322 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T19:18:15.322 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T19:18:15.322 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T19:18:15.322 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T19:18:15.322 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T19:18:15.323 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T19:18:15.323 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T19:18:15.323 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T19:18:15.323 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T19:18:15.323 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T19:18:15.324 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T19:18:15.325 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T19:18:15.325 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T19:18:15.325 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T19:18:15.325 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T19:18:15.325 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T19:18:15.326 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T19:18:15.326 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T19:18:15.326 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T19:18:15.326 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T19:18:15.326 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T19:18:15.327 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T19:18:15.328 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T19:18:15.328 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T19:18:15.328 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T19:18:15.328 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T19:18:15.328 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T19:18:15.329 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T19:18:15.330 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T19:18:15.330 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T19:18:15.330 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T19:18:15.330 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T19:18:15.331 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T19:18:15.332 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T19:18:15.332 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T19:18:15.332 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T19:18:15.332 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T19:18:15.332 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T19:18:15.333 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T19:18:15.333 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T19:18:15.333 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T19:18:15.333 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T19:18:15.333 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T19:18:15.334 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T19:18:15.335 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T19:18:15.335 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T19:18:15.335 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T19:18:15.335 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T19:18:15.335 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T19:18:15.336 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T19:18:15.336 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T19:18:15.336 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T19:18:15.336 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T19:18:15.336 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T19:18:15.337 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T19:18:15.337 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T19:18:15.337 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T19:18:15.337 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T19:18:15.337 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T19:18:15.338 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T19:18:15.338 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T19:18:15.338 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T19:18:15.338 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T19:18:15.338 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T19:18:15.339 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T19:18:15.339 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T19:18:15.339 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T19:18:15.339 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T19:18:15.339 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T19:18:15.340 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T19:18:15.341 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T19:18:15.341 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T19:18:15.341 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T19:18:15.341 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T19:18:15.341 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T19:18:15.342 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T19:18:15.342 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T19:18:15.342 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T19:18:15.342 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T19:18:15.342 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T19:18:15.343 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T19:18:15.344 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T19:18:15.344 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T19:18:15.344 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T19:18:15.344 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T19:18:15.344 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T19:18:15.345 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T19:18:15.345 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T19:18:15.345 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T19:18:15.345 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T19:18:15.345 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T19:18:15.346 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T19:18:15.346 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T19:18:15.346 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T19:18:15.346 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T19:18:15.346 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T19:18:15.347 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T19:18:15.347 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T19:18:15.347 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T19:18:15.347 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T19:18:15.347 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T19:18:15.348 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T19:18:15.349 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T19:18:15.349 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T19:18:15.349 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T19:18:15.349 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T19:18:15.349 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T19:18:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T19:18:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T19:18:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T19:18:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T19:18:15.350 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T19:18:15.351 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T19:18:15.351 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T19:18:15.351 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T19:18:15.351 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T19:18:15.351 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T19:18:15.352 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T19:18:15.352 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T19:18:15.352 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T19:18:15.352 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T19:18:15.352 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T19:18:15.353 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T19:18:15.354 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T19:18:15.354 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T19:18:15.354 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T19:18:15.354 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T19:18:15.354 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T19:18:15.355 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T19:18:15.355 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T19:18:15.355 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T19:18:15.355 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T19:18:15.355 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T19:18:15.356 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T19:18:15.356 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T19:18:15.356 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T19:18:15.356 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T19:18:15.356 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T19:18:15.357 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T19:18:15.358 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T19:18:15.358 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T19:18:15.358 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T19:18:15.358 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T19:18:15.358 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T19:18:15.359 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T19:18:15.359 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T19:18:15.359 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T19:18:15.359 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T19:18:15.359 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T19:18:15.360 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T19:18:15.360 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T19:18:15.360 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T19:18:15.360 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T19:18:15.360 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T19:18:15.361 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T19:18:15.362 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T19:18:15.362 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T19:18:15.362 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T19:18:15.362 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T19:18:15.362 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T19:18:15.363 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T19:18:15.363 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T19:18:15.363 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T19:18:15.363 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T19:18:15.363 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T19:18:15.364 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T19:18:15.364 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T19:18:15.364 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T19:18:15.364 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T19:18:15.364 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T19:18:15.365 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T19:18:15.365 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T19:18:15.365 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T19:18:15.365 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T19:18:15.365 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T19:18:15.366 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T19:18:15.367 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T19:18:15.367 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T19:18:15.367 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T19:18:15.367 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T19:18:15.367 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T19:18:15.368 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T19:18:15.368 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T19:18:15.368 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T19:18:15.368 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T19:18:15.368 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T19:18:15.369 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T19:18:15.369 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T19:18:15.369 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T19:18:15.369 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T19:18:15.369 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T19:18:15.370 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T19:18:15.370 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T19:18:15.370 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T19:18:15.370 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T19:18:15.370 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T19:18:15.371 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T19:18:15.372 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T19:18:15.372 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T19:18:15.372 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T19:18:15.372 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T19:18:15.372 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T19:18:15.373 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T19:18:15.373 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T19:18:15.373 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T19:18:15.373 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T19:18:15.373 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T19:18:15.374 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T19:18:15.374 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T19:18:15.374 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T19:18:15.374 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T19:18:15.374 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T19:18:15.375 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T19:18:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T19:18:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T19:18:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T19:18:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T19:18:15.376 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T19:18:15.377 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T19:18:15.377 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T19:18:15.377 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T19:18:15.377 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T19:18:15.377 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T19:18:15.378 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T19:18:15.378 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T19:18:15.378 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T19:18:15.378 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T19:18:15.378 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T19:18:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T19:18:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T19:18:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T19:18:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T19:18:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T19:18:15.380 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T19:18:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T19:18:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T19:18:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T19:18:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T19:18:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T19:18:15.382 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T19:18:15.382 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T19:18:15.382 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T19:18:15.382 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T19:18:15.382 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T19:18:15.383 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T19:18:15.383 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T19:18:15.383 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T19:18:15.383 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T19:18:15.383 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T19:18:15.384 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T19:18:15.385 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T19:18:15.385 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T19:18:15.385 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T19:18:15.385 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T19:18:15.385 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T19:18:15.386 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T19:18:15.386 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T19:18:15.386 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T19:18:15.386 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T19:18:15.386 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T19:18:15.387 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T19:18:15.387 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T19:18:15.387 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T19:18:15.387 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T19:18:15.387 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T19:18:15.388 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T19:18:15.388 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T19:18:15.388 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T19:18:15.388 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T19:18:15.388 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T19:18:15.389 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T19:18:15.390 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T19:18:15.390 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T19:18:15.390 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T19:18:15.390 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T19:18:15.390 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T19:18:15.391 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T19:18:15.391 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T19:18:15.391 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T19:18:15.391 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T19:18:15.391 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T19:18:15.392 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T19:18:15.393 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T19:18:15.393 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T19:18:15.393 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T19:18:15.393 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T19:18:15.393 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T19:18:15.394 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T19:18:15.394 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T19:18:15.394 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T19:18:15.394 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T19:18:15.394 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T19:18:15.395 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T19:18:15.395 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T19:18:15.395 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T19:18:15.395 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T19:18:15.395 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T19:18:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T19:18:15.397 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T19:18:15.397 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T19:18:15.397 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T19:18:15.397 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T19:18:15.397 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T19:18:15.398 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T19:18:15.398 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T19:18:15.398 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T19:18:15.398 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T19:18:15.398 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T19:18:15.399 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T19:18:15.399 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T19:18:15.399 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T19:18:15.399 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T19:18:15.399 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T19:18:15.400 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T19:18:15.401 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T19:18:15.401 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T19:18:15.401 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T19:18:15.401 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T19:18:15.401 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T19:18:15.402 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T19:18:15.402 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T19:18:15.402 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T19:18:15.402 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T19:18:15.402 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T19:18:15.403 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T19:18:15.404 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T19:18:15.404 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T19:18:15.404 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T19:18:15.404 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T19:18:15.404 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T19:18:15.405 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T19:18:15.406 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T19:18:15.406 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T19:18:15.406 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T19:18:15.406 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T19:18:15.406 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T19:18:15.407 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T19:18:15.407 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T19:18:15.407 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T19:18:15.407 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T19:18:15.407 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T19:18:15.408 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T19:18:15.408 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T19:18:15.408 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T19:18:15.408 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T19:18:15.408 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T19:18:15.409 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T19:18:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T19:18:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T19:18:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T19:18:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T19:18:15.410 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T19:18:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T19:18:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T19:18:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T19:18:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T19:18:15.411 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T19:18:15.412 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T19:18:15.413 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T19:18:15.413 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T19:18:15.413 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T19:18:15.413 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T19:18:15.413 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T19:18:15.414 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T19:18:15.415 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T19:18:15.415 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T19:18:15.415 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T19:18:15.415 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T19:18:15.415 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T19:18:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T19:18:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T19:18:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T19:18:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T19:18:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T19:18:15.417 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T19:18:15.418 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T19:18:15.418 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T19:18:15.418 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T19:18:15.418 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T19:18:15.419 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T19:18:15.420 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T19:18:15.420 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T19:18:15.420 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T19:18:15.420 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T19:18:15.420 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T19:18:15.421 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T19:18:15.421 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T19:18:15.421 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T19:18:15.421 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T19:18:15.421 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T19:18:15.422 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T19:18:15.422 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T19:18:15.422 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T19:18:15.422 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T19:18:15.422 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T19:18:15.423 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T19:18:15.424 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T19:18:15.424 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T19:18:15.424 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T19:18:15.424 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T19:18:15.424 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T19:18:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T19:18:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T19:18:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T19:18:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T19:18:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T19:18:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T19:18:15.427 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T19:18:15.427 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T19:18:15.427 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T19:18:15.427 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T19:18:15.427 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T19:18:15.428 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T19:18:15.428 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T19:18:15.428 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T19:18:15.428 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T19:18:15.428 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T19:18:15.429 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T19:18:15.430 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T19:18:15.430 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T19:18:15.430 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T19:18:15.430 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T19:18:15.430 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T19:18:15.431 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T19:18:15.431 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T19:18:15.431 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T19:18:15.431 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T19:18:15.431 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T19:18:15.432 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T19:18:15.433 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T19:18:15.433 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T19:18:15.433 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T19:18:15.433 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T19:18:15.433 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T19:18:15.434 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T19:18:15.434 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T19:18:15.434 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T19:18:15.434 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T19:18:15.434 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T19:18:15.435 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T19:18:15.436 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T19:18:15.436 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T19:18:15.436 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T19:18:15.436 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T19:18:15.436 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T19:18:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T19:18:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T19:18:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T19:18:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T19:18:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T19:18:15.438 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T19:18:15.438 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T19:18:15.438 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T19:18:15.438 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T19:18:15.438 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T19:18:15.439 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T19:18:15.440 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T19:18:15.440 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T19:18:15.440 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T19:18:15.440 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T19:18:15.440 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T19:18:15.441 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T19:18:15.442 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T19:18:15.442 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T19:18:15.442 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T19:18:15.442 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T19:18:15.442 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T19:18:15.443 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T19:18:15.443 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T19:18:15.443 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T19:18:15.443 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T19:18:15.443 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T19:18:15.444 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T19:18:15.445 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T19:18:15.446 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T19:18:15.446 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T19:18:15.446 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T19:18:15.446 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T19:18:15.446 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T19:18:15.447 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T19:18:15.448 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T19:18:15.448 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T19:18:15.448 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T19:18:15.448 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T19:18:15.448 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T19:18:15.449 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T19:18:15.450 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T19:18:15.450 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T19:18:15.450 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T19:18:15.450 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T19:18:15.450 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T19:18:15.451 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T19:18:15.451 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T19:18:15.451 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T19:18:15.451 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T19:18:15.451 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T19:18:15.452 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T19:18:15.453 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T19:18:15.453 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T19:18:15.453 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T19:18:15.453 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T19:18:15.453 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T19:18:15.454 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T19:18:15.455 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T19:18:15.455 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T19:18:15.455 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T19:18:15.455 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T19:18:15.455 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T19:18:15.456 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T19:18:15.457 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T19:18:15.457 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T19:18:15.457 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T19:18:15.457 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T19:18:15.457 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T19:18:15.458 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T19:18:15.458 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T19:18:15.458 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T19:18:15.458 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T19:18:15.458 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T19:18:15.459 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T19:18:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T19:18:15.461 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T19:18:15.461 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T19:18:15.461 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T19:18:15.461 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T19:18:15.461 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T19:18:15.462 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T19:18:15.462 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T19:18:15.462 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T19:18:15.462 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T19:18:15.462 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T19:18:15.463 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T19:18:15.464 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T19:18:15.464 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T19:18:15.464 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T19:18:15.464 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T19:18:15.464 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T19:18:15.465 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T19:18:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T19:18:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T19:18:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T19:18:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T19:18:15.466 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T19:18:15.467 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T19:18:15.467 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T19:18:15.467 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T19:18:15.467 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T19:18:15.467 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T19:18:15.468 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T19:18:15.469 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T19:18:15.469 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T19:18:15.469 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T19:18:15.469 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T19:18:15.469 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T19:18:15.470 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T19:18:15.470 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T19:18:15.470 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T19:18:15.470 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T19:18:15.470 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T19:18:15.471 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T19:18:15.471 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T19:18:15.471 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T19:18:15.471 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T19:18:15.471 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T19:18:15.472 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T19:18:15.473 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T19:18:15.473 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T19:18:15.473 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T19:18:15.473 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T19:18:15.473 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T19:18:15.474 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T19:18:15.474 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T19:18:15.474 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T19:18:15.474 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T19:18:15.474 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T19:18:15.475 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T19:18:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T19:18:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T19:18:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T19:18:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T19:18:15.476 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T19:18:15.477 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T19:18:15.478 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T19:18:15.478 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T19:18:15.478 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T19:18:15.478 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T19:18:15.478 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T19:18:15.479 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T19:18:15.479 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T19:18:15.479 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T19:18:15.479 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T19:18:15.479 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T19:18:15.480 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T19:18:15.480 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T19:18:15.480 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T19:18:15.480 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T19:18:15.480 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T19:18:15.481 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T19:18:15.482 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T19:18:15.482 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T19:18:15.482 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T19:18:15.482 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T19:18:15.482 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T19:18:15.483 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T19:18:15.484 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T19:18:15.484 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T19:18:15.484 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T19:18:15.484 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T19:18:15.484 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T19:18:15.485 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T19:18:15.485 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T19:18:15.485 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T19:18:15.485 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T19:18:15.485 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T19:18:15.486 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T19:18:15.486 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T19:18:15.486 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T19:18:15.486 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T19:18:15.486 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T19:18:15.487 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T19:18:15.488 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T19:18:15.488 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T19:18:15.488 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T19:18:15.488 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T19:18:15.488 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T19:18:15.489 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T19:18:15.490 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T19:18:15.490 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T19:18:15.490 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T19:18:15.490 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T19:18:15.490 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T19:18:15.491 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T19:18:15.491 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T19:18:15.491 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T19:18:15.491 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T19:18:15.491 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T19:18:15.492 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T19:18:15.492 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T19:18:15.492 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T19:18:15.492 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T19:18:15.492 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T19:18:15.493 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T19:18:15.494 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T19:18:15.494 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T19:18:15.494 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T19:18:15.494 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T19:18:15.494 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T19:18:15.495 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T19:18:15.496 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T19:18:15.496 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T19:18:15.496 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T19:18:15.496 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T19:18:15.496 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T19:18:15.497 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T19:18:15.498 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T19:18:15.498 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T19:18:15.498 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T19:18:15.498 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T19:18:15.498 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T19:18:15.499 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T19:18:15.499 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T19:18:15.499 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T19:18:15.499 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T19:18:15.499 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T19:18:15.500 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T19:18:15.501 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T19:18:15.501 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T19:18:15.501 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T19:18:15.501 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T19:18:15.501 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T19:18:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T19:18:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T19:18:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T19:18:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T19:18:15.502 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T19:18:15.503 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T19:18:15.503 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T19:18:15.503 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T19:18:15.503 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T19:18:15.503 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T19:18:15.504 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T19:18:15.504 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T19:18:15.504 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T19:18:15.504 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T19:18:15.504 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T19:18:15.505 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T19:18:15.505 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T19:18:15.505 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T19:18:15.505 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T19:18:15.505 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T19:18:15.506 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T19:18:15.507 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T19:18:15.507 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T19:18:15.507 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T19:18:15.507 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T19:18:15.507 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T19:18:15.508 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T19:18:15.508 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T19:18:15.508 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T19:18:15.508 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T19:18:15.508 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T19:18:15.509 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T19:18:15.510 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T19:18:15.510 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T19:18:15.510 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T19:18:15.510 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T19:18:15.510 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T19:18:15.511 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T19:18:15.511 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T19:18:15.511 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T19:18:15.511 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T19:18:15.511 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T19:18:15.512 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T19:18:15.513 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T19:18:15.513 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T19:18:15.513 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T19:18:15.513 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T19:18:15.513 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T19:18:15.514 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T19:18:15.514 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T19:18:15.514 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T19:18:15.514 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T19:18:15.514 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T19:18:15.515 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T19:18:15.515 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T19:18:15.515 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T19:18:15.515 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T19:18:15.515 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T19:18:15.516 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T19:18:15.517 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T19:18:15.517 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T19:18:15.517 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T19:18:15.517 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T19:18:15.517 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T19:18:15.518 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T19:18:15.518 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T19:18:15.518 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T19:18:15.518 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T19:18:15.518 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T19:18:15.519 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T19:18:15.519 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T19:18:15.519 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T19:18:15.519 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T19:18:15.519 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T19:18:15.520 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T19:18:15.520 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T19:18:15.520 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T19:18:15.520 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T19:18:15.520 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T19:18:15.521 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T19:18:15.522 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T19:18:15.522 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T19:18:15.522 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T19:18:15.522 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T19:18:15.522 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T19:18:15.523 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T19:18:15.523 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T19:18:15.523 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T19:18:15.523 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T19:18:15.523 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T19:18:15.524 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T19:18:15.525 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T19:18:15.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T19:18:15.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T19:18:15.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T19:18:15.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T19:18:15.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T19:18:15.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T19:18:15.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T19:18:15.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T19:18:15.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T19:18:15.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T19:18:15.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T19:18:15.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T19:18:15.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T19:18:15.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T19:18:15.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T19:18:15.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T19:18:15.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T19:18:15.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T19:18:15.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T19:18:15.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T19:18:15.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T19:18:15.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T19:18:15.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T19:18:15.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T19:18:15.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T19:18:15.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T19:18:15.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T19:18:15.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T19:18:15.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T19:18:15.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T19:18:15.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T19:18:15.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T19:18:15.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T19:18:15.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T19:18:15.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T19:18:15.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T19:18:15.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T19:18:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T19:18:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T19:18:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T19:18:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T19:18:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T19:18:15.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T19:18:15.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T19:18:15.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T19:18:15.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T19:18:15.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T19:18:15.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T19:18:15.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T19:18:15.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T19:18:15.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T19:18:15.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T19:18:15.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T19:18:15.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T19:18:15.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T19:18:15.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T19:18:15.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T19:18:15.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T19:18:15.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T19:18:15.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T19:18:15.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T19:18:15.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T19:18:15.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T19:18:15.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T19:18:15.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T19:18:15.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T19:18:15.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T19:18:15.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T19:18:15.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T19:18:15.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T19:18:15.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T19:18:15.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T19:18:15.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T19:18:15.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T19:18:15.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T19:18:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T19:18:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T19:18:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T19:18:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T19:18:15.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T19:18:15.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T19:18:15.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T19:18:15.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T19:18:15.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T19:18:15.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T19:18:15.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T19:18:15.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T19:18:15.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T19:18:15.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T19:18:15.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T19:18:15.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T19:18:15.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T19:18:15.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T19:18:15.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T19:18:15.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T19:18:15.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T19:18:15.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T19:18:15.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T19:18:15.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T19:18:15.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T19:18:15.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T19:18:15.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T19:18:15.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T19:18:15.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T19:18:15.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T19:18:15.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T19:18:15.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T19:18:15.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T19:18:15.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T19:18:15.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T19:18:15.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T19:18:15.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T19:18:15.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T19:18:15.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T19:18:15.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T19:18:15.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T19:18:15.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T19:18:15.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T19:18:15.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T19:18:15.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T19:18:15.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T19:18:15.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T19:18:15.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T19:18:15.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T19:18:15.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T19:18:15.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T19:18:15.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T19:18:15.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T19:18:15.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T19:18:15.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T19:18:15.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T19:18:15.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T19:18:15.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T19:18:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T19:18:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T19:18:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T19:18:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T19:18:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T19:18:15.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T19:18:15.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T19:18:15.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T19:18:15.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T19:18:15.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T19:18:15.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T19:18:15.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T19:18:15.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T19:18:15.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T19:18:15.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T19:18:15.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T19:18:15.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T19:18:15.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T19:18:15.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T19:18:15.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T19:18:15.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T19:18:15.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T19:18:15.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T19:18:15.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T19:18:15.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T19:18:15.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T19:18:15.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T19:18:15.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T19:18:15.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T19:18:15.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T19:18:15.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T19:18:15.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T19:18:15.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T19:18:15.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T19:18:15.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T19:18:15.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T19:18:15.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T19:18:15.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T19:18:15.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T19:18:15.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T19:18:15.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T19:18:15.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T19:18:15.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T19:18:15.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T19:18:15.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T19:18:15.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T19:18:15.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T19:18:15.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T19:18:15.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T19:18:15.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T19:18:15.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T19:18:15.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T19:18:15.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T19:18:15.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T19:18:15.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T19:18:15.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T19:18:15.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T19:18:15.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T19:18:15.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T19:18:15.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T19:18:15.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T19:18:15.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T19:18:15.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T19:18:15.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T19:18:15.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T19:18:15.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T19:18:15.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T19:18:15.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T19:18:15.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T19:18:15.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T19:18:15.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T19:18:15.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T19:18:15.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T19:18:15.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T19:18:15.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T19:18:15.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T19:18:15.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T19:18:15.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T19:18:15.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T19:18:15.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T19:18:15.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T19:18:15.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T19:18:15.582 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.582 DEBUG:teuthology.orchestra.run.smithi192:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:15.611 INFO:teuthology.orchestra.run.smithi192.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T19:18:15.612 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T19:18:15.612 INFO:teuthology.orchestra.run.smithi192.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:15.612 INFO:teuthology.orchestra.run.smithi192.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:15.612 INFO:teuthology.orchestra.run.smithi192.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T19:18:15.613 INFO:teuthology.orchestra.run.smithi192.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T19:18:15.614 INFO:teuthology.orchestra.run.smithi192.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T19:18:15.614 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.614 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2023-10-18T19:18:15.614 INFO:teuthology.orchestra.run.smithi192.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:15.614 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T19:18:15.615 INFO:teuthology.orchestra.run.smithi192.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.615 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2023-10-18T19:18:15.616 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2023-10-18T19:18:15.694 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2023-10-18T19:18:15.695 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2023-10-18T19:18:15.695 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.02 2023-10-18T19:18:15.695 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 129.el8 2023-10-18T19:18:15.695 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2023-10-18T19:18:15.695 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-18T19:18:15.696 INFO:teuthology.orchestra.run.smithi192.stdout:Group : System Environment/Base 2023-10-18T19:18:15.696 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 9265586 2023-10-18T19:18:15.696 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2023-10-18T19:18:15.696 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Relocations : (not relocatable) 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : CentOS BuildSystem 2023-10-18T19:18:15.697 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2023-10-18T19:18:15.698 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T19:18:15.698 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2023-10-18T19:18:15.698 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2023-10-18T19:18:15.698 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:18:15.698 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T19:18:15.699 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T19:18:15.699 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T19:18:15.699 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2023-10-18T19:18:15.699 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:18:15.699 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T19:18:15.700 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T19:18:15.701 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 6.6.0-rc5-g47672119149b 2023-10-18T19:18:15.701 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T19:18:16.660 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-10-18T19:18:16.664 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-10-18T19:18:16.715 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.sJfpI4uoaA 2023-10-18T19:18:16.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sJfpI4uoaA 2023-10-18T19:18:16.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.sJfpI4uoaA 2023-10-18T19:18:16.906 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.sJfpI4uoaA is 6KB 2023-10-18T19:18:16.955 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.sJfpI4uoaA 2023-10-18T19:18:16.973 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T19:18:17.050 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-18T19:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-18T19:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-18T19:18:17.051 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b.conf 2023-10-18T19:18:17.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b 2023-10-18T19:18:17.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-10-18T19:18:18.872 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-10-18T19:18:21.003 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-10-18T19:18:21.004 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-10-18T19:18:21.027 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.5r3w9PIcmb 2023-10-18T19:18:21.027 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5r3w9PIcmb 2023-10-18T19:18:21.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.5r3w9PIcmb 2023-10-18T19:18:21.233 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.5r3w9PIcmb is 6KB 2023-10-18T19:18:21.258 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.5r3w9PIcmb 2023-10-18T19:18:21.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T19:18:21.341 INFO:teuthology.orchestra.run.smithi192.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-18T19:18:21.342 INFO:teuthology.orchestra.run.smithi192.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-18T19:18:21.342 INFO:teuthology.orchestra.run.smithi192.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-18T19:18:21.342 INFO:teuthology.orchestra.run.smithi192.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b.conf 2023-10-18T19:18:21.344 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b 2023-10-18T19:18:21.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-10-18T19:18:31.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-18T19:18:31.642 DEBUG:teuthology.orchestra.run.smithi184:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:31.700 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:31.700 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-18T19:18:31.700 INFO:teuthology.orchestra.run.smithi184.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T19:18:31.701 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-18T19:18:31.701 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-18T19:18:31.701 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-18T19:18:31.701 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-18T19:18:31.701 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-18T19:18:31.702 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T19:18:31.702 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T19:18:31.702 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T19:18:31.702 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T19:18:31.702 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T19:18:31.703 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T19:18:31.703 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T19:18:31.703 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-18T19:18:31.703 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T19:18:31.703 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T19:18:31.704 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T19:18:31.704 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T19:18:31.704 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T19:18:31.704 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T19:18:31.704 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T19:18:31.705 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T19:18:31.705 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T19:18:31.705 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T19:18:31.705 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T19:18:31.705 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T19:18:31.706 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-18T19:18:31.706 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-18T19:18:31.706 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-18T19:18:31.706 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T19:18:31.706 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T19:18:31.707 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T19:18:31.708 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T19:18:31.709 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T19:18:31.709 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T19:18:31.709 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T19:18:31.709 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T19:18:31.710 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T19:18:31.710 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T19:18:31.710 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T19:18:31.710 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T19:18:31.710 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T19:18:31.711 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T19:18:31.711 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T19:18:31.711 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T19:18:31.711 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T19:18:31.711 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T19:18:31.712 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T19:18:31.712 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T19:18:31.712 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T19:18:31.712 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T19:18:31.712 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T19:18:31.713 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T19:18:31.714 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T19:18:31.714 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T19:18:31.714 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T19:18:31.714 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T19:18:31.714 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T19:18:31.715 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T19:18:31.715 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T19:18:31.715 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T19:18:31.715 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T19:18:31.715 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T19:18:31.716 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-18T19:18:31.717 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T19:18:31.718 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T19:18:31.718 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T19:18:31.718 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T19:18:31.718 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T19:18:31.718 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-18T19:18:31.719 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T19:18:31.719 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T19:18:31.719 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-18T19:18:31.719 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T19:18:31.719 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T19:18:31.720 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T19:18:31.721 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T19:18:31.721 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T19:18:31.721 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T19:18:31.721 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T19:18:31.721 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T19:18:31.722 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T19:18:31.722 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T19:18:31.722 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T19:18:31.722 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T19:18:31.722 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T19:18:31.723 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T19:18:31.724 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T19:18:31.724 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T19:18:31.724 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T19:18:31.724 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T19:18:31.724 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T19:18:31.725 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T19:18:31.725 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T19:18:31.725 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T19:18:31.725 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T19:18:31.725 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T19:18:31.726 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T19:18:31.726 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-18T19:18:31.726 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T19:18:31.726 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T19:18:31.726 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T19:18:31.727 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T19:18:31.727 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T19:18:31.727 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T19:18:31.727 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T19:18:31.727 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T19:18:31.728 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T19:18:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T19:18:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T19:18:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T19:18:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-18T19:18:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T19:18:31.730 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-18T19:18:31.730 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-18T19:18:31.730 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-18T19:18:31.730 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-18T19:18:31.730 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-18T19:18:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T19:18:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-18T19:18:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-18T19:18:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T19:18:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-18T19:18:31.732 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T19:18:31.733 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T19:18:31.733 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-18T19:18:31.733 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T19:18:31.733 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T19:18:31.733 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T19:18:31.734 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-18T19:18:31.734 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-18T19:18:31.734 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T19:18:31.734 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-18T19:18:31.734 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-18T19:18:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T19:18:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-18T19:18:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T19:18:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-18T19:18:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T19:18:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T19:18:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T19:18:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T19:18:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T19:18:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-18T19:18:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T19:18:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T19:18:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T19:18:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T19:18:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T19:18:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T19:18:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T19:18:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-18T19:18:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T19:18:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T19:18:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T19:18:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-18T19:18:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-18T19:18:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T19:18:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T19:18:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T19:18:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-18T19:18:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-18T19:18:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-18T19:18:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-18T19:18:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-18T19:18:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-18T19:18:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T19:18:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T19:18:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-18T19:18:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-18T19:18:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T19:18:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-18T19:18:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-18T19:18:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T19:18:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-18T19:18:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T19:18:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T19:18:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T19:18:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-18T19:18:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T19:18:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-18T19:18:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T19:18:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-18T19:18:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-18T19:18:31.745 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-18T19:18:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-18T19:18:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T19:18:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-18T19:18:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T19:18:31.746 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-18T19:18:31.747 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T19:18:31.747 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T19:18:31.747 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T19:18:31.747 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T19:18:31.747 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T19:18:31.748 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T19:18:31.749 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T19:18:31.749 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T19:18:31.749 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-18T19:18:31.749 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-18T19:18:31.749 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T19:18:31.750 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-18T19:18:31.750 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T19:18:31.750 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T19:18:31.750 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-18T19:18:31.750 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T19:18:31.751 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T19:18:31.752 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T19:18:31.752 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T19:18:31.752 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T19:18:31.752 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T19:18:31.753 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T19:18:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T19:18:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T19:18:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T19:18:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T19:18:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T19:18:31.755 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T19:18:31.755 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T19:18:31.755 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T19:18:31.755 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T19:18:31.755 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T19:18:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T19:18:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T19:18:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T19:18:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T19:18:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T19:18:31.757 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T19:18:31.758 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T19:18:31.758 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T19:18:31.758 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T19:18:31.758 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T19:18:31.758 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T19:18:31.759 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T19:18:31.759 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T19:18:31.759 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T19:18:31.759 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T19:18:31.759 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T19:18:31.760 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T19:18:31.760 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T19:18:31.760 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T19:18:31.760 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T19:18:31.760 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T19:18:31.761 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T19:18:31.761 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T19:18:31.761 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T19:18:31.761 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T19:18:31.761 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T19:18:31.762 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T19:18:31.762 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T19:18:31.762 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T19:18:31.762 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T19:18:31.762 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T19:18:31.763 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T19:18:31.764 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T19:18:31.765 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T19:18:31.765 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T19:18:31.765 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T19:18:31.765 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T19:18:31.765 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T19:18:31.766 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T19:18:31.766 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T19:18:31.766 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T19:18:31.766 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T19:18:31.766 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T19:18:31.767 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T19:18:31.768 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T19:18:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T19:18:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T19:18:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T19:18:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T19:18:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T19:18:31.770 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T19:18:31.770 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T19:18:31.770 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T19:18:31.770 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T19:18:31.770 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T19:18:31.771 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T19:18:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T19:18:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T19:18:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T19:18:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T19:18:31.772 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T19:18:31.773 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T19:18:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T19:18:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T19:18:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T19:18:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T19:18:31.774 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T19:18:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T19:18:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T19:18:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T19:18:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T19:18:31.775 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T19:18:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T19:18:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T19:18:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T19:18:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T19:18:31.776 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T19:18:31.777 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T19:18:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T19:18:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T19:18:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T19:18:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T19:18:31.778 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T19:18:31.779 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T19:18:31.779 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T19:18:31.779 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T19:18:31.779 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T19:18:31.779 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T19:18:31.780 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T19:18:31.781 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T19:18:31.781 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T19:18:31.781 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T19:18:31.781 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T19:18:31.781 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T19:18:31.782 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T19:18:31.782 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T19:18:31.782 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T19:18:31.782 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T19:18:31.782 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T19:18:31.783 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T19:18:31.783 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T19:18:31.783 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T19:18:31.783 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T19:18:31.783 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T19:18:31.784 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T19:18:31.784 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T19:18:31.784 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T19:18:31.784 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T19:18:31.784 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T19:18:31.785 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T19:18:31.786 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T19:18:31.786 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T19:18:31.786 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T19:18:31.786 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T19:18:31.786 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T19:18:31.787 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T19:18:31.787 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T19:18:31.787 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T19:18:31.787 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T19:18:31.787 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T19:18:31.788 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T19:18:31.788 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T19:18:31.788 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-18T19:18:31.788 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-18T19:18:31.788 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T19:18:31.789 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T19:18:31.790 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T19:18:31.790 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T19:18:31.790 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T19:18:31.790 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T19:18:31.791 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T19:18:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T19:18:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T19:18:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T19:18:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T19:18:31.792 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T19:18:31.793 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T19:18:31.793 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T19:18:31.793 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T19:18:31.793 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T19:18:31.793 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-18T19:18:31.794 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T19:18:31.794 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-18T19:18:31.794 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T19:18:31.794 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T19:18:31.794 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-18T19:18:31.795 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-18T19:18:31.795 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T19:18:31.795 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T19:18:31.795 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T19:18:31.795 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T19:18:31.796 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T19:18:31.796 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T19:18:31.796 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T19:18:31.796 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-18T19:18:31.796 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-18T19:18:31.797 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T19:18:31.797 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-18T19:18:31.797 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T19:18:31.797 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-18T19:18:31.797 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T19:18:31.798 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-18T19:18:31.798 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T19:18:31.798 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-18T19:18:31.798 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-18T19:18:31.799 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T19:18:31.799 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-18T19:18:31.799 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T19:18:31.799 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-18T19:18:31.799 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T19:18:31.800 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-18T19:18:31.800 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T19:18:31.800 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-18T19:18:31.800 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T19:18:31.800 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T19:18:31.801 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-18T19:18:31.802 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T19:18:31.802 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-18T19:18:31.802 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T19:18:31.802 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T19:18:31.802 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T19:18:31.803 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T19:18:31.803 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T19:18:31.803 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T19:18:31.803 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T19:18:31.803 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T19:18:31.804 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T19:18:31.805 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T19:18:31.805 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T19:18:31.805 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-18T19:18:31.805 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-18T19:18:31.805 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T19:18:31.806 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-18T19:18:31.806 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T19:18:31.806 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T19:18:31.806 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T19:18:31.806 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T19:18:31.807 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-18T19:18:31.807 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T19:18:31.807 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T19:18:31.807 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T19:18:31.807 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-18T19:18:31.808 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-18T19:18:31.809 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T19:18:31.809 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T19:18:31.809 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T19:18:31.809 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T19:18:31.810 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T19:18:31.811 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T19:18:31.811 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T19:18:31.811 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T19:18:31.811 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T19:18:31.811 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T19:18:31.812 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T19:18:31.812 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T19:18:31.812 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T19:18:31.812 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T19:18:31.812 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-18T19:18:31.813 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T19:18:31.813 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T19:18:31.813 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T19:18:31.813 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T19:18:31.813 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T19:18:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-18T19:18:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-18T19:18:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T19:18:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T19:18:31.814 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T19:18:31.815 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T19:18:31.815 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T19:18:31.815 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T19:18:31.815 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T19:18:31.815 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-18T19:18:31.816 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T19:18:31.816 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T19:18:31.816 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-18T19:18:31.816 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T19:18:31.816 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T19:18:31.817 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T19:18:31.818 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T19:18:31.818 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T19:18:31.818 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-18T19:18:31.818 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T19:18:31.819 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T19:18:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T19:18:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T19:18:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T19:18:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-18T19:18:31.820 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T19:18:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T19:18:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-18T19:18:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T19:18:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T19:18:31.821 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-18T19:18:31.822 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-18T19:18:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T19:18:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T19:18:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T19:18:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T19:18:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-18T19:18:31.824 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T19:18:31.824 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-18T19:18:31.824 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-18T19:18:31.824 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T19:18:31.824 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-18T19:18:31.825 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T19:18:31.826 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T19:18:31.826 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T19:18:31.826 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-18T19:18:31.826 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-18T19:18:31.826 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T19:18:31.827 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T19:18:31.827 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T19:18:31.829 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T19:18:31.829 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-18T19:18:31.829 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T19:18:31.829 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T19:18:31.830 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T19:18:31.830 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T19:18:31.830 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-18T19:18:31.830 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T19:18:31.830 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-18T19:18:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T19:18:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-18T19:18:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T19:18:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-18T19:18:31.831 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T19:18:31.832 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-18T19:18:31.832 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T19:18:31.832 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T19:18:31.832 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T19:18:31.832 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-18T19:18:31.833 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-18T19:18:31.833 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T19:18:31.833 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-18T19:18:31.833 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T19:18:31.833 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-18T19:18:31.834 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T19:18:31.834 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-18T19:18:31.834 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T19:18:31.834 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T19:18:31.834 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-18T19:18:31.835 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T19:18:31.835 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T19:18:31.835 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-18T19:18:31.835 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T19:18:31.835 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T19:18:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-18T19:18:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T19:18:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T19:18:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-18T19:18:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-18T19:18:31.837 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T19:18:31.838 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-18T19:18:31.838 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T19:18:31.838 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-18T19:18:31.838 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T19:18:31.838 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-18T19:18:31.839 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T19:18:31.839 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-18T19:18:31.839 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-18T19:18:31.839 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T19:18:31.839 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T19:18:31.840 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T19:18:31.841 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T19:18:31.841 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-18T19:18:31.841 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T19:18:31.841 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T19:18:31.841 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T19:18:31.842 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-18T19:18:31.842 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-18T19:18:31.842 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T19:18:31.842 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T19:18:31.842 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T19:18:31.843 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-18T19:18:31.843 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T19:18:31.843 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-18T19:18:31.843 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T19:18:31.843 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-18T19:18:31.844 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T19:18:31.844 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-18T19:18:31.844 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T19:18:31.844 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-18T19:18:31.844 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T19:18:31.845 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-18T19:18:31.845 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T19:18:31.845 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-18T19:18:31.845 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T19:18:31.845 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-18T19:18:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T19:18:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-18T19:18:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T19:18:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-18T19:18:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T19:18:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T19:18:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-18T19:18:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T19:18:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T19:18:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-18T19:18:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-18T19:18:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T19:18:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-18T19:18:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T19:18:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-18T19:18:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-18T19:18:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T19:18:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-18T19:18:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T19:18:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T19:18:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-18T19:18:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T19:18:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-18T19:18:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T19:18:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-18T19:18:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T19:18:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-18T19:18:31.853 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T19:18:31.853 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-18T19:18:31.853 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T19:18:31.853 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-18T19:18:31.853 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T19:18:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T19:18:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T19:18:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T19:18:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-18T19:18:31.854 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-18T19:18:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-18T19:18:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T19:18:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-18T19:18:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T19:18:31.855 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T19:18:31.856 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T19:18:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T19:18:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-18T19:18:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-18T19:18:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T19:18:31.857 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T19:18:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-18T19:18:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T19:18:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T19:18:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T19:18:31.858 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T19:18:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-18T19:18:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T19:18:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-18T19:18:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T19:18:31.859 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-18T19:18:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T19:18:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T19:18:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-18T19:18:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T19:18:31.860 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T19:18:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-18T19:18:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T19:18:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T19:18:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-18T19:18:31.861 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T19:18:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-18T19:18:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T19:18:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T19:18:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-18T19:18:31.862 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T19:18:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T19:18:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T19:18:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T19:18:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-18T19:18:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T19:18:31.864 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T19:18:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-18T19:18:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T19:18:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T19:18:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-18T19:18:31.865 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T19:18:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T19:18:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-18T19:18:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T19:18:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T19:18:31.866 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T19:18:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T19:18:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T19:18:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-18T19:18:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T19:18:31.867 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T19:18:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T19:18:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T19:18:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T19:18:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T19:18:31.868 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T19:18:31.869 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-18T19:18:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T19:18:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T19:18:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T19:18:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-18T19:18:31.870 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T19:18:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T19:18:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T19:18:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T19:18:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T19:18:31.871 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-18T19:18:31.872 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T19:18:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T19:18:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T19:18:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T19:18:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T19:18:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T19:18:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-18T19:18:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T19:18:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-18T19:18:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-18T19:18:31.874 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T19:18:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-18T19:18:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T19:18:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-18T19:18:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T19:18:31.875 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-18T19:18:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-18T19:18:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T19:18:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-18T19:18:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-18T19:18:31.876 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T19:18:31.877 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T19:18:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-18T19:18:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-18T19:18:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T19:18:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-18T19:18:31.878 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-18T19:18:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T19:18:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-18T19:18:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T19:18:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T19:18:31.879 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T19:18:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-18T19:18:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-18T19:18:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T19:18:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-18T19:18:31.880 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-18T19:18:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T19:18:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T19:18:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T19:18:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T19:18:31.881 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T19:18:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T19:18:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T19:18:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T19:18:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T19:18:31.882 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T19:18:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T19:18:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T19:18:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-18T19:18:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T19:18:31.883 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T19:18:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T19:18:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T19:18:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T19:18:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T19:18:31.884 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T19:18:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T19:18:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T19:18:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T19:18:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T19:18:31.885 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-18T19:18:31.886 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T19:18:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T19:18:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T19:18:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T19:18:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-18T19:18:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T19:18:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T19:18:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-18T19:18:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T19:18:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T19:18:31.888 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T19:18:31.889 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T19:18:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T19:18:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T19:18:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T19:18:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T19:18:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T19:18:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T19:18:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T19:18:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T19:18:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T19:18:31.891 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T19:18:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T19:18:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T19:18:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T19:18:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T19:18:31.892 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T19:18:31.893 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T19:18:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T19:18:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-18T19:18:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T19:18:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T19:18:31.894 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T19:18:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T19:18:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T19:18:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-18T19:18:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T19:18:31.895 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-18T19:18:31.896 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T19:18:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T19:18:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-18T19:18:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T19:18:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-18T19:18:31.897 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T19:18:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-18T19:18:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T19:18:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-18T19:18:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T19:18:31.898 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T19:18:31.899 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-18T19:18:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T19:18:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T19:18:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T19:18:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-18T19:18:31.900 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-18T19:18:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-18T19:18:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-18T19:18:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-18T19:18:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T19:18:31.901 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T19:18:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-18T19:18:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T19:18:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T19:18:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T19:18:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T19:18:31.903 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T19:18:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T19:18:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T19:18:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-18T19:18:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T19:18:31.904 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T19:18:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T19:18:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-18T19:18:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T19:18:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T19:18:31.905 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-18T19:18:31.906 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T19:18:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T19:18:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T19:18:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T19:18:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-18T19:18:31.907 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T19:18:31.908 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T19:18:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T19:18:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-18T19:18:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T19:18:31.909 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T19:18:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-18T19:18:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T19:18:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T19:18:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T19:18:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T19:18:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T19:18:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T19:18:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T19:18:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T19:18:31.911 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T19:18:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T19:18:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T19:18:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-18T19:18:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T19:18:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-18T19:18:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-18T19:18:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T19:18:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-18T19:18:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T19:18:31.914 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-18T19:18:31.915 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T19:18:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-18T19:18:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-18T19:18:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-18T19:18:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T19:18:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T19:18:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T19:18:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T19:18:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T19:18:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T19:18:31.917 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T19:18:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T19:18:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T19:18:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T19:18:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T19:18:31.918 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T19:18:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T19:18:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T19:18:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T19:18:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-18T19:18:31.919 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-18T19:18:31.920 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-18T19:18:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T19:18:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T19:18:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-18T19:18:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T19:18:31.921 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-18T19:18:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-18T19:18:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T19:18:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-18T19:18:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T19:18:31.922 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-18T19:18:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T19:18:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T19:18:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T19:18:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T19:18:31.923 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T19:18:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-18T19:18:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-18T19:18:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T19:18:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T19:18:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T19:18:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T19:18:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-18T19:18:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T19:18:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T19:18:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T19:18:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T19:18:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T19:18:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T19:18:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T19:18:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T19:18:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T19:18:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T19:18:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-18T19:18:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T19:18:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T19:18:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-18T19:18:31.929 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T19:18:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-18T19:18:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T19:18:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T19:18:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T19:18:31.930 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T19:18:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T19:18:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T19:18:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T19:18:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T19:18:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T19:18:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T19:18:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T19:18:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T19:18:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T19:18:31.933 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T19:18:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T19:18:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T19:18:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T19:18:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T19:18:31.934 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T19:18:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T19:18:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T19:18:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T19:18:31.935 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T19:18:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T19:18:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T19:18:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T19:18:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T19:18:31.936 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T19:18:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T19:18:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T19:18:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T19:18:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T19:18:31.937 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T19:18:31.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T19:18:31.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T19:18:31.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T19:18:31.938 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T19:18:31.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T19:18:31.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T19:18:31.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T19:18:31.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-18T19:18:31.939 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T19:18:31.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T19:18:31.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T19:18:31.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T19:18:31.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T19:18:31.940 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T19:18:31.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T19:18:31.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T19:18:31.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T19:18:31.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T19:18:31.941 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T19:18:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T19:18:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T19:18:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T19:18:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T19:18:31.942 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-18T19:18:31.943 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T19:18:31.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T19:18:31.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T19:18:31.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T19:18:31.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-18T19:18:31.944 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T19:18:31.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T19:18:31.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T19:18:31.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T19:18:31.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-18T19:18:31.945 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-18T19:18:31.946 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-18T19:18:31.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-18T19:18:31.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-18T19:18:31.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-18T19:18:31.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-18T19:18:31.947 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-18T19:18:31.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-18T19:18:31.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-18T19:18:31.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T19:18:31.948 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T19:18:31.949 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T19:18:31.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T19:18:31.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T19:18:31.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T19:18:31.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T19:18:31.950 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T19:18:31.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T19:18:31.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T19:18:31.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-18T19:18:31.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T19:18:31.951 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T19:18:31.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T19:18:31.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T19:18:31.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T19:18:31.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T19:18:31.952 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T19:18:31.953 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T19:18:31.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T19:18:31.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T19:18:31.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T19:18:31.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T19:18:31.954 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T19:18:31.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T19:18:31.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T19:18:31.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T19:18:31.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T19:18:31.955 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-18T19:18:31.956 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T19:18:31.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T19:18:31.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T19:18:31.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-18T19:18:31.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T19:18:31.957 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T19:18:31.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-18T19:18:31.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T19:18:31.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-18T19:18:31.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-18T19:18:31.958 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T19:18:31.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-18T19:18:31.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T19:18:31.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-18T19:18:31.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T19:18:31.959 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T19:18:31.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-18T19:18:31.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T19:18:31.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-18T19:18:31.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T19:18:31.960 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-18T19:18:31.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T19:18:31.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-18T19:18:31.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T19:18:31.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-18T19:18:31.961 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-18T19:18:31.962 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T19:18:31.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-18T19:18:31.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-18T19:18:31.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T19:18:31.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-18T19:18:31.963 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-18T19:18:31.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T19:18:31.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-18T19:18:31.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T19:18:31.964 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-18T19:18:31.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-18T19:18:31.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T19:18:31.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-18T19:18:31.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T19:18:31.965 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T19:18:31.966 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-18T19:18:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T19:18:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-18T19:18:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T19:18:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-18T19:18:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T19:18:31.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-18T19:18:31.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-18T19:18:31.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T19:18:31.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-18T19:18:31.968 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T19:18:31.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-18T19:18:31.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T19:18:31.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T19:18:31.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T19:18:31.969 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T19:18:31.970 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-18T19:18:31.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T19:18:31.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-18T19:18:31.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T19:18:31.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T19:18:31.971 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T19:18:31.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T19:18:31.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T19:18:31.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T19:18:31.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T19:18:31.972 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T19:18:31.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T19:18:31.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T19:18:31.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T19:18:31.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T19:18:31.973 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T19:18:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T19:18:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T19:18:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T19:18:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T19:18:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T19:18:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T19:18:31.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T19:18:31.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T19:18:31.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T19:18:31.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T19:18:31.976 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T19:18:31.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T19:18:31.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T19:18:31.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T19:18:31.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T19:18:31.977 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T19:18:31.978 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T19:18:31.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T19:18:31.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T19:18:31.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T19:18:31.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T19:18:31.979 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T19:18:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T19:18:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T19:18:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T19:18:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T19:18:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T19:18:31.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-18T19:18:31.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-18T19:18:31.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T19:18:31.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-18T19:18:31.981 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T19:18:31.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-18T19:18:31.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T19:18:31.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T19:18:31.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T19:18:31.982 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T19:18:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T19:18:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-18T19:18:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T19:18:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-18T19:18:31.983 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T19:18:31.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-18T19:18:31.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T19:18:31.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-18T19:18:31.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T19:18:31.984 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-18T19:18:31.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-18T19:18:31.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T19:18:31.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-18T19:18:31.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T19:18:31.985 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T19:18:31.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-18T19:18:31.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T19:18:31.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-18T19:18:31.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T19:18:31.986 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-18T19:18:31.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T19:18:31.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-18T19:18:31.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T19:18:31.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-18T19:18:31.987 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T19:18:31.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-18T19:18:31.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-18T19:18:31.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-18T19:18:31.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T19:18:31.988 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T19:18:31.989 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-18T19:18:31.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T19:18:31.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T19:18:31.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T19:18:31.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T19:18:31.990 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-18T19:18:31.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T19:18:31.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T19:18:31.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-18T19:18:31.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T19:18:31.991 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-18T19:18:31.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T19:18:31.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-18T19:18:31.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T19:18:31.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T19:18:31.992 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T19:18:31.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T19:18:31.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-18T19:18:31.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-18T19:18:31.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-18T19:18:31.993 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T19:18:31.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-18T19:18:31.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-18T19:18:31.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T19:18:31.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T19:18:31.994 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T19:18:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T19:18:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T19:18:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T19:18:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T19:18:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T19:18:31.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-18T19:18:31.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T19:18:31.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T19:18:31.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T19:18:31.996 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T19:18:31.997 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T19:18:31.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T19:18:31.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T19:18:31.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-18T19:18:31.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T19:18:31.998 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-18T19:18:31.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T19:18:31.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T19:18:31.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-18T19:18:31.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T19:18:31.999 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T19:18:32.000 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T19:18:32.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T19:18:32.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T19:18:32.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T19:18:32.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T19:18:32.001 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T19:18:32.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T19:18:32.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T19:18:32.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T19:18:32.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T19:18:32.002 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T19:18:32.003 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T19:18:32.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-18T19:18:32.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T19:18:32.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-18T19:18:32.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-18T19:18:32.004 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T19:18:32.005 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-18T19:18:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-18T19:18:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-18T19:18:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T19:18:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T19:18:32.006 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T19:18:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T19:18:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T19:18:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-18T19:18:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-18T19:18:32.007 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T19:18:32.008 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T19:18:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T19:18:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T19:18:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T19:18:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T19:18:32.009 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T19:18:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T19:18:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T19:18:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-18T19:18:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T19:18:32.010 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T19:18:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T19:18:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T19:18:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T19:18:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T19:18:32.011 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T19:18:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T19:18:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T19:18:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T19:18:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T19:18:32.012 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T19:18:32.013 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T19:18:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T19:18:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T19:18:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T19:18:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T19:18:32.014 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T19:18:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T19:18:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T19:18:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T19:18:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T19:18:32.015 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T19:18:32.016 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T19:18:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T19:18:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T19:18:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T19:18:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T19:18:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-18T19:18:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T19:18:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T19:18:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T19:18:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T19:18:32.018 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T19:18:32.019 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T19:18:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T19:18:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T19:18:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T19:18:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T19:18:32.020 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T19:18:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T19:18:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T19:18:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T19:18:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T19:18:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T19:18:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T19:18:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T19:18:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T19:18:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T19:18:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T19:18:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T19:18:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T19:18:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T19:18:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T19:18:32.023 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-18T19:18:32.024 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T19:18:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-18T19:18:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T19:18:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T19:18:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T19:18:32.025 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T19:18:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T19:18:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T19:18:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T19:18:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-18T19:18:32.026 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T19:18:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-18T19:18:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T19:18:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-18T19:18:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T19:18:32.027 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T19:18:32.028 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T19:18:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T19:18:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T19:18:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T19:18:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T19:18:32.029 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T19:18:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T19:18:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T19:18:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T19:18:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T19:18:32.030 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T19:18:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T19:18:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-18T19:18:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T19:18:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T19:18:32.031 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T19:18:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T19:18:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T19:18:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T19:18:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T19:18:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T19:18:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T19:18:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T19:18:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T19:18:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T19:18:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T19:18:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T19:18:32.034 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T19:18:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T19:18:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T19:18:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T19:18:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T19:18:32.035 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T19:18:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T19:18:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T19:18:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T19:18:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T19:18:32.036 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T19:18:32.037 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T19:18:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T19:18:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T19:18:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T19:18:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T19:18:32.038 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T19:18:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T19:18:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T19:18:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T19:18:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T19:18:32.039 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T19:18:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T19:18:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T19:18:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T19:18:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T19:18:32.040 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T19:18:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T19:18:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T19:18:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T19:18:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T19:18:32.041 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T19:18:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T19:18:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T19:18:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T19:18:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T19:18:32.042 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T19:18:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T19:18:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T19:18:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-18T19:18:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T19:18:32.043 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T19:18:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T19:18:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T19:18:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T19:18:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T19:18:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T19:18:32.045 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T19:18:32.046 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T19:18:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T19:18:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T19:18:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T19:18:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T19:18:32.047 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T19:18:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T19:18:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T19:18:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T19:18:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T19:18:32.048 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T19:18:32.049 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T19:18:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T19:18:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T19:18:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T19:18:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T19:18:32.050 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T19:18:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T19:18:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T19:18:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T19:18:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T19:18:32.051 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T19:18:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T19:18:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T19:18:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T19:18:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T19:18:32.052 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T19:18:32.053 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T19:18:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T19:18:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T19:18:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T19:18:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T19:18:32.054 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T19:18:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T19:18:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T19:18:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T19:18:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T19:18:32.055 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T19:18:32.056 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T19:18:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T19:18:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T19:18:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T19:18:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T19:18:32.057 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-18T19:18:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T19:18:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-18T19:18:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T19:18:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-18T19:18:32.058 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T19:18:32.059 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-18T19:18:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T19:18:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T19:18:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T19:18:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-18T19:18:32.060 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T19:18:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T19:18:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T19:18:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T19:18:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T19:18:32.061 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T19:18:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T19:18:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T19:18:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T19:18:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T19:18:32.062 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T19:18:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T19:18:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T19:18:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T19:18:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T19:18:32.063 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T19:18:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T19:18:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T19:18:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T19:18:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T19:18:32.064 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T19:18:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T19:18:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T19:18:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T19:18:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T19:18:32.065 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T19:18:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T19:18:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T19:18:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T19:18:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T19:18:32.066 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T19:18:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T19:18:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T19:18:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T19:18:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T19:18:32.067 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T19:18:32.068 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T19:18:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T19:18:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T19:18:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-18T19:18:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T19:18:32.069 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T19:18:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-18T19:18:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-18T19:18:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T19:18:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T19:18:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T19:18:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-18T19:18:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T19:18:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-18T19:18:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T19:18:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T19:18:32.072 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T19:18:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T19:18:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T19:18:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-18T19:18:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T19:18:32.073 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-18T19:18:32.074 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-18T19:18:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-18T19:18:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T19:18:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T19:18:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T19:18:32.075 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T19:18:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T19:18:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T19:18:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T19:18:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T19:18:32.076 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T19:18:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T19:18:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T19:18:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T19:18:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T19:18:32.078 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T19:18:32.078 DEBUG:teuthology.orchestra.run.smithi184:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-18T19:18:32.106 INFO:teuthology.orchestra.run.smithi184.stdout:postinstall scriptlet (using /bin/sh): 2023-10-18T19:18:32.106 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-18T19:18:32.106 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:32.106 INFO:teuthology.orchestra.run.smithi184.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:32.106 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T19:18:32.107 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:32.107 INFO:teuthology.orchestra.run.smithi184.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-18T19:18:32.107 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-10-18T19:18:32.107 INFO:teuthology.orchestra.run.smithi184.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:32.107 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-18T19:18:32.108 INFO:teuthology.orchestra.run.smithi184.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-18T19:18:32.108 INFO:teuthology.orchestra.run.smithi184.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-18T19:18:32.108 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:32.108 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-10-18T19:18:32.108 INFO:teuthology.orchestra.run.smithi184.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-18T19:18:32.109 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-18T19:18:32.109 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-18T19:18:32.109 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2023-10-18T19:18:32.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2023-10-18T19:18:32.188 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2023-10-18T19:18:32.188 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2023-10-18T19:18:32.189 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.02 2023-10-18T19:18:32.189 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 129.el8 2023-10-18T19:18:32.189 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2023-10-18T19:18:32.189 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-18T19:18:32.191 INFO:teuthology.orchestra.run.smithi184.stdout:Group : System Environment/Base 2023-10-18T19:18:32.191 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 9265586 2023-10-18T19:18:32.191 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2023-10-18T19:18:32.191 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-18T19:18:32.192 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-18T19:18:32.192 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-18T19:18:32.192 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-18T19:18:32.192 INFO:teuthology.orchestra.run.smithi184.stdout:Relocations : (not relocatable) 2023-10-18T19:18:32.192 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : CentOS BuildSystem 2023-10-18T19:18:32.193 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2023-10-18T19:18:32.193 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-18T19:18:32.193 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2023-10-18T19:18:32.193 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2023-10-18T19:18:32.193 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:18:32.194 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-18T19:18:32.194 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-18T19:18:32.194 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-18T19:18:32.194 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2023-10-18T19:18:32.195 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:18:32.195 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2023-10-18T19:18:32.196 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-18T19:18:32.196 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 6.6.0-rc5-g47672119149b 2023-10-18T19:18:32.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-18T19:18:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-10-18T19:18:39.371 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-10-18T19:18:39.379 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-18T19:18:39.402 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.uD3sYxOFzl 2023-10-18T19:18:39.402 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uD3sYxOFzl 2023-10-18T19:18:39.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.uD3sYxOFzl 2023-10-18T19:18:39.642 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.uD3sYxOFzl is 6KB 2023-10-18T19:18:39.690 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.uD3sYxOFzl 2023-10-18T19:18:39.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2023-10-18T19:18:39.776 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-18T19:18:39.777 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-18T19:18:39.777 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-18T19:18:39.777 INFO:teuthology.orchestra.run.smithi184.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b.conf 2023-10-18T19:18:39.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-rc5-g47672119149b 2023-10-18T19:18:39.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-10-18T19:18:47.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-18T19:18:47.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:18:47.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:18:51.518 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-18T19:18:51.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:18:51.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:05.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-18T19:19:09.946 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-18T19:19:10.000 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-18T19:19:10.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:19:10.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:14.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:19:14.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:17.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-18T19:19:18.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:19:18.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:22.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-18T19:19:28.385 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-18T19:19:29.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:19:29.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:32.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-18T19:19:34.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:19:34.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:37.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:19:37.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:40.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-18T19:19:47.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:19:47.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:19:52.442 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-18T19:19:52.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:19:52.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:20:07.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:20:07.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:20:08.034 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-18T19:20:08.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:20:08.421 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g47672119149b"... 2023-10-18T19:20:08.421 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-10-18T19:20:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:6.6.0-rc5-g47672119149b 2023-10-18T19:20:08.468 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T19:20:08.468 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T19:20:08.468 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T19:20:09.469 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-10-18T19:20:09.470 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-18T19:20:09.596 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2023-10-18T19:20:09.616 DEBUG:teuthology.parallel:result is None 2023-10-18T19:20:10.874 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-18T19:20:19.702 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-18T19:20:20.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:20:20.119 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-18T19:20:20.119 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-18T19:20:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:6.6.0-rc5-g47672119149b 2023-10-18T19:20:20.165 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T19:20:20.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T19:20:20.166 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T19:20:21.167 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-18T19:20:21.167 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-18T19:20:21.270 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-10-18T19:20:21.293 DEBUG:teuthology.parallel:result is None 2023-10-18T19:20:25.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:20:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:20:26.168 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-18T19:20:26.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:20:26.580 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-18T19:20:26.580 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-18T19:20:26.628 INFO:teuthology.orchestra.run.smithi184.stdout:6.6.0-rc5-g47672119149b 2023-10-18T19:20:26.628 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T19:20:26.628 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T19:20:26.629 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-18T19:20:27.630 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-18T19:20:27.630 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-18T19:20:27.764 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2023-10-18T19:20:27.789 DEBUG:teuthology.parallel:result is None 2023-10-18T19:20:27.790 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T19:20:27.796 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T19:20:27.797 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T19:20:27.802 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T19:20:27.806 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T19:20:27.858 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T19:20:27.879 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T19:20:27.904 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T19:20:27.904 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T19:20:27.910 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T19:20:27.915 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T19:20:27.975 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T19:20:27.983 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T19:20:27.983 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T19:20:27.988 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T19:20:27.993 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T19:20:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.082 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.104 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.108 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T19:20:28.111 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T19:20:28.122 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T19:20:28.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T19:20:28.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T19:20:28.132 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T19:20:28.202 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T19:20:28.212 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T19:20:28.212 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T19:20:28.217 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T19:20:28.222 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T19:20:28.268 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:28.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:28.450 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:28.524 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:28.593 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:20:28.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T19:20:28.663 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:28.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:28.811 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:28.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:28.956 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:20:28.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T19:20:29.027 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:29.106 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T19:20:29.180 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:29.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T19:20:29.326 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:20:29.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T19:20:29.396 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-10-18T19:20:29.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-10-18T19:20:29.406 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-10-18T19:20:29.517 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T19:20:29.526 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T19:20:29.545 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-18T19:20:30.016 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T19:20:30.023 INFO:teuthology.task.internal:Starting timer... 2023-10-18T19:20:30.024 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T19:20:30.049 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T19:20:30.081 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-18T19:20:30.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-10-18T19:20:30.220 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-10-18T19:20:30.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-10-18T19:20:30.344 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-10-18T19:20:30.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2023-10-18T19:20:30.474 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2023-10-18T19:20:30.477 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T19:20:30.477 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-10-18T19:20:30.527 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-10-18T19:20:30.527 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-10-18T19:20:30.582 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-10-18T19:20:30.582 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2023-10-18T19:20:30.632 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2023-10-18T19:20:30.632 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2023-10-18T19:20:30.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T19:20:30.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:20:30.704 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T19:20:30.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:20:30.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-18T19:20:30.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:20:30.848 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T19:20:30.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-10-18T19:20:30.918 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-10-18T19:20:30.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2023-10-18T19:20:31.057 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T19:20:31.071 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-18T19:20:31.077 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-18T19:20:31.239 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T19:20:31.262 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T19:20:31.264 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi184.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T19:31:02.990 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-10-18T19:31:03.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:31:03.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:31:03.097 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-18T19:31:03.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-18T19:31:03.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:31:03.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:31:03.307 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-18T19:31:03.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-18T19:31:03.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:31:03.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:31:03.522 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-18T19:31:03.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-18T19:31:03.644 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T19:31:03.654 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T19:31:03.654 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T19:31:03.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T19:31:03.660 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T19:31:03.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T19:31:03.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T19:31:03.666 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T19:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T19:31:03.741 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T19:31:03.745 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-18T19:31:03.764 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T19:31:03.774 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T19:31:03.778 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-18T19:31:03.852 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-10-18T19:31:03.872 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2023-10-18T19:31:03.873 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-10-18T19:31:03.880 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-10-18T19:31:03.899 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2023-10-18T19:31:03.901 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-10-18T19:31:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T19:31:03.932 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T19:31:03.933 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-18T19:31:03.945 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T19:31:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T19:31:03.965 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-18T19:31:04.034 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-10-18T19:31:04.041 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T19:31:04.042 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-10-18T19:31:04.042 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.042 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.042 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.042 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.051 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-10-18T19:31:04.054 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-10-18T19:31:04.058 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T19:31:04.058 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-10-18T19:31:04.059 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.059 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.059 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.059 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.061 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-18T19:31:04.061 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-10-18T19:31:04.061 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.061 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.061 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.062 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-18T19:31:04.063 INFO:teuthology.run_tasks:Running task install... 2023-10-18T19:31:04.073 DEBUG:teuthology.task.install:project ceph 2023-10-18T19:31:04.073 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}} 2023-10-18T19:31:04.074 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T19:31:04.074 INFO:teuthology.task.install:Using flavor: default 2023-10-18T19:31:04.080 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T19:31:04.080 INFO:teuthology.task.install:extra packages: ['librados2'] 2023-10-18T19:31:04.081 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'tag': None, 'wait_for_package': False} 2023-10-18T19:31:04.081 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.081 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.082 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.082 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.082 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:31:04.084 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'tag': None, 'wait_for_package': False} 2023-10-18T19:31:04.085 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.085 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.085 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.085 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.086 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:31:04.087 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'tag': None, 'wait_for_package': False} 2023-10-18T19:31:04.087 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.088 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.088 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.088 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.088 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:31:04.280 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2023-10-18T19:31:04.280 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2023-10-18T19:31:04.317 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T19:31:04.318 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:31:04.318 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T19:31:04.354 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2023-10-18T19:31:04.354 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2023-10-18T19:31:04.360 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2023-10-18T19:31:04.360 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2023-10-18T19:31:04.388 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2023-10-18T19:31:04.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.389 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.389 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.389 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.389 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.390 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T19:31:04.392 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T19:31:04.392 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:31:04.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T19:31:04.415 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T19:31:04.415 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:31:04.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T19:31:04.463 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2023-10-18T19:31:04.463 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.463 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.464 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.464 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.464 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.464 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T19:31:04.486 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2023-10-18T19:31:04.487 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:31:04.487 INFO:teuthology.packaging:ref: None 2023-10-18T19:31:04.487 INFO:teuthology.packaging:tag: None 2023-10-18T19:31:04.487 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:31:04.488 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:31:04.488 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T19:31:04.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T19:31:04.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T19:31:04.596 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T19:31:04.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T19:31:04.667 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2023-10-18T19:31:04.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2023-10-18T19:31:04.671 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T19:31:04.694 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T19:31:04.741 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-10-18T19:31:04.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-10-18T19:31:04.765 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-10-18T19:31:04.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-10-18T19:31:05.021 INFO:teuthology.orchestra.run.smithi192.stdout:76 files removed 2023-10-18T19:31:05.057 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw 2023-10-18T19:31:05.114 INFO:teuthology.orchestra.run.smithi088.stdout:76 files removed 2023-10-18T19:31:05.116 INFO:teuthology.orchestra.run.smithi184.stdout:76 files removed 2023-10-18T19:31:05.149 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw 2023-10-18T19:31:05.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw 2023-10-18T19:31:05.713 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 599 kB/s | 65 kB 00:00 2023-10-18T19:31:05.767 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 865 kB/s | 65 kB 00:00 2023-10-18T19:31:05.777 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 817 kB/s | 65 kB 00:00 2023-10-18T19:31:05.855 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 106 kB/s | 11 kB 00:00 2023-10-18T19:31:05.868 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 174 kB/s | 11 kB 00:00 2023-10-18T19:31:05.877 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 176 kB/s | 11 kB 00:00 2023-10-18T19:31:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 19 kB/s | 1.7 kB 00:00 2023-10-18T19:31:05.994 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 19 kB/s | 1.7 kB 00:00 2023-10-18T19:31:06.006 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 14 kB/s | 1.7 kB 00:00 2023-10-18T19:31:09.368 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 10 MB/s | 33 MB 00:03 2023-10-18T19:31:09.520 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - AppStream 9.6 MB/s | 33 MB 00:03 2023-10-18T19:31:12.481 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - AppStream 5.2 MB/s | 33 MB 00:06 2023-10-18T19:31:18.435 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 50 MB 00:02 2023-10-18T19:31:19.095 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 50 MB 00:02 2023-10-18T19:31:22.165 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 50 MB 00:03 2023-10-18T19:31:26.559 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 29 kB/s | 18 kB 00:00 2023-10-18T19:31:26.868 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 55 kB/s | 6.9 kB 00:00 2023-10-18T19:31:27.336 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-10-18T19:31:27.628 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-18T19:31:27.646 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - Extras common packages 54 kB/s | 6.9 kB 00:00 2023-10-18T19:31:28.205 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 8 - PowerTools 16 MB/s | 6.5 MB 00:00 2023-10-18T19:31:29.162 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-18T19:31:29.840 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-18T19:31:30.015 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-10-18T19:31:30.341 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - Extras common packages 51 kB/s | 6.9 kB 00:00 2023-10-18T19:31:30.957 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-18T19:31:31.125 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 6.5 MB 00:00 2023-10-18T19:31:32.454 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 16 MB 00:03 2023-10-18T19:31:32.618 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-18T19:31:33.419 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-18T19:31:35.574 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 423 kB/s | 24 kB 00:00 2023-10-18T19:31:36.946 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-10-18T19:31:37.936 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 172 kB/s | 24 kB 00:00 2023-10-18T19:31:40.132 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:31:40.134 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:31:40.134 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-10-18T19:31:40.135 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:31:40.135 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:31:40.135 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2023-10-18T19:31:40.135 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-10-18T19:31:40.135 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2023-10-18T19:31:40.136 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2023-10-18T19:31:40.136 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-10-18T19:31:40.136 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2023-10-18T19:31:40.136 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2023-10-18T19:31:40.136 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2023-10-18T19:31:40.137 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T19:31:40.137 INFO:teuthology.orchestra.run.smithi184.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-18T19:31:40.137 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2023-10-18T19:31:40.137 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T19:31:40.137 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-18T19:31:40.138 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2023-10-18T19:31:40.139 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2023-10-18T19:31:40.139 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-18T19:31:40.139 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2023-10-18T19:31:40.139 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2023-10-18T19:31:40.139 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2023-10-18T19:31:40.140 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:31:40.140 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:31:40.140 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:31:40.140 INFO:teuthology.orchestra.run.smithi184.stdout:Install 20 Packages 2023-10-18T19:31:40.140 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2023-10-18T19:31:40.141 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:31:40.141 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 44 M 2023-10-18T19:31:40.141 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:31:40.600 INFO:teuthology.orchestra.run.smithi184.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 35 MB/s | 5.4 MB 00:00 2023-10-18T19:31:40.625 INFO:teuthology.orchestra.run.smithi184.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 998 kB/s | 25 kB 00:00 2023-10-18T19:31:40.659 INFO:teuthology.orchestra.run.smithi184.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2023-10-18T19:31:40.693 INFO:teuthology.orchestra.run.smithi184.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 11 MB/s | 376 kB 00:00 2023-10-18T19:31:40.793 INFO:teuthology.orchestra.run.smithi184.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 17 MB/s | 6.0 MB 00:00 2023-10-18T19:31:40.818 INFO:teuthology.orchestra.run.smithi184.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.5 MB/s | 39 kB 00:00 2023-10-18T19:31:40.844 INFO:teuthology.orchestra.run.smithi184.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 6.2 MB/s | 159 kB 00:00 2023-10-18T19:31:40.877 INFO:teuthology.orchestra.run.smithi184.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 9.6 MB/s | 323 kB 00:00 2023-10-18T19:31:40.911 INFO:teuthology.orchestra.run.smithi184.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.5 MB/s | 291 kB 00:00 2023-10-18T19:31:40.936 INFO:teuthology.orchestra.run.smithi184.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2023-10-18T19:31:41.037 INFO:teuthology.orchestra.run.smithi184.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 5.3 MB 00:00 2023-10-18T19:31:41.298 INFO:teuthology.orchestra.run.smithi184.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 23 MB/s | 19 MB 00:00 2023-10-18T19:31:41.320 INFO:teuthology.orchestra.run.smithi184.stdout:(13/22): librdkafka-0.11.4-3.el8.x86_64.rpm 922 kB/s | 354 kB 00:00 2023-10-18T19:31:41.387 INFO:teuthology.orchestra.run.smithi184.stdout:(14/22): librabbitmq-0.9.0-4.el8.x86_64.rpm 706 kB/s | 47 kB 00:00 2023-10-18T19:31:41.412 INFO:teuthology.orchestra.run.smithi184.stdout:(15/22): python3-prettytable-0.7.2-14.el8.noarc 376 kB/s | 44 kB 00:00 2023-10-18T19:31:41.438 INFO:teuthology.orchestra.run.smithi184.stdout:(16/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 648 kB/s | 259 kB 00:00 2023-10-18T19:31:41.646 INFO:teuthology.orchestra.run.smithi184.stdout:(17/22): leveldb-1.22-1.el8.x86_64.rpm 775 kB/s | 181 kB 00:00 2023-10-18T19:31:41.705 INFO:teuthology.orchestra.run.smithi184.stdout:(18/22): liboath-2.6.2-3.el8.x86_64.rpm 220 kB/s | 59 kB 00:00 2023-10-18T19:31:41.753 INFO:teuthology.orchestra.run.smithi184.stdout:(19/22): libunwind-1.3.1-3.el8.x86_64.rpm 709 kB/s | 75 kB 00:00 2023-10-18T19:31:41.769 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:31:41.772 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:31:41.772 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-18T19:31:41.772 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:31:41.773 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:31:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2023-10-18T19:31:41.773 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-10-18T19:31:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2023-10-18T19:31:41.773 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2023-10-18T19:31:41.774 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-18T19:31:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2023-10-18T19:31:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2023-10-18T19:31:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2023-10-18T19:31:41.774 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T19:31:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-18T19:31:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2023-10-18T19:31:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T19:31:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-18T19:31:41.775 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2023-10-18T19:31:41.776 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2023-10-18T19:31:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-18T19:31:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2023-10-18T19:31:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2023-10-18T19:31:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2023-10-18T19:31:41.777 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:31:41.778 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:31:41.778 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:31:41.778 INFO:teuthology.orchestra.run.smithi088.stdout:Install 20 Packages 2023-10-18T19:31:41.778 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2023-10-18T19:31:41.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:31:41.779 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 44 M 2023-10-18T19:31:41.779 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:31:41.780 INFO:teuthology.orchestra.run.smithi184.stdout:(20/22): gperftools-libs-2.7-9.el8.x86_64.rpm 779 kB/s | 306 kB 00:00 2023-10-18T19:31:41.839 INFO:teuthology.orchestra.run.smithi184.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 20 MB/s | 1.7 MB 00:00 2023-10-18T19:31:41.906 INFO:teuthology.orchestra.run.smithi184.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 17 MB/s | 3.5 MB 00:00 2023-10-18T19:31:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:31:41.911 INFO:teuthology.orchestra.run.smithi184.stdout:Total 25 MB/s | 44 MB 00:01 2023-10-18T19:31:42.002 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:31:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:31:42.055 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:31:42.361 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:31:42.364 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:31:42.389 INFO:teuthology.orchestra.run.smithi088.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 32 MB/s | 5.4 MB 00:00 2023-10-18T19:31:42.414 INFO:teuthology.orchestra.run.smithi088.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2023-10-18T19:31:42.447 INFO:teuthology.orchestra.run.smithi088.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2023-10-18T19:31:42.481 INFO:teuthology.orchestra.run.smithi088.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 11 MB/s | 376 kB 00:00 2023-10-18T19:31:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:31:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:31:42.544 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-10-18T19:31:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:31:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:31:42.544 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2023-10-18T19:31:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-10-18T19:31:42.545 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2023-10-18T19:31:42.545 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2023-10-18T19:31:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-18T19:31:42.546 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2023-10-18T19:31:42.546 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2023-10-18T19:31:42.546 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2023-10-18T19:31:42.546 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-18T19:31:42.546 INFO:teuthology.orchestra.run.smithi192.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-18T19:31:42.547 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2023-10-18T19:31:42.547 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-18T19:31:42.547 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-18T19:31:42.547 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2023-10-18T19:31:42.547 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-18T19:31:42.548 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2023-10-18T19:31:42.548 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-18T19:31:42.548 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-18T19:31:42.548 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2023-10-18T19:31:42.548 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2023-10-18T19:31:42.549 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-18T19:31:42.549 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2023-10-18T19:31:42.549 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2023-10-18T19:31:42.549 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2023-10-18T19:31:42.549 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:31:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:31:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:31:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:Install 20 Packages 2023-10-18T19:31:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 2 Packages 2023-10-18T19:31:42.550 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:31:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 44 M 2023-10-18T19:31:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:31:42.556 INFO:teuthology.orchestra.run.smithi088.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 18 MB/s | 6.0 MB 00:00 2023-10-18T19:31:42.582 INFO:teuthology.orchestra.run.smithi088.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.5 MB/s | 39 kB 00:00 2023-10-18T19:31:42.607 INFO:teuthology.orchestra.run.smithi088.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 6.3 MB/s | 159 kB 00:00 2023-10-18T19:31:42.640 INFO:teuthology.orchestra.run.smithi088.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-10-18T19:31:42.674 INFO:teuthology.orchestra.run.smithi088.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.6 MB/s | 291 kB 00:00 2023-10-18T19:31:42.699 INFO:teuthology.orchestra.run.smithi088.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2023-10-18T19:31:42.825 INFO:teuthology.orchestra.run.smithi088.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 5.3 MB 00:00 2023-10-18T19:31:42.996 INFO:teuthology.orchestra.run.smithi192.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 33 MB/s | 5.4 MB 00:00 2023-10-18T19:31:43.021 INFO:teuthology.orchestra.run.smithi192.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2023-10-18T19:31:43.054 INFO:teuthology.orchestra.run.smithi192.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 520 kB 00:00 2023-10-18T19:31:43.067 INFO:teuthology.orchestra.run.smithi088.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 23 MB/s | 19 MB 00:00 2023-10-18T19:31:43.088 INFO:teuthology.orchestra.run.smithi192.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 11 MB/s | 376 kB 00:00 2023-10-18T19:31:43.092 INFO:teuthology.orchestra.run.smithi088.stdout:(13/22): librdkafka-0.11.4-3.el8.x86_64.rpm 902 kB/s | 354 kB 00:00 2023-10-18T19:31:43.169 INFO:teuthology.orchestra.run.smithi088.stdout:(14/22): librabbitmq-0.9.0-4.el8.x86_64.rpm 629 kB/s | 47 kB 00:00 2023-10-18T19:31:43.172 INFO:teuthology.orchestra.run.smithi192.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 18 MB/s | 6.0 MB 00:00 2023-10-18T19:31:43.193 INFO:teuthology.orchestra.run.smithi088.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 707 kB/s | 259 kB 00:00 2023-10-18T19:31:43.198 INFO:teuthology.orchestra.run.smithi192.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 1.6 MB/s | 39 kB 00:00 2023-10-18T19:31:43.214 INFO:teuthology.orchestra.run.smithi192.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 9.4 MB/s | 159 kB 00:00 2023-10-18T19:31:43.218 INFO:teuthology.orchestra.run.smithi088.stdout:(16/22): python3-prettytable-0.7.2-14.el8.noarc 292 kB/s | 44 kB 00:00 2023-10-18T19:31:43.240 INFO:teuthology.orchestra.run.smithi192.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 13 MB/s | 323 kB 00:00 2023-10-18T19:31:43.273 INFO:teuthology.orchestra.run.smithi192.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 8.6 MB/s | 291 kB 00:00 2023-10-18T19:31:43.298 INFO:teuthology.orchestra.run.smithi192.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2023-10-18T19:31:43.365 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:31:43.407 INFO:teuthology.orchestra.run.smithi192.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 17 MB/s | 5.3 MB 00:00 2023-10-18T19:31:43.418 INFO:teuthology.orchestra.run.smithi088.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2023-10-18T19:31:43.485 INFO:teuthology.orchestra.run.smithi088.stdout:(18/22): leveldb-1.22-1.el8.x86_64.rpm 678 kB/s | 181 kB 00:00 2023-10-18T19:31:43.510 INFO:teuthology.orchestra.run.smithi088.stdout:(19/22): gperftools-libs-2.7-9.el8.x86_64.rpm 894 kB/s | 306 kB 00:00 2023-10-18T19:31:43.556 INFO:teuthology.orchestra.run.smithi088.stdout:(20/22): libunwind-1.3.1-3.el8.x86_64.rpm 561 kB/s | 75 kB 00:00 2023-10-18T19:31:43.571 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2023-10-18T19:31:43.611 INFO:teuthology.orchestra.run.smithi088.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-10-18T19:31:43.682 INFO:teuthology.orchestra.run.smithi192.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 23 MB/s | 19 MB 00:00 2023-10-18T19:31:43.686 INFO:teuthology.orchestra.run.smithi088.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 17 MB/s | 3.5 MB 00:00 2023-10-18T19:31:43.688 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:31:43.689 INFO:teuthology.orchestra.run.smithi088.stdout:Total 23 MB/s | 44 MB 00:01 2023-10-18T19:31:43.707 INFO:teuthology.orchestra.run.smithi192.stdout:(13/22): librdkafka-0.11.4-3.el8.x86_64.rpm 866 kB/s | 354 kB 00:00 2023-10-18T19:31:43.766 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:43.774 INFO:teuthology.orchestra.run.smithi192.stdout:(14/22): librabbitmq-0.9.0-4.el8.x86_64.rpm 704 kB/s | 47 kB 00:00 2023-10-18T19:31:43.779 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:31:43.800 INFO:teuthology.orchestra.run.smithi192.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 661 kB/s | 259 kB 00:00 2023-10-18T19:31:43.825 INFO:teuthology.orchestra.run.smithi192.stdout:(16/22): python3-prettytable-0.7.2-14.el8.noarc 309 kB/s | 44 kB 00:00 2023-10-18T19:31:43.831 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:31:43.831 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:31:44.142 INFO:teuthology.orchestra.run.smithi192.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 185 kB/s | 59 kB 00:00 2023-10-18T19:31:44.150 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:31:44.154 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:31:44.182 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:44.251 INFO:teuthology.orchestra.run.smithi192.stdout:(18/22): leveldb-1.22-1.el8.x86_64.rpm 402 kB/s | 181 kB 00:00 2023-10-18T19:31:44.334 INFO:teuthology.orchestra.run.smithi192.stdout:(19/22): librados2-14.2.22-0.el8.x86_64.rpm 42 MB/s | 3.5 MB 00:00 2023-10-18T19:31:44.359 INFO:teuthology.orchestra.run.smithi192.stdout:(20/22): gperftools-libs-2.7-9.el8.x86_64.rpm 524 kB/s | 306 kB 00:00 2023-10-18T19:31:44.385 INFO:teuthology.orchestra.run.smithi192.stdout:(21/22): libunwind-1.3.1-3.el8.x86_64.rpm 310 kB/s | 75 kB 00:00 2023-10-18T19:31:44.424 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:44.427 INFO:teuthology.orchestra.run.smithi192.stdout:(22/22): librbd1-14.2.22-0.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-10-18T19:31:44.429 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:31:44.429 INFO:teuthology.orchestra.run.smithi192.stdout:Total 24 MB/s | 44 MB 00:01 2023-10-18T19:31:44.525 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:31:44.538 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:44.578 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:31:44.579 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:31:44.759 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:31:44.930 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:31:44.934 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:31:44.940 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:45.163 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:31:45.175 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:45.374 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:45.386 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2023-10-18T19:31:45.455 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:45.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:45.961 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:31:46.006 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:46.130 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/24 2023-10-18T19:31:46.160 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2023-10-18T19:31:46.274 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:46.329 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:46.371 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:46.420 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:46.527 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:46.546 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2023-10-18T19:31:46.692 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:31:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:31:46.771 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2023-10-18T19:31:46.895 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:31:46.961 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:46.962 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:47.065 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:31:47.104 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:31:47.197 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:47.298 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:31:47.308 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2023-10-18T19:31:47.419 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:47.457 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:47.487 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:47.501 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:47.549 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:47.728 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:31:47.762 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2023-10-18T19:31:47.942 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2023-10-18T19:31:47.954 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:48.033 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:31:48.106 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2023-10-18T19:31:48.164 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/24 2023-10-18T19:31:48.274 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:48.349 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:48.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:48.484 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:48.673 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/24 2023-10-18T19:31:48.674 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2023-10-18T19:31:48.821 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:31:48.862 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:48.946 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:31:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:31:49.142 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2023-10-18T19:31:49.233 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:31:49.290 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:31:49.466 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2023-10-18T19:31:49.484 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:31:49.652 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:49.717 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:31:49.738 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:49.938 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2023-10-18T19:31:49.958 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2023-10-18T19:31:50.079 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:50.137 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2023-10-18T19:31:50.170 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2023-10-18T19:31:50.321 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2023-10-18T19:31:50.392 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2023-10-18T19:31:50.477 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:50.553 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2023-10-18T19:31:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2023-10-18T19:31:50.812 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:50.920 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:50.994 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2023-10-18T19:31:51.015 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:51.729 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:52.016 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:52.206 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:52.339 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:31:52.872 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:53.086 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:53.254 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:53.513 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:53.785 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:54.068 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:54.230 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2023-10-18T19:31:54.266 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:54.385 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:31:54.520 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:54.727 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2023-10-18T19:31:54.895 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:12.201 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:12.201 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-10-18T19:32:12.201 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-10-18T19:32:12.201 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-10-18T19:32:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-10-18T19:32:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-10-18T19:32:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-10-18T19:32:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-10-18T19:32:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-10-18T19:32:12.203 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-10-18T19:32:12.203 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:12.937 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:12.983 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:12.983 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:13.213 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:13.213 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:14.087 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:14.109 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-10-18T19:32:14.110 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-10-18T19:32:14.110 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-18T19:32:14.110 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-10-18T19:32:14.110 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-10-18T19:32:14.111 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-10-18T19:32:14.111 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-10-18T19:32:14.111 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-10-18T19:32:14.111 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-18T19:32:14.112 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:14.195 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:14.195 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2023-10-18T19:32:14.196 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2023-10-18T19:32:14.196 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:32:14.196 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:32:14.196 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:32:14.196 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:32:14.197 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2023-10-18T19:32:14.197 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:32:14.197 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2023-10-18T19:32:14.197 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:32:14.197 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:32:14.198 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:32:14.198 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2023-10-18T19:32:14.198 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2023-10-18T19:32:14.198 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2023-10-18T19:32:14.198 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 16/24 2023-10-18T19:32:14.199 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2023-10-18T19:32:14.199 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2023-10-18T19:32:14.199 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2023-10-18T19:32:14.199 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2023-10-18T19:32:14.199 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:14.200 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2023-10-18T19:32:14.200 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2023-10-18T19:32:14.489 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:14.489 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2023-10-18T19:32:14.489 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2023-10-18T19:32:14.489 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-18T19:32:14.490 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2023-10-18T19:32:14.490 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2023-10-18T19:32:14.490 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2023-10-18T19:32:14.490 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2023-10-18T19:32:14.490 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2023-10-18T19:32:14.491 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-18T19:32:14.491 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:14.838 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:14.884 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:14.884 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:15.107 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:15.107 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:15.139 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:15.140 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:15.140 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-10-18T19:32:15.140 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.140 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:32:15.140 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: leveldb-1.22-1.el8.x86_64 2023-10-18T19:32:15.141 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.142 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T19:32:15.142 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-18T19:32:15.142 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.142 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T19:32:15.143 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.143 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T19:32:15.143 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T19:32:15.143 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.143 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:15.144 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:15.233 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:15.279 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2023-10-18T19:32:15.280 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:15.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-test 2023-10-18T19:32:15.502 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2023-10-18T19:32:15.502 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:16.109 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:16.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2023-10-18T19:32:16.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2023-10-18T19:32:16.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:32:16.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:32:16.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:32:16.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:32:16.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2023-10-18T19:32:16.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:32:16.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2023-10-18T19:32:16.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:32:16.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:32:16.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:32:16.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2023-10-18T19:32:16.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2023-10-18T19:32:16.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2023-10-18T19:32:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 16/24 2023-10-18T19:32:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2023-10-18T19:32:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2023-10-18T19:32:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2023-10-18T19:32:16.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2023-10-18T19:32:16.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:16.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2023-10-18T19:32:16.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2023-10-18T19:32:16.501 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:16.502 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2023-10-18T19:32:16.502 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2023-10-18T19:32:16.502 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2023-10-18T19:32:16.503 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2023-10-18T19:32:16.503 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2023-10-18T19:32:16.503 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2023-10-18T19:32:16.505 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2023-10-18T19:32:16.505 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2023-10-18T19:32:16.505 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2023-10-18T19:32:16.506 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2023-10-18T19:32:16.506 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2023-10-18T19:32:16.506 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2023-10-18T19:32:16.506 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 16/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2023-10-18T19:32:16.507 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2023-10-18T19:32:16.508 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2023-10-18T19:32:16.508 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2023-10-18T19:32:16.508 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2023-10-18T19:32:16.508 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2023-10-18T19:32:16.558 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:17.056 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:17.057 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-10-18T19:32:17.057 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.057 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:32:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.058 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T19:32:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: leveldb-1.22-1.el8.x86_64 2023-10-18T19:32:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T19:32:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-18T19:32:17.059 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T19:32:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T19:32:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T19:32:17.060 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T19:32:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.061 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:17.062 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:17.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-test 2023-10-18T19:32:17.465 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2023-10-18T19:32:17.465 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:17.466 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-10-18T19:32:17.466 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.466 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:32:17.466 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.467 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.467 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.467 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.467 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-18T19:32:17.467 INFO:teuthology.orchestra.run.smithi192.stdout: leveldb-1.22-1.el8.x86_64 2023-10-18T19:32:17.468 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.468 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-18T19:32:17.468 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-18T19:32:17.468 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.469 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-18T19:32:17.469 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.469 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-18T19:32:17.469 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-18T19:32:17.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-18T19:32:17.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:17.471 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:17.471 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:17.798 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-test 2023-10-18T19:32:18.241 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:18.242 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:18.242 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:18.242 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:32:18.243 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2023-10-18T19:32:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-10-18T19:32:18.243 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-18T19:32:18.243 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-18T19:32:18.244 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-18T19:32:18.244 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-18T19:32:18.244 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:18.244 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:32:18.244 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:18.245 INFO:teuthology.orchestra.run.smithi184.stdout:Install 5 Packages 2023-10-18T19:32:18.245 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:18.245 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 36 M 2023-10-18T19:32:18.246 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 127 M 2023-10-18T19:32:18.246 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:32:18.472 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:42 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:18.650 INFO:teuthology.orchestra.run.smithi184.stdout:(1/5): jq-1.6-7.el8.x86_64.rpm 982 kB/s | 202 kB 00:00 2023-10-18T19:32:18.675 INFO:teuthology.orchestra.run.smithi184.stdout:(2/5): oniguruma-6.8.2-2.el8.x86_64.rpm 810 kB/s | 187 kB 00:00 2023-10-18T19:32:18.867 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:41 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:19.076 INFO:teuthology.orchestra.run.smithi184.stdout:(3/5): ceph-test-14.2.22-0.el8.x86_64.rpm 55 MB/s | 35 MB 00:00 2023-10-18T19:32:19.101 INFO:teuthology.orchestra.run.smithi184.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 166 kB/s | 71 kB 00:00 2023-10-18T19:32:19.226 INFO:teuthology.orchestra.run.smithi184.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 561 kB/s | 323 kB 00:00 2023-10-18T19:32:19.227 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:19.228 INFO:teuthology.orchestra.run.smithi184.stdout:Total 36 MB/s | 36 MB 00:00 2023-10-18T19:32:19.322 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:32:19.346 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:32:19.347 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:32:19.620 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:32:19.623 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:32:20.031 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:32:20.264 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:20.264 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:20.265 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:20.265 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:20.265 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:32:20.265 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2023-10-18T19:32:20.266 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-18T19:32:20.266 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-18T19:32:20.266 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-18T19:32:20.266 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-18T19:32:20.266 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-18T19:32:20.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:20.267 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:32:20.267 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:20.267 INFO:teuthology.orchestra.run.smithi088.stdout:Install 5 Packages 2023-10-18T19:32:20.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:20.268 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 36 M 2023-10-18T19:32:20.268 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 127 M 2023-10-18T19:32:20.269 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:32:20.283 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2023-10-18T19:32:20.447 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2023-10-18T19:32:20.464 INFO:teuthology.orchestra.run.smithi088.stdout:(1/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-18T19:32:20.505 INFO:teuthology.orchestra.run.smithi088.stdout:(2/5): jq-1.6-7.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-10-18T19:32:20.512 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:32:20.513 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:20.513 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:20.514 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:20.514 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:32:20.514 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2023-10-18T19:32:20.514 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-18T19:32:20.515 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-18T19:32:20.515 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-18T19:32:20.515 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout:Install 5 Packages 2023-10-18T19:32:20.516 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:20.517 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 36 M 2023-10-18T19:32:20.517 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 127 M 2023-10-18T19:32:20.518 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:32:20.584 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:20.668 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:20.874 INFO:teuthology.orchestra.run.smithi192.stdout:(1/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-10-18T19:32:20.899 INFO:teuthology.orchestra.run.smithi192.stdout:(2/5): jq-1.6-7.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-10-18T19:32:20.914 INFO:teuthology.orchestra.run.smithi088.stdout:(3/5): ceph-test-14.2.22-0.el8.x86_64.rpm 57 MB/s | 35 MB 00:00 2023-10-18T19:32:20.948 INFO:teuthology.orchestra.run.smithi088.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 160 kB/s | 71 kB 00:00 2023-10-18T19:32:21.006 INFO:teuthology.orchestra.run.smithi088.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 596 kB/s | 323 kB 00:00 2023-10-18T19:32:21.007 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:21.008 INFO:teuthology.orchestra.run.smithi088.stdout:Total 48 MB/s | 36 MB 00:00 2023-10-18T19:32:21.099 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:32:21.123 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:32:21.124 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:32:21.317 INFO:teuthology.orchestra.run.smithi192.stdout:(3/5): ceph-test-14.2.22-0.el8.x86_64.rpm 57 MB/s | 35 MB 00:00 2023-10-18T19:32:21.691 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:32:21.691 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:32:21.692 INFO:teuthology.orchestra.run.smithi192.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 160 kB/s | 71 kB 00:00 2023-10-18T19:32:21.692 INFO:teuthology.orchestra.run.smithi192.stdout:(5/5): socat-1.7.4.1-1.el8.x86_64.rpm 578 kB/s | 323 kB 00:00 2023-10-18T19:32:21.692 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:21.693 INFO:teuthology.orchestra.run.smithi192.stdout:Total 39 MB/s | 36 MB 00:00 2023-10-18T19:32:21.693 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:32:21.693 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:32:21.693 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:32:21.823 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:32:21.826 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:32:21.827 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:32:22.055 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2023-10-18T19:32:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2023-10-18T19:32:22.238 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:32:22.370 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:22.455 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2023-10-18T19:32:22.473 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2023-10-18T19:32:22.766 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:22.867 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:24.085 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-7.el8.x86_64 4/5 2023-10-18T19:32:24.332 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:24.703 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:24.704 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2023-10-18T19:32:24.704 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-7.el8.x86_64 2/5 2023-10-18T19:32:24.704 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:24.704 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2023-10-18T19:32:25.465 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-18T19:32:25.465 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:25.465 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:32:25.466 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-7.el8.x86_64 2023-10-18T19:32:25.466 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2023-10-18T19:32:25.466 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T19:32:25.466 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:25.466 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:25.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph 2023-10-18T19:32:25.918 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-7.el8.x86_64 4/5 2023-10-18T19:32:26.143 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:26.303 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.6-7.el8.x86_64 4/5 2023-10-18T19:32:26.515 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:26.515 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2023-10-18T19:32:26.515 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-7.el8.x86_64 2/5 2023-10-18T19:32:26.515 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:26.516 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2023-10-18T19:32:26.564 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:26.756 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:26.940 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2023-10-18T19:32:26.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2023-10-18T19:32:26.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.6-7.el8.x86_64 2/5 2023-10-18T19:32:26.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2023-10-18T19:32:26.941 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2023-10-18T19:32:27.278 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-18T19:32:27.279 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:27.279 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:32:27.279 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-7.el8.x86_64 2023-10-18T19:32:27.279 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2023-10-18T19:32:27.280 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T19:32:27.280 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:27.280 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:27.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph 2023-10-18T19:32:27.665 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2023-10-18T19:32:27.666 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:27.666 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:32:27.666 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-7.el8.x86_64 2023-10-18T19:32:27.666 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2023-10-18T19:32:27.667 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-18T19:32:27.667 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:27.667 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:27.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph 2023-10-18T19:32:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:28.450 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-10-18T19:32:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:32:28.450 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2023-10-18T19:32:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-10-18T19:32:28.451 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2023-10-18T19:32:28.451 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2023-10-18T19:32:28.451 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2023-10-18T19:32:28.451 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2023-10-18T19:32:28.451 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T19:32:28.452 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T19:32:28.452 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-18T19:32:28.452 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T19:32:28.452 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T19:32:28.452 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-18T19:32:28.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T19:32:28.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T19:32:28.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T19:32:28.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-18T19:32:28.453 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-18T19:32:28.454 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T19:32:28.454 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T19:32:28.454 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T19:32:28.454 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-18T19:32:28.454 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-18T19:32:28.455 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-18T19:32:28.455 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T19:32:28.455 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T19:32:28.455 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T19:32:28.455 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T19:32:28.456 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T19:32:28.456 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T19:32:28.456 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T19:32:28.456 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-18T19:32:28.456 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T19:32:28.457 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:32:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:Install 31 Packages 2023-10-18T19:32:28.457 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 28 M 2023-10-18T19:32:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 93 M 2023-10-18T19:32:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:32:28.526 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:28.945 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:28.984 INFO:teuthology.orchestra.run.smithi184.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 106 kB/s | 6.3 kB 00:00 2023-10-18T19:32:29.042 INFO:teuthology.orchestra.run.smithi184.stdout:(2/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 17 MB/s | 2.0 MB 00:00 2023-10-18T19:32:29.084 INFO:teuthology.orchestra.run.smithi184.stdout:(3/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2023-10-18T19:32:29.210 INFO:teuthology.orchestra.run.smithi184.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 20 MB/s | 4.5 MB 00:00 2023-10-18T19:32:29.460 INFO:teuthology.orchestra.run.smithi184.stdout:(5/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 40 MB/s | 17 MB 00:00 2023-10-18T19:32:29.485 INFO:teuthology.orchestra.run.smithi184.stdout:(6/31): python3-markupsafe-0.23-19.el8.x86_64.r 141 kB/s | 39 kB 00:00 2023-10-18T19:32:29.519 INFO:teuthology.orchestra.run.smithi184.stdout:(7/31): python3-mako-1.0.6-14.el8.noarch.rpm 361 kB/s | 157 kB 00:00 2023-10-18T19:32:29.619 INFO:teuthology.orchestra.run.smithi184.stdout:(8/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 652 kB/s | 103 kB 00:00 2023-10-18T19:32:29.644 INFO:teuthology.orchestra.run.smithi184.stdout:(9/31): python3-pytz-2017.2-11.el8.noarch.rpm 359 kB/s | 57 kB 00:00 2023-10-18T19:32:29.745 INFO:teuthology.orchestra.run.smithi184.stdout:(10/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-18T19:32:29.770 INFO:teuthology.orchestra.run.smithi184.stdout:(11/31): python3-werkzeug-0.12.2-4.el8.noarch.r 1.8 MB/s | 457 kB 00:00 2023-10-18T19:32:29.795 INFO:teuthology.orchestra.run.smithi184.stdout:(12/31): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-10-18T19:32:29.846 INFO:teuthology.orchestra.run.smithi184.stdout:(13/31): python3-cryptography-3.2.1-6.el8.x86_6 3.1 MB/s | 641 kB 00:00 2023-10-18T19:32:29.863 INFO:teuthology.orchestra.run.smithi184.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 475 kB/s | 44 kB 00:00 2023-10-18T19:32:29.930 INFO:teuthology.orchestra.run.smithi184.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2023-10-18T19:32:29.980 INFO:teuthology.orchestra.run.smithi184.stdout:(16/31): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-10-18T19:32:30.014 INFO:teuthology.orchestra.run.smithi184.stdout:(17/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.0 MB/s | 173 kB 00:00 2023-10-18T19:32:30.039 INFO:teuthology.orchestra.run.smithi184.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 300 kB/s | 18 kB 00:00 2023-10-18T19:32:30.064 INFO:teuthology.orchestra.run.smithi184.stdout:(19/31): python3-logutils-0.3.5-11.el8.noarch.r 976 kB/s | 49 kB 00:00 2023-10-18T19:32:30.089 INFO:teuthology.orchestra.run.smithi184.stdout:(20/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2023-10-18T19:32:30.115 INFO:teuthology.orchestra.run.smithi184.stdout:(21/31): python3-more-itertools-7.2.0-3.el8.noa 778 kB/s | 59 kB 00:00 2023-10-18T19:32:30.140 INFO:teuthology.orchestra.run.smithi184.stdout:(22/31): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-10-18T19:32:30.165 INFO:teuthology.orchestra.run.smithi184.stdout:(23/31): python3-simplegeneric-0.8.1-17.el8.noa 376 kB/s | 19 kB 00:00 2023-10-18T19:32:30.190 INFO:teuthology.orchestra.run.smithi184.stdout:(24/31): python3-singledispatch-3.4.0.3-18.el8. 478 kB/s | 24 kB 00:00 2023-10-18T19:32:30.214 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:30.216 INFO:teuthology.orchestra.run.smithi184.stdout:(25/31): python3-tempora-1.14.1-5.el8.noarch.rp 581 kB/s | 29 kB 00:00 2023-10-18T19:32:30.218 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-18T19:32:30.219 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:30.219 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:32:30.219 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2023-10-18T19:32:30.219 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-18T19:32:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2023-10-18T19:32:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2023-10-18T19:32:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2023-10-18T19:32:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2023-10-18T19:32:30.220 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T19:32:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T19:32:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-18T19:32:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T19:32:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T19:32:30.221 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-18T19:32:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T19:32:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T19:32:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T19:32:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-18T19:32:30.222 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-18T19:32:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T19:32:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T19:32:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T19:32:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-18T19:32:30.223 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-18T19:32:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-18T19:32:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T19:32:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T19:32:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T19:32:30.224 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T19:32:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T19:32:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T19:32:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T19:32:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-18T19:32:30.225 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T19:32:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:30.226 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:32:30.226 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:30.226 INFO:teuthology.orchestra.run.smithi088.stdout:Install 31 Packages 2023-10-18T19:32:30.226 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:30.227 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 28 M 2023-10-18T19:32:30.227 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 93 M 2023-10-18T19:32:30.227 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:32:30.241 INFO:teuthology.orchestra.run.smithi184.stdout:(26/31): python3-trustme-0.6.0-4.el8.noarch.rpm 548 kB/s | 27 kB 00:00 2023-10-18T19:32:30.258 INFO:teuthology.orchestra.run.smithi184.stdout:(27/31): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-10-18T19:32:30.316 INFO:teuthology.orchestra.run.smithi184.stdout:(28/31): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-10-18T19:32:30.333 INFO:teuthology.orchestra.run.smithi184.stdout:(29/31): python3-waitress-1.4.3-1.el8.noarch.rp 2.1 MB/s | 255 kB 00:00 2023-10-18T19:32:30.359 INFO:teuthology.orchestra.run.smithi184.stdout:(30/31): python3-zc-lockfile-2.0-2.el8.noarch.r 552 kB/s | 23 kB 00:00 2023-10-18T19:32:30.384 INFO:teuthology.orchestra.run.smithi184.stdout:(31/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.7 MB/s | 251 kB 00:00 2023-10-18T19:32:30.386 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:30.387 INFO:teuthology.orchestra.run.smithi184.stdout:Total 15 MB/s | 28 MB 00:01 2023-10-18T19:32:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 109 kB/s | 6.3 kB 00:00 2023-10-18T19:32:30.574 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:32:30.580 INFO:teuthology.orchestra.run.smithi088.stdout:(2/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2023-10-18T19:32:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:32:30.619 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:32:30.620 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:32:30.622 INFO:teuthology.orchestra.run.smithi088.stdout:(3/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2023-10-18T19:32:30.623 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:30.623 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-10-18T19:32:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:32:30.624 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2023-10-18T19:32:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-18T19:32:30.624 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2023-10-18T19:32:30.625 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2023-10-18T19:32:30.625 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2023-10-18T19:32:30.625 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2023-10-18T19:32:30.625 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-18T19:32:30.625 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-18T19:32:30.626 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-18T19:32:30.626 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-18T19:32:30.626 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-18T19:32:30.626 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-18T19:32:30.626 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-18T19:32:30.627 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-18T19:32:30.627 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-18T19:32:30.627 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-18T19:32:30.627 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-18T19:32:30.627 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-18T19:32:30.628 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-18T19:32:30.628 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-18T19:32:30.628 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-18T19:32:30.628 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-18T19:32:30.628 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-18T19:32:30.629 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-18T19:32:30.630 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-18T19:32:30.630 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-18T19:32:30.630 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-18T19:32:30.630 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:30.630 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:32:30.631 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:30.631 INFO:teuthology.orchestra.run.smithi192.stdout:Install 31 Packages 2023-10-18T19:32:30.631 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:30.632 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 28 M 2023-10-18T19:32:30.632 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 93 M 2023-10-18T19:32:30.632 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:32:30.715 INFO:teuthology.orchestra.run.smithi088.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 24 MB/s | 4.5 MB 00:00 2023-10-18T19:32:30.815 INFO:teuthology.orchestra.run.smithi088.stdout:(5/31): python3-mako-1.0.6-14.el8.noarch.rpm 818 kB/s | 157 kB 00:00 2023-10-18T19:32:30.840 INFO:teuthology.orchestra.run.smithi088.stdout:(6/31): python3-markupsafe-0.23-19.el8.x86_64.r 310 kB/s | 39 kB 00:00 2023-10-18T19:32:30.935 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:32:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:32:31.041 INFO:teuthology.orchestra.run.smithi088.stdout:(7/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 37 MB/s | 17 MB 00:00 2023-10-18T19:32:31.059 INFO:teuthology.orchestra.run.smithi192.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 116 kB/s | 6.3 kB 00:00 2023-10-18T19:32:31.066 INFO:teuthology.orchestra.run.smithi088.stdout:(8/31): python3-pytz-2017.2-11.el8.noarch.rpm 253 kB/s | 57 kB 00:00 2023-10-18T19:32:31.091 INFO:teuthology.orchestra.run.smithi088.stdout:(9/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 375 kB/s | 103 kB 00:00 2023-10-18T19:32:31.117 INFO:teuthology.orchestra.run.smithi192.stdout:(2/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2023-10-18T19:32:31.167 INFO:teuthology.orchestra.run.smithi192.stdout:(3/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 12 MB/s | 2.0 MB 00:00 2023-10-18T19:32:31.208 INFO:teuthology.orchestra.run.smithi088.stdout:(10/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2023-10-18T19:32:31.258 INFO:teuthology.orchestra.run.smithi088.stdout:(11/31): python3-cryptography-3.2.1-6.el8.x86_6 3.8 MB/s | 641 kB 00:00 2023-10-18T19:32:31.261 INFO:teuthology.orchestra.run.smithi192.stdout:(4/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 22 MB/s | 4.5 MB 00:00 2023-10-18T19:32:31.275 INFO:teuthology.orchestra.run.smithi088.stdout:(12/31): python3-pycparser-2.14-14.el8.noarch.r 1.6 MB/s | 109 kB 00:00 2023-10-18T19:32:31.309 INFO:teuthology.orchestra.run.smithi088.stdout:(13/31): python3-werkzeug-0.12.2-4.el8.noarch.r 1.7 MB/s | 457 kB 00:00 2023-10-18T19:32:31.359 INFO:teuthology.orchestra.run.smithi192.stdout:(5/31): python3-mako-1.0.6-14.el8.noarch.rpm 819 kB/s | 157 kB 00:00 2023-10-18T19:32:31.384 INFO:teuthology.orchestra.run.smithi192.stdout:(6/31): python3-markupsafe-0.23-19.el8.x86_64.r 310 kB/s | 39 kB 00:00 2023-10-18T19:32:31.443 INFO:teuthology.orchestra.run.smithi088.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 237 kB/s | 44 kB 00:00 2023-10-18T19:32:31.501 INFO:teuthology.orchestra.run.smithi088.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 822 kB/s | 185 kB 00:00 2023-10-18T19:32:31.560 INFO:teuthology.orchestra.run.smithi088.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 690 kB/s | 173 kB 00:00 2023-10-18T19:32:31.560 INFO:teuthology.orchestra.run.smithi192.stdout:(7/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 38 MB/s | 17 MB 00:00 2023-10-18T19:32:31.585 INFO:teuthology.orchestra.run.smithi088.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-18T19:32:31.602 INFO:teuthology.orchestra.run.smithi192.stdout:(8/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 427 kB/s | 103 kB 00:00 2023-10-18T19:32:31.627 INFO:teuthology.orchestra.run.smithi088.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 262 kB/s | 18 kB 00:00 2023-10-18T19:32:31.652 INFO:teuthology.orchestra.run.smithi088.stdout:(19/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.8 MB/s | 384 kB 00:00 2023-10-18T19:32:31.678 INFO:teuthology.orchestra.run.smithi088.stdout:(20/31): python3-logutils-0.3.5-11.el8.noarch.r 529 kB/s | 49 kB 00:00 2023-10-18T19:32:31.702 INFO:teuthology.orchestra.run.smithi192.stdout:(9/31): python3-pytz-2017.2-11.el8.noarch.rpm 180 kB/s | 57 kB 00:00 2023-10-18T19:32:31.703 INFO:teuthology.orchestra.run.smithi088.stdout:(21/31): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2023-10-18T19:32:31.728 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] python3-cryptography-3.2.1-6.el8.x86_64.rpm: Status code: 500 for http://mirror.ette.biz/centos/8-stream/BaseOS/x86_64/os/Packages/python3-cryptography-3.2.1-6.el8.x86_64.rpm (IP: 38.105.93.109) 2023-10-18T19:32:31.736 INFO:teuthology.orchestra.run.smithi088.stdout:(22/31): python3-portend-2.6-1.el8.noarch.rpm 265 kB/s | 16 kB 00:00 2023-10-18T19:32:31.762 INFO:teuthology.orchestra.run.smithi088.stdout:(23/31): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-10-18T19:32:31.769 INFO:teuthology.orchestra.run.smithi192.stdout:(10/31): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2023-10-18T19:32:31.787 INFO:teuthology.orchestra.run.smithi088.stdout:(24/31): python3-simplegeneric-0.8.1-17.el8.noa 224 kB/s | 19 kB 00:00 2023-10-18T19:32:31.803 INFO:teuthology.orchestra.run.smithi192.stdout:(11/31): python3-pycparser-2.14-14.el8.noarch.r 3.2 MB/s | 109 kB 00:00 2023-10-18T19:32:31.812 INFO:teuthology.orchestra.run.smithi088.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-10-18T19:32:31.838 INFO:teuthology.orchestra.run.smithi088.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2023-10-18T19:32:31.853 INFO:teuthology.orchestra.run.smithi192.stdout:(12/31): python3-werkzeug-0.12.2-4.el8.noarch.r 1.5 MB/s | 457 kB 00:00 2023-10-18T19:32:31.871 INFO:teuthology.orchestra.run.smithi088.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 327 kB/s | 27 kB 00:00 2023-10-18T19:32:31.922 INFO:teuthology.orchestra.run.smithi088.stdout:(28/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.9 MB/s | 251 kB 00:00 2023-10-18T19:32:31.947 INFO:teuthology.orchestra.run.smithi088.stdout:(29/31): python3-waitress-1.4.3-1.el8.noarch.rp 1.9 MB/s | 255 kB 00:00 2023-10-18T19:32:31.972 INFO:teuthology.orchestra.run.smithi088.stdout:(30/31): python3-webtest-2.0.33-1.el8.noarch.rp 850 kB/s | 85 kB 00:00 2023-10-18T19:32:31.997 INFO:teuthology.orchestra.run.smithi088.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 304 kB/s | 23 kB 00:00 2023-10-18T19:32:32.000 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:32.001 INFO:teuthology.orchestra.run.smithi088.stdout:Total 16 MB/s | 28 MB 00:01 2023-10-18T19:32:32.034 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:32:32.036 INFO:teuthology.orchestra.run.smithi192.stdout:(13/31): python3-cryptography-3.2.1-6.el8.x86_6 1.9 MB/s | 641 kB 00:00 2023-10-18T19:32:32.078 INFO:teuthology.orchestra.run.smithi192.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 158 kB/s | 44 kB 00:00 2023-10-18T19:32:32.187 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:32:32.229 INFO:teuthology.orchestra.run.smithi192.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 493 kB/s | 185 kB 00:00 2023-10-18T19:32:32.232 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:32:32.232 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:32:32.240 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2023-10-18T19:32:32.312 INFO:teuthology.orchestra.run.smithi192.stdout:(16/31): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-18T19:32:32.337 INFO:teuthology.orchestra.run.smithi192.stdout:(17/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.5 MB/s | 384 kB 00:00 2023-10-18T19:32:32.396 INFO:teuthology.orchestra.run.smithi192.stdout:(18/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 481 kB/s | 173 kB 00:00 2023-10-18T19:32:32.421 INFO:teuthology.orchestra.run.smithi192.stdout:(19/31): python3-jaraco-functools-2.0-4.el8.noa 161 kB/s | 18 kB 00:00 2023-10-18T19:32:32.433 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2023-10-18T19:32:32.447 INFO:teuthology.orchestra.run.smithi192.stdout:(20/31): python3-logutils-0.3.5-11.el8.noarch.r 448 kB/s | 49 kB 00:00 2023-10-18T19:32:32.489 INFO:teuthology.orchestra.run.smithi192.stdout:(21/31): python3-more-itertools-7.2.0-3.el8.noa 637 kB/s | 59 kB 00:00 2023-10-18T19:32:32.531 INFO:teuthology.orchestra.run.smithi192.stdout:(22/31): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-10-18T19:32:32.556 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:32:32.560 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:32:32.564 INFO:teuthology.orchestra.run.smithi192.stdout:(23/31): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-18T19:32:32.589 INFO:teuthology.orchestra.run.smithi192.stdout:(24/31): python3-simplegeneric-0.8.1-17.el8.noa 187 kB/s | 19 kB 00:00 2023-10-18T19:32:32.615 INFO:teuthology.orchestra.run.smithi192.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 286 kB/s | 24 kB 00:00 2023-10-18T19:32:32.644 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2023-10-18T19:32:32.648 INFO:teuthology.orchestra.run.smithi192.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 348 kB/s | 29 kB 00:00 2023-10-18T19:32:32.674 INFO:teuthology.orchestra.run.smithi192.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 327 kB/s | 27 kB 00:00 2023-10-18T19:32:32.707 INFO:teuthology.orchestra.run.smithi192.stdout:(28/31): python3-waitress-1.4.3-1.el8.noarch.rp 2.7 MB/s | 255 kB 00:00 2023-10-18T19:32:32.749 INFO:teuthology.orchestra.run.smithi192.stdout:(29/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2023-10-18T19:32:32.774 INFO:teuthology.orchestra.run.smithi192.stdout:(30/31): python3-webtest-2.0.33-1.el8.noarch.rp 852 kB/s | 85 kB 00:00 2023-10-18T19:32:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 275 kB/s | 23 kB 00:00 2023-10-18T19:32:32.796 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:32.796 INFO:teuthology.orchestra.run.smithi192.stdout:Total 13 MB/s | 28 MB 00:02 2023-10-18T19:32:32.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2023-10-18T19:32:32.983 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:32:32.987 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2023-10-18T19:32:33.028 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:32:33.029 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:32:33.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2023-10-18T19:32:33.340 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:32:33.344 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:32:33.369 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2023-10-18T19:32:33.556 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2023-10-18T19:32:33.634 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:32:33.764 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2023-10-18T19:32:33.850 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2023-10-18T19:32:33.998 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2023-10-18T19:32:34.069 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2023-10-18T19:32:34.221 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2023-10-18T19:32:34.299 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2023-10-18T19:32:34.408 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:32:34.461 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2023-10-18T19:32:34.509 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2023-10-18T19:32:34.656 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2023-10-18T19:32:34.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2023-10-18T19:32:34.832 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2023-10-18T19:32:34.855 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2023-10-18T19:32:34.886 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2023-10-18T19:32:35.053 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2023-10-18T19:32:35.079 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2023-10-18T19:32:35.131 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/31 2023-10-18T19:32:35.263 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/31 2023-10-18T19:32:35.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2023-10-18T19:32:35.292 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2023-10-18T19:32:35.427 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2023-10-18T19:32:35.507 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2023-10-18T19:32:35.531 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2023-10-18T19:32:35.586 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2023-10-18T19:32:35.743 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2023-10-18T19:32:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2023-10-18T19:32:35.834 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2023-10-18T19:32:36.010 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2023-10-18T19:32:36.046 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2023-10-18T19:32:36.079 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2023-10-18T19:32:36.232 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2023-10-18T19:32:36.289 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2023-10-18T19:32:36.337 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2023-10-18T19:32:36.386 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2023-10-18T19:32:36.571 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2023-10-18T19:32:36.614 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2023-10-18T19:32:36.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2023-10-18T19:32:36.835 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2023-10-18T19:32:36.862 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2023-10-18T19:32:37.024 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/31 2023-10-18T19:32:37.080 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2023-10-18T19:32:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2023-10-18T19:32:37.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2023-10-18T19:32:37.304 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2023-10-18T19:32:37.504 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2023-10-18T19:32:37.606 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/31 2023-10-18T19:32:37.684 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2023-10-18T19:32:37.737 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2023-10-18T19:32:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/31 2023-10-18T19:32:38.062 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2023-10-18T19:32:38.089 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2023-10-18T19:32:38.140 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2023-10-18T19:32:38.243 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2023-10-18T19:32:38.348 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2023-10-18T19:32:38.349 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:38.421 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2023-10-18T19:32:38.608 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2023-10-18T19:32:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2023-10-18T19:32:38.907 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2023-10-18T19:32:38.973 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2023-10-18T19:32:39.148 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2023-10-18T19:32:39.180 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2023-10-18T19:32:39.382 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2023-10-18T19:32:39.393 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/31 2023-10-18T19:32:39.586 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2023-10-18T19:32:39.785 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2023-10-18T19:32:39.824 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:39.872 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2023-10-18T19:32:39.982 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:40.086 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2023-10-18T19:32:40.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2023-10-18T19:32:40.378 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2023-10-18T19:32:40.430 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:40.557 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:40.770 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:40.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/31 2023-10-18T19:32:40.907 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:40.950 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:41.064 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:41.172 INFO:teuthology.orchestra.run.smithi184.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T19:32:41.172 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:41.289 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2023-10-18T19:32:41.546 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2023-10-18T19:32:41.710 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2023-10-18T19:32:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2023-10-18T19:32:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2023-10-18T19:32:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2023-10-18T19:32:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2023-10-18T19:32:41.711 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2023-10-18T19:32:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2023-10-18T19:32:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2023-10-18T19:32:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2023-10-18T19:32:41.712 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2023-10-18T19:32:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 12/31 2023-10-18T19:32:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2023-10-18T19:32:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2023-10-18T19:32:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2023-10-18T19:32:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2023-10-18T19:32:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2023-10-18T19:32:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2023-10-18T19:32:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2023-10-18T19:32:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2023-10-18T19:32:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2023-10-18T19:32:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2023-10-18T19:32:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2023-10-18T19:32:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2023-10-18T19:32:41.715 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2023-10-18T19:32:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2023-10-18T19:32:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2023-10-18T19:32:41.716 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2023-10-18T19:32:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2023-10-18T19:32:41.717 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2023-10-18T19:32:41.933 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:42.149 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:42.602 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:42.766 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:42.781 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2023-10-18T19:32:42.781 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:42.781 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:32:42.781 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:42.782 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:42.782 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:42.782 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:42.782 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:42.783 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T19:32:42.783 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T19:32:42.783 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-18T19:32:42.783 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T19:32:42.783 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T19:32:42.784 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-18T19:32:42.784 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T19:32:42.784 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T19:32:42.784 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T19:32:42.784 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-18T19:32:42.785 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T19:32:42.785 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T19:32:42.785 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T19:32:42.785 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T19:32:42.785 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T19:32:42.786 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T19:32:42.786 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-18T19:32:42.786 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T19:32:42.786 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T19:32:42.786 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T19:32:42.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T19:32:42.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T19:32:42.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T19:32:42.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T19:32:42.787 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T19:32:42.788 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T19:32:42.788 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:42.788 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:42.981 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:43.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-base 2023-10-18T19:32:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2023-10-18T19:32:43.158 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:43.201 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:43.221 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:43.427 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:43.427 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T19:32:43.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:43.670 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2023-10-18T19:32:43.846 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:43.966 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2023-10-18T19:32:43.966 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2023-10-18T19:32:43.966 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2023-10-18T19:32:43.967 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2023-10-18T19:32:43.967 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2023-10-18T19:32:43.967 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2023-10-18T19:32:43.967 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2023-10-18T19:32:43.968 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2023-10-18T19:32:43.968 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2023-10-18T19:32:43.968 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2023-10-18T19:32:43.968 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2023-10-18T19:32:43.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 12/31 2023-10-18T19:32:43.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2023-10-18T19:32:43.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2023-10-18T19:32:43.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2023-10-18T19:32:43.969 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2023-10-18T19:32:43.970 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2023-10-18T19:32:43.970 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2023-10-18T19:32:43.970 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2023-10-18T19:32:43.970 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2023-10-18T19:32:43.971 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2023-10-18T19:32:43.971 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2023-10-18T19:32:43.971 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2023-10-18T19:32:43.971 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2023-10-18T19:32:43.971 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2023-10-18T19:32:43.972 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2023-10-18T19:32:43.972 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2023-10-18T19:32:43.973 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2023-10-18T19:32:43.973 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2023-10-18T19:32:43.973 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2023-10-18T19:32:44.059 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2023-10-18T19:32:44.087 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:09 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:44.281 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2023-10-18T19:32:44.446 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:44.555 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2023-10-18T19:32:44.556 INFO:teuthology.orchestra.run.smithi192.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T19:32:44.556 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:45.078 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2023-10-18T19:32:45.078 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:32:45.078 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:45.079 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:45.079 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:45.079 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:45.079 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:45.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T19:32:45.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T19:32:45.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-18T19:32:45.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T19:32:45.080 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T19:32:45.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-18T19:32:45.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T19:32:45.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T19:32:45.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T19:32:45.081 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-18T19:32:45.082 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T19:32:45.082 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T19:32:45.082 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T19:32:45.082 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T19:32:45.082 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T19:32:45.083 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T19:32:45.084 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T19:32:45.084 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T19:32:45.084 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T19:32:45.084 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T19:32:45.084 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T19:32:45.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:45.097 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2023-10-18T19:32:45.097 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2023-10-18T19:32:45.097 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2023-10-18T19:32:45.097 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2023-10-18T19:32:45.098 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2023-10-18T19:32:45.098 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 6/31 2023-10-18T19:32:45.098 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2023-10-18T19:32:45.098 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2023-10-18T19:32:45.098 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 9/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 11/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 12/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2023-10-18T19:32:45.099 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2023-10-18T19:32:45.100 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2023-10-18T19:32:45.100 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2023-10-18T19:32:45.100 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2023-10-18T19:32:45.100 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2023-10-18T19:32:45.100 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2023-10-18T19:32:45.101 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2023-10-18T19:32:45.101 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2023-10-18T19:32:45.101 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2023-10-18T19:32:45.101 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2023-10-18T19:32:45.101 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2023-10-18T19:32:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2023-10-18T19:32:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2023-10-18T19:32:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 28/31 2023-10-18T19:32:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2023-10-18T19:32:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2023-10-18T19:32:45.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-base 2023-10-18T19:32:45.553 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:45.764 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:45.765 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:32:45.766 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:46.240 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2023-10-18T19:32:46.241 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:46.241 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:32:46.241 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:46.241 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:46.241 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:46.242 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:46.242 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:46.242 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-18T19:32:46.242 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-18T19:32:46.242 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-18T19:32:46.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-18T19:32:46.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-18T19:32:46.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-18T19:32:46.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-18T19:32:46.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-18T19:32:46.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2023-10-18T19:32:46.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-18T19:32:46.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-18T19:32:46.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-18T19:32:46.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-18T19:32:46.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-18T19:32:46.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-18T19:32:46.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-18T19:32:46.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-18T19:32:46.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-18T19:32:46.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-18T19:32:46.247 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-18T19:32:46.247 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-18T19:32:46.247 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:46.247 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:46.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr 2023-10-18T19:32:46.440 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:10 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:46.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-base 2023-10-18T19:32:47.358 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:47.594 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:10 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:47.890 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:48.099 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:48.100 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:32:48.100 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:48.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-mgr 2023-10-18T19:32:48.826 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:49.037 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:49.038 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:49.038 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:32:49.039 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:49.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-fuse 2023-10-18T19:32:49.249 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:32:49.251 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:32:49.251 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:49.288 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:13 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:49.373 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr 2023-10-18T19:32:50.226 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:15 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:50.439 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:13 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:50.771 INFO:teuthology.orchestra.run.smithi088.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:50.981 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:50.983 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:32:50.983 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:51.104 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-fuse 2023-10-18T19:32:51.883 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:51.884 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:51.884 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:51.884 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:51.885 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:32:51.885 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2023-10-18T19:32:51.885 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-10-18T19:32:51.885 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-18T19:32:51.885 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:51.886 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:32:51.886 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:51.886 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2023-10-18T19:32:51.886 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:51.887 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 673 k 2023-10-18T19:32:51.887 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 1.9 M 2023-10-18T19:32:51.887 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:32:51.905 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:32:52.116 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:32:52.117 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:32:52.118 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:52.130 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 12 MB/s | 590 kB 00:00 2023-10-18T19:32:52.162 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:16 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:52.196 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 732 kB/s | 83 kB 00:00 2023-10-18T19:32:52.197 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:52.197 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.1 MB/s | 673 kB 00:00 2023-10-18T19:32:52.220 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:32:52.247 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:32:52.247 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:32:52.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-fuse 2023-10-18T19:32:52.347 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:32:52.350 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:32:52.543 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:32:52.747 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-18T19:32:52.895 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:53.316 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:16 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:53.520 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:53.520 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2023-10-18T19:32:53.832 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:53.833 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:53.833 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:53.833 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:53.833 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:32:53.834 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2023-10-18T19:32:53.834 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-18T19:32:53.834 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-18T19:32:53.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:53.835 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:32:53.835 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:53.835 INFO:teuthology.orchestra.run.smithi088.stdout:Install 2 Packages 2023-10-18T19:32:53.835 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 673 k 2023-10-18T19:32:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 1.9 M 2023-10-18T19:32:53.836 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:32:54.085 INFO:teuthology.orchestra.run.smithi088.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 10 MB/s | 590 kB 00:00 2023-10-18T19:32:54.110 INFO:teuthology.orchestra.run.smithi088.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-10-18T19:32:54.110 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:54.111 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.4 MB/s | 673 kB 00:00 2023-10-18T19:32:54.134 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:32:54.160 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:32:54.160 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:32:54.201 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-18T19:32:54.201 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:54.201 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:32:54.201 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-18T19:32:54.202 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:54.202 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:54.260 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:32:54.264 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:32:54.458 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:32:54.489 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados-devel 2023-10-18T19:32:54.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-18T19:32:54.887 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:55.102 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:32:55.103 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:55.103 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:55.103 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:55.103 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:32:55.104 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2023-10-18T19:32:55.104 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-18T19:32:55.104 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-18T19:32:55.104 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:55.105 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:32:55.105 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:32:55.105 INFO:teuthology.orchestra.run.smithi192.stdout:Install 2 Packages 2023-10-18T19:32:55.105 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:55.106 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 673 k 2023-10-18T19:32:55.106 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 1.9 M 2023-10-18T19:32:55.106 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:32:55.205 INFO:teuthology.orchestra.run.smithi192.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 9.8 MB/s | 590 kB 00:00 2023-10-18T19:32:55.238 INFO:teuthology.orchestra.run.smithi192.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 897 kB/s | 83 kB 00:00 2023-10-18T19:32:55.239 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:55.239 INFO:teuthology.orchestra.run.smithi192.stdout:Total 4.9 MB/s | 673 kB 00:00 2023-10-18T19:32:55.263 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:32:55.290 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:32:55.290 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:32:55.391 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:32:55.394 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:32:55.484 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:55.484 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2023-10-18T19:32:55.560 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:32:55.582 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:32:55.846 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-10-18T19:32:56.044 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:56.167 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-18T19:32:56.167 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:56.167 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:32:56.168 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-18T19:32:56.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:56.168 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:32:56.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados-devel 2023-10-18T19:32:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2023-10-18T19:32:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2023-10-18T19:32:57.230 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:32:57.231 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:57.231 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:57.231 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:57.231 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:32:57.232 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2023-10-18T19:32:57.232 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:57.232 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:32:57.232 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:32:57.232 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-10-18T19:32:57.233 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:57.233 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 90 k 2023-10-18T19:32:57.234 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 310 k 2023-10-18T19:32:57.234 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:32:57.283 INFO:teuthology.orchestra.run.smithi184.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 1.7 MB/s | 90 kB 00:00 2023-10-18T19:32:57.284 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:57.284 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.7 MB/s | 90 kB 00:00 2023-10-18T19:32:57.285 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:32:57.298 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:32:57.298 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:32:57.353 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:32:57.356 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:32:57.374 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-10-18T19:32:57.375 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:57.375 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:32:57.375 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-10-18T19:32:57.375 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:32:57.376 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:32:57.465 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:32:57.488 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:32:57.610 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:32:57.631 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados-devel 2023-10-18T19:32:57.973 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:32:58.648 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:32:58.648 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:58.648 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:32:58.649 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:32:58.649 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:32:58.649 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:32:58.700 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:32:58.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs2 2023-10-18T19:32:59.172 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:32:59.172 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:59.172 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:32:59.173 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:59.173 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:32:59.173 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2023-10-18T19:32:59.173 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:59.173 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:32:59.174 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:32:59.174 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-10-18T19:32:59.174 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:32:59.175 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 90 k 2023-10-18T19:32:59.175 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 310 k 2023-10-18T19:32:59.175 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:32:59.213 INFO:teuthology.orchestra.run.smithi088.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 2.2 MB/s | 90 kB 00:00 2023-10-18T19:32:59.214 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:32:59.214 INFO:teuthology.orchestra.run.smithi088.stdout:Total 2.2 MB/s | 90 kB 00:00 2023-10-18T19:32:59.215 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:32:59.227 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:32:59.228 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:32:59.281 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:32:59.284 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:32:59.398 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:32:59.593 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:32:59.966 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:00.007 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:00.377 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:00.378 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:00.378 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:00.378 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:00.378 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-10-18T19:33:00.379 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:00.380 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 90 k 2023-10-18T19:33:00.380 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 310 k 2023-10-18T19:33:00.381 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:33:00.425 INFO:teuthology.orchestra.run.smithi192.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 1.9 MB/s | 90 kB 00:00 2023-10-18T19:33:00.426 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:00.426 INFO:teuthology.orchestra.run.smithi192.stdout:Total 1.9 MB/s | 90 kB 00:00 2023-10-18T19:33:00.427 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:33:00.439 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:33:00.440 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:33:00.493 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:33:00.496 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:33:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:33:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:00.650 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:33:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:00.651 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:00.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:00.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs2 2023-10-18T19:33:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:01.492 INFO:teuthology.orchestra.run.smithi184.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:01.702 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:01.703 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:33:01.704 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:01.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs-devel 2023-10-18T19:33:01.907 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:01.908 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:01.908 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:33:01.908 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:01.908 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:01.909 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:01.926 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:02.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs2 2023-10-18T19:33:02.863 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:03.236 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:03.361 INFO:teuthology.orchestra.run.smithi088.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:03.569 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:33:03.571 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:03.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install libcephfs-devel 2023-10-18T19:33:04.538 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:04.539 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:04.539 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:04.539 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:04.539 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:33:04.540 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2023-10-18T19:33:04.540 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:04.540 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:33:04.540 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:04.540 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-10-18T19:33:04.541 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:04.541 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 22 k 2023-10-18T19:33:04.541 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 77 k 2023-10-18T19:33:04.542 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:33:04.577 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 592 kB/s | 22 kB 00:00 2023-10-18T19:33:04.577 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:04.578 INFO:teuthology.orchestra.run.smithi184.stdout:Total 569 kB/s | 22 kB 00:00 2023-10-18T19:33:04.578 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:33:04.583 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:33:04.583 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:33:04.585 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:33:04.589 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:33:04.639 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:33:04.715 INFO:teuthology.orchestra.run.smithi192.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:04.734 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:04.783 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:04.924 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:04.925 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:33:04.926 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:05.062 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs-devel 2023-10-18T19:33:05.088 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:05.721 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:05.722 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:05.722 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:33:05.722 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:05.722 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:05.723 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:05.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2023-10-18T19:33:06.110 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:06.393 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:33:06.394 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2023-10-18T19:33:06.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:33:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-10-18T19:33:06.395 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 22 k 2023-10-18T19:33:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 77 k 2023-10-18T19:33:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:33:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 385 kB/s | 22 kB 00:00 2023-10-18T19:33:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:Total 376 kB/s | 22 kB 00:00 2023-10-18T19:33:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:33:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:33:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:33:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:33:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:33:06.513 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:33:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:06.929 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:06.935 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:07.593 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:07.593 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:07.594 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:33:07.594 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:07.594 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:07.594 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:07.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2023-10-18T19:33:07.831 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:07.832 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:07.833 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:07.833 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:07.833 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:33:07.833 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2023-10-18T19:33:07.834 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:07.834 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:33:07.834 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:07.834 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-10-18T19:33:07.835 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:07.835 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 22 k 2023-10-18T19:33:07.835 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 77 k 2023-10-18T19:33:07.835 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:33:07.877 INFO:teuthology.orchestra.run.smithi192.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 494 kB/s | 22 kB 00:00 2023-10-18T19:33:07.878 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:07.878 INFO:teuthology.orchestra.run.smithi192.stdout:Total 478 kB/s | 22 kB 00:00 2023-10-18T19:33:07.879 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:33:07.883 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:33:07.883 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:33:07.886 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:33:07.889 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:33:07.937 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:33:08.107 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:08.409 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:08.410 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:08.619 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:08.620 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:33:08.620 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:08.745 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librbd1 2023-10-18T19:33:08.827 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:09.112 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:33:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:09.113 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:09.345 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados2 2023-10-18T19:33:09.794 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:10.288 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:10.403 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:10.497 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:10.498 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:33:10.498 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:10.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librbd1 2023-10-18T19:33:11.277 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:11.487 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:11.488 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:33:11.489 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:11.605 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-fuse 2023-10-18T19:33:11.676 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:11.885 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:12.092 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:12.094 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:33:12.094 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:12.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librbd1 2023-10-18T19:33:12.659 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:13.156 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:13.303 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:13.366 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:13.368 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:33:13.368 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:13.501 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-fuse 2023-10-18T19:33:14.352 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:14.353 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:14.353 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:14.353 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:14.353 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:33:14.353 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2023-10-18T19:33:14.354 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:14.354 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:33:14.354 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:14.354 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-10-18T19:33:14.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:14.355 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 73 k 2023-10-18T19:33:14.356 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 188 k 2023-10-18T19:33:14.356 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:33:14.398 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2023-10-18T19:33:14.399 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:14.399 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.6 MB/s | 73 kB 00:00 2023-10-18T19:33:14.399 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:33:14.412 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:33:14.412 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:33:14.466 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:33:14.469 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:33:14.556 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:14.574 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:33:14.757 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:14.854 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:15.066 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:15.068 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:33:15.068 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:15.110 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:15.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-fuse 2023-10-18T19:33:15.799 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:15.799 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:15.800 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:33:15.800 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:15.800 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:15.800 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:16.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-mirror 2023-10-18T19:33:16.272 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:16.323 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:16.323 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:16.324 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:33:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2023-10-18T19:33:16.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:16.325 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:33:16.325 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:16.325 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-10-18T19:33:16.325 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:16.326 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 73 k 2023-10-18T19:33:16.326 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 188 k 2023-10-18T19:33:16.326 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:33:16.371 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2023-10-18T19:33:16.372 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:16.372 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.5 MB/s | 73 kB 00:00 2023-10-18T19:33:16.373 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:33:16.385 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:33:16.386 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:33:16.439 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:33:16.442 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:33:16.548 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:33:16.739 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:17.092 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:17.102 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:17.792 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:17.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:17.793 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:33:17.793 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:17.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:17.794 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:17.944 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:17.945 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:17.945 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:17.945 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:17.946 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:33:17.946 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2023-10-18T19:33:17.946 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:17.946 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:33:17.946 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:17.947 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-10-18T19:33:17.947 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:17.947 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 73 k 2023-10-18T19:33:17.948 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 188 k 2023-10-18T19:33:17.948 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:33:17.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-mirror 2023-10-18T19:33:17.999 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.4 MB/s | 73 kB 00:00 2023-10-18T19:33:17.999 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:18.000 INFO:teuthology.orchestra.run.smithi192.stdout:Total 1.3 MB/s | 73 kB 00:00 2023-10-18T19:33:18.000 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:33:18.013 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:33:18.013 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:33:18.068 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:33:18.071 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:33:18.191 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:33:18.405 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:18.770 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:18.770 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:18.770 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:18.771 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:18.771 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:33:18.771 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2023-10-18T19:33:18.771 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:18.771 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:33:18.772 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:18.772 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-10-18T19:33:18.772 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:18.772 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.3 M 2023-10-18T19:33:18.772 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 8.4 M 2023-10-18T19:33:18.773 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:33:18.788 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:18.842 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 33 MB/s | 2.3 MB 00:00 2023-10-18T19:33:18.842 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:18.843 INFO:teuthology.orchestra.run.smithi184.stdout:Total 32 MB/s | 2.3 MB 00:00 2023-10-18T19:33:18.843 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:33:18.858 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:33:18.859 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:33:18.921 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:33:18.924 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:33:19.029 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:19.248 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:33:19.400 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:19.465 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:19.466 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:19.466 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:33:19.466 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:19.466 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:19.467 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:19.708 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-mirror 2023-10-18T19:33:20.060 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:20.696 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:20.697 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:20.697 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:20.697 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:20.697 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:33:20.698 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2023-10-18T19:33:20.698 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:20.698 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:33:20.698 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:20.698 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-10-18T19:33:20.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:20.699 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 2.3 M 2023-10-18T19:33:20.699 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 8.4 M 2023-10-18T19:33:20.699 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:33:20.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:20.748 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:20.748 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:33:20.748 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:20.748 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:20.749 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:20.778 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:20.782 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 28 MB/s | 2.3 MB 00:00 2023-10-18T19:33:20.783 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:20.783 INFO:teuthology.orchestra.run.smithi088.stdout:Total 27 MB/s | 2.3 MB 00:00 2023-10-18T19:33:20.784 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:33:20.798 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:33:20.799 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:33:20.861 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:33:20.865 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:33:20.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-nbd 2023-10-18T19:33:21.197 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:33:21.366 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:22.012 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:22.019 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:22.445 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:22.445 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:22.446 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:22.446 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:33:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2023-10-18T19:33:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:22.446 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:33:22.447 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:22.447 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-10-18T19:33:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:22.449 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 2.3 M 2023-10-18T19:33:22.450 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 8.4 M 2023-10-18T19:33:22.450 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:33:22.534 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2023-10-18T19:33:22.535 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:22.535 INFO:teuthology.orchestra.run.smithi192.stdout:Total 26 MB/s | 2.3 MB 00:00 2023-10-18T19:33:22.536 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:33:22.550 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:33:22.551 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:33:22.613 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:33:22.616 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:33:22.730 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:22.731 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:22.731 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:33:22.731 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:22.731 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:22.731 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:22.935 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:33:22.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install rbd-nbd 2023-10-18T19:33:23.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:23.690 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:23.691 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:23.691 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:23.691 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:23.691 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-10-18T19:33:23.692 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2023-10-18T19:33:23.692 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:23.692 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-10-18T19:33:23.692 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-10-18T19:33:23.693 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2023-10-18T19:33:23.693 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:23.693 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 142 k 2023-10-18T19:33:23.693 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 422 k 2023-10-18T19:33:23.693 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-10-18T19:33:23.736 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.1 MB/s | 142 kB 00:00 2023-10-18T19:33:23.737 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:23.737 INFO:teuthology.orchestra.run.smithi184.stdout:Total 3.0 MB/s | 142 kB 00:00 2023-10-18T19:33:23.738 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-10-18T19:33:23.750 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-10-18T19:33:23.751 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-10-18T19:33:23.778 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:23.834 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-10-18T19:33:23.837 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-10-18T19:33:23.959 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-10-18T19:33:24.031 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:24.097 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:24.474 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:24.498 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:24.498 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:24.498 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:33:24.499 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:24.499 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:24.499 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:24.715 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-nbd 2023-10-18T19:33:25.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:25.156 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:25.156 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-10-18T19:33:25.156 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:25.156 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:25.157 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:25.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2023-10-18T19:33:25.726 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:25.728 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:25.728 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:25.728 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:25.728 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-18T19:33:25.728 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout:Install 1 Package 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:25.729 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 142 k 2023-10-18T19:33:25.730 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 422 k 2023-10-18T19:33:25.730 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:33:25.768 INFO:teuthology.orchestra.run.smithi088.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.6 MB/s | 142 kB 00:00 2023-10-18T19:33:25.769 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:25.769 INFO:teuthology.orchestra.run.smithi088.stdout:Total 3.4 MB/s | 142 kB 00:00 2023-10-18T19:33:25.769 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:33:25.776 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:25.782 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:33:25.783 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:33:25.868 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:33:25.871 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:33:26.027 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:33:26.196 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:26.452 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:51 ago on Wed 18 Oct 2023 07:31:35 PM UTC. 2023-10-18T19:33:26.568 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:27.310 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:27.311 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:27.311 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:33:27.311 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:27.311 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:27.312 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:27.439 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:27.441 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:27.441 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2023-10-18T19:33:27.441 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:27.441 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-18T19:33:27.442 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2023-10-18T19:33:27.442 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:27.442 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-18T19:33:27.442 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2023-10-18T19:33:27.442 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2023-10-18T19:33:27.443 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:27.443 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 142 k 2023-10-18T19:33:27.443 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 422 k 2023-10-18T19:33:27.443 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-18T19:33:27.479 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.7 MB/s | 142 kB 00:00 2023-10-18T19:33:27.479 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:33:27.480 INFO:teuthology.orchestra.run.smithi192.stdout:Total 3.6 MB/s | 142 kB 00:00 2023-10-18T19:33:27.480 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-18T19:33:27.494 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-18T19:33:27.494 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-18T19:33:27.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install librados2 2023-10-18T19:33:27.578 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-18T19:33:27.581 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-18T19:33:27.715 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-18T19:33:27.896 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:27.925 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:28.136 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-10-18T19:33:28.137 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-10-18T19:33:28.138 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-10-18T19:33:28.265 DEBUG:teuthology.parallel:result is None 2023-10-18T19:33:28.272 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:28.593 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:52 ago on Wed 18 Oct 2023 07:31:36 PM UTC. 2023-10-18T19:33:28.970 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2023-10-18T19:33:28.970 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:28.970 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-18T19:33:28.971 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2023-10-18T19:33:28.971 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:28.971 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:29.215 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados2 2023-10-18T19:33:30.053 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:30.263 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:33:30.264 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-18T19:33:30.265 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:33:30.273 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:53 ago on Wed 18 Oct 2023 07:31:37 PM UTC. 2023-10-18T19:33:30.383 DEBUG:teuthology.parallel:result is None 2023-10-18T19:33:31.734 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2023-10-18T19:33:31.945 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-18T19:33:31.946 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-18T19:33:31.946 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-18T19:33:32.086 DEBUG:teuthology.parallel:result is None 2023-10-18T19:33:32.086 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:33:32.087 INFO:teuthology.packaging:ref: None 2023-10-18T19:33:32.087 INFO:teuthology.packaging:tag: None 2023-10-18T19:33:32.087 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:33:32.088 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:33:32.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:33:32.346 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T19:33:32.406 INFO:teuthology.orchestra.run.smithi088.stdout:14.2.22-0.el8 2023-10-18T19:33:32.407 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2023-10-18T19:33:32.407 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2023-10-18T19:33:32.408 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:33:32.408 INFO:teuthology.packaging:ref: None 2023-10-18T19:33:32.408 INFO:teuthology.packaging:tag: None 2023-10-18T19:33:32.409 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:33:32.409 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:33:32.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:33:32.600 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T19:33:32.663 INFO:teuthology.orchestra.run.smithi184.stdout:14.2.22-0.el8 2023-10-18T19:33:32.663 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2023-10-18T19:33:32.664 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2023-10-18T19:33:32.664 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T19:33:32.664 INFO:teuthology.packaging:ref: None 2023-10-18T19:33:32.665 INFO:teuthology.packaging:tag: None 2023-10-18T19:33:32.665 INFO:teuthology.packaging:branch: nautilus 2023-10-18T19:33:32.665 INFO:teuthology.packaging:sha1: b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:33:32.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2023-10-18T19:33:32.852 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T19:33:32.909 INFO:teuthology.orchestra.run.smithi192.stdout:14.2.22-0.el8 2023-10-18T19:33:32.910 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2023-10-18T19:33:32.910 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2023-10-18T19:33:32.910 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T19:33:32.911 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:32.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T19:33:32.987 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:32.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T19:33:33.067 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:33.068 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T19:33:33.140 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T19:33:33.141 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:33.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T19:33:33.213 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T19:33:33.322 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:33.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T19:33:33.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T19:33:33.512 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:33.513 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T19:33:33.587 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T19:33:33.699 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T19:33:33.699 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:33.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T19:33:33.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T19:33:33.879 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:33.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T19:33:33.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T19:33:34.061 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:34.062 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T19:33:34.133 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T19:33:34.243 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T19:33:34.244 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:34.244 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T19:33:34.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T19:33:34.423 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:34.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T19:33:34.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T19:33:34.604 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:34.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T19:33:34.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T19:33:34.784 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:33:34.793 INFO:teuthology.task.print:**** done installing nautilus 2023-10-18T19:33:34.794 INFO:teuthology.run_tasks:Running task ceph... 2023-10-18T19:33:34.876 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-18T19:33:34.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-10-18T19:33:34.881 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-10-18T19:33:34.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-10-18T19:33:34.955 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-18T19:33:34.955 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T19:33:34.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T19:33:34.966 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T19:33:35.035 INFO:tasks.ceph:Creating extra log directories... 2023-10-18T19:33:35.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T19:33:35.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T19:33:35.044 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T19:33:35.126 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-18T19:33:35.127 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-18T19:33:35.127 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429223', 'branch': 'wip-vshankar-testing-pacific-20231016.091648', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7429223', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/nautilus latest\n'}], 'name': 'vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-pacific-20231016.091648'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, 'nuke-on-error': False, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-pacific-20231016.091648', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 7825, 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'sleep_before_teardown': 0, 'subset': '33/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-pacific-20231016.091648', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFt0g5Q4OgUHhB5cw796zIX47qXgr2dQA4m5UOLeC9pcM6mYrb9ZLXQK9NShWjQzb0Un4HGRNRAXe+LA5i6JBmE=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8appbTjUKCc3niUwRRMpz+htaicXI1nGLwB5HQKAOuguEfn1y+POhWxzYdhlId7HM0Ooi4VlYz4Ha1jxgiEbk=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB38AQK1lRoWjNW7OKta5o0Jfgm+A5OQ4tdZZose4MI4JYrSI294B6LfstPTshPpXapNHZO4tQRuOb8ihxF9tnk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'nautilus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'}}, {'print': '**** done installing nautilus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client nautilus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done nautilus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None, 'mon.b': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release pacific', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_12:48:28', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-18T19:33:35.128 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T19:33:35.133 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T19:33:35.138 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T19:33:35.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T19:33:35.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T19:33:35.223 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T19:33:35.295 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:35.295 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T19:33:35.341 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T19:33:35.341 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-10-18T19:33:35.428 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T19:33:35.428 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T19:33:35.428 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-10-18T19:33:35.428 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T19:33:35.429 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T19:33:35.429 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-18 19:33:21.690429651 +0000 2023-10-18T19:33:35.429 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-18 19:30:10.271725449 +0000 2023-10-18T19:33:35.429 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-18 19:30:10.271725449 +0000 2023-10-18T19:33:35.429 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-18 19:30:10.238726106 +0000 2023-10-18T19:33:35.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T19:33:35.496 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-18T19:33:35.497 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-18T19:33:35.497 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000311167 s, 1.6 MB/s 2023-10-18T19:33:35.498 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T19:33:35.547 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-10-18T19:33:35.593 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T19:33:35.593 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T19:33:35.593 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-10-18T19:33:35.593 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T19:33:35.594 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T19:33:35.594 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-18 19:33:21.690429651 +0000 2023-10-18T19:33:35.594 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-18 19:30:11.118708579 +0000 2023-10-18T19:33:35.594 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-18 19:30:11.118708579 +0000 2023-10-18T19:33:35.594 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-18 19:30:11.094709057 +0000 2023-10-18T19:33:35.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T19:33:35.699 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-18T19:33:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-18T19:33:35.700 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000281807 s, 1.8 MB/s 2023-10-18T19:33:35.702 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T19:33:35.750 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-10-18T19:33:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T19:33:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T19:33:35.796 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-10-18T19:33:35.797 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T19:33:35.797 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T19:33:35.797 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-18 19:33:21.690429651 +0000 2023-10-18T19:33:35.797 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-18 19:30:11.956691889 +0000 2023-10-18T19:33:35.797 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-18 19:30:11.956691889 +0000 2023-10-18T19:33:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-18 19:30:11.930692407 +0000 2023-10-18T19:33:35.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T19:33:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-18T19:33:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-18T19:33:35.903 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000310753 s, 1.6 MB/s 2023-10-18T19:33:35.905 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T19:33:35.954 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-10-18T19:33:36.000 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T19:33:36.000 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T19:33:36.000 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-10-18T19:33:36.001 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T19:33:36.001 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-18T19:33:36.001 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-18 19:33:21.690429651 +0000 2023-10-18T19:33:36.001 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-18 19:30:12.804675000 +0000 2023-10-18T19:33:36.001 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-18 19:30:12.804675000 +0000 2023-10-18T19:33:36.002 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-10-18 19:30:12.779675498 +0000 2023-10-18T19:33:36.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T19:33:36.106 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-18T19:33:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-18T19:33:36.107 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000270684 s, 1.9 MB/s 2023-10-18T19:33:36.109 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T19:33:36.157 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T19:33:36.157 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-18T19:33:36.158 INFO:tasks.ceph:Generating config... 2023-10-18T19:33:36.159 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-18T19:33:36.159 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-18T19:33:36.160 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-18T19:33:36.160 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-18T19:33:36.160 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-18T19:33:36.161 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-18T19:33:36.161 INFO:tasks.ceph:[client] debug client = 20 2023-10-18T19:33:36.161 INFO:tasks.ceph:[client] debug ms = 1 2023-10-18T19:33:36.161 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-18T19:33:36.162 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-18T19:33:36.162 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-18T19:33:36.162 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-18T19:33:36.163 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-18T19:33:36.163 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-18T19:33:36.163 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-18T19:33:36.164 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-18T19:33:36.164 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-18T19:33:36.164 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-18T19:33:36.164 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-18T19:33:36.165 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-18T19:33:36.165 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-18T19:33:36.165 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-18T19:33:36.166 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-18T19:33:36.166 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-18T19:33:36.166 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-18T19:33:36.166 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-18T19:33:36.167 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-18T19:33:36.167 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-18T19:33:36.167 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-18T19:33:36.167 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-18T19:33:36.168 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-18T19:33:36.168 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-18T19:33:36.168 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-18T19:33:36.169 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-18T19:33:36.169 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-18T19:33:36.169 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-18T19:33:36.170 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-18T19:33:36.170 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-18T19:33:36.170 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-18T19:33:36.171 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-18T19:33:36.171 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-18T19:33:36.171 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-18T19:33:36.171 INFO:tasks.ceph:Setting up mon.a... 2023-10-18T19:33:36.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-18T19:33:36.482 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-10-18T19:33:36.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-18T19:33:36.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T19:33:36.678 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]'), ('mon.c', '[v2:172.21.15.88:3302,v1:172.21.15.88:6791]')] 2023-10-18T19:33:36.678 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],[v2:172.21.15.88:3302,v1:172.21.15.88:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-18T19:33:36.679 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:36.680 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T19:33:36.726 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --addv b '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]' --addv c '[v2:172.21.15.88:3302,v1:172.21.15.88:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:36.871 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:36.871 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid fe6fac15-13f3-4a33-b6ef-f18d02d18f87 2023-10-18T19:33:36.872 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-10-18T19:33:36.872 INFO:teuthology.orchestra.run.smithi088.stdout:fsid fe6fac15-13f3-4a33-b6ef-f18d02d18f87 2023-10-18T19:33:36.872 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-10-18 19:33:36.870059 2023-10-18T19:33:36.872 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-10-18 19:33:36.870059 2023-10-18T19:33:36.872 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 0 (unknown) 2023-10-18T19:33:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-10-18T19:33:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.b 2023-10-18T19:33:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] mon.c 2023-10-18T19:33:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-18T19:33:36.875 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T19:33:36.920 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fe6fac15-13f3-4a33-b6ef-f18d02d18f87... 2023-10-18T19:33:36.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T19:33:36.926 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T19:33:36.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T19:33:37.039 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-10-18T19:33:37.039 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-10-18T19:33:37.039 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T19:33:37.040 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-10-18T19:33:37.040 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.040 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-10-18T19:33:37.040 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.041 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-10-18T19:33:37.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.041 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-10-18T19:33:37.041 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-10-18T19:33:37.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.042 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-10-18T19:33:37.042 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-10-18T19:33:37.042 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.042 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T19:33:37.042 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-10-18T19:33:37.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.043 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T19:33:37.043 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T19:33:37.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.043 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-10-18T19:33:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-10-18T19:33:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-10-18T19:33:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-10-18T19:33:37.044 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-10-18T19:33:37.045 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-10-18T19:33:37.045 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-10-18T19:33:37.045 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-10-18T19:33:37.045 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T19:33:37.045 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T19:33:37.046 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-10-18T19:33:37.046 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.046 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-18T19:33:37.046 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.046 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-10-18T19:33:37.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.047 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-10-18T19:33:37.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.047 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-10-18T19:33:37.047 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],[v2:172.21.15.88:3302,v1:172.21.15.88:6791]" 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on pool no app = False 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: ms bind msgr2 = False 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore warn on legacy statfs = False 2023-10-18T19:33:37.048 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore warn on no per pool omap = False 2023-10-18T19:33:37.049 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn min per osd = 0 2023-10-18T19:33:37.049 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = fe6fac15-13f3-4a33-b6ef-f18d02d18f87 2023-10-18T19:33:37.049 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.049 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-10-18T19:33:37.049 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-10-18T19:33:37.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.050 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-10-18T19:33:37.050 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-10-18T19:33:37.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.050 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-10-18T19:33:37.051 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-10-18T19:33:37.051 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.051 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-10-18T19:33:37.051 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-10-18T19:33:37.051 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-10-18T19:33:37.052 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.052 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-10-18T19:33:37.052 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-10-18T19:33:37.052 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.052 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-10-18T19:33:37.053 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.053 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-10-18T19:33:37.053 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.053 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-10-18T19:33:37.053 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.054 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-10-18T19:33:37.054 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-10-18T19:33:37.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.054 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-10-18T19:33:37.055 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-10-18T19:33:37.055 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2023-10-18T19:33:37.055 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2023-10-18T19:33:37.055 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2023-10-18T19:33:37.055 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-10-18T19:33:37.056 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-10-18T19:33:37.057 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2023-10-18T19:33:37.057 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2023-10-18T19:33:37.057 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-18T19:33:37.057 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-10-18T19:33:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2023-10-18T19:33:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T19:33:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-10-18T19:33:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-10-18T19:33:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-10-18T19:33:37.059 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-10-18T19:33:37.059 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-10-18T19:33:37.059 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.059 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-10-18T19:33:37.060 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-18T19:33:37.060 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-10-18T19:33:37.060 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-10-18T19:33:37.060 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-10-18T19:33:37.061 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.061 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.061 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-10-18T19:33:37.061 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.061 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-10-18T19:33:37.062 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-18T19:33:37.062 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-10-18T19:33:37.062 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-10-18T19:33:37.062 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-10-18T19:33:37.063 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-10-18T19:33:37.063 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-10-18T19:33:37.063 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.063 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-10-18T19:33:37.064 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-10-18T19:33:37.064 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.064 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.064 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T19:33:37.064 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T19:33:37.065 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T19:33:37.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.065 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T19:33:37.066 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T19:33:37.066 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T19:33:37.066 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-10-18T19:33:37.066 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = False 2023-10-18T19:33:37.067 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:33:37.067 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-10-18T19:33:37.067 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-10-18T19:33:37.068 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-10-18T19:33:37.068 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-10-18T19:33:37.069 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T19:33:37.069 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T19:33:37.069 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-10-18T19:33:37.070 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-10-18T19:33:37.070 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-18T19:33:37.070 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.071 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.071 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-10-18T19:33:37.072 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-10-18T19:33:37.072 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-10-18T19:33:37.072 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-10-18T19:33:37.073 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-10-18T19:33:37.073 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-10-18T19:33:37.073 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-10-18T19:33:37.074 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-10-18T19:33:37.074 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-18T19:33:37.074 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-10-18T19:33:37.075 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-10-18T19:33:37.075 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-10-18T19:33:37.075 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-10-18T19:33:37.076 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-10-18T19:33:37.076 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.076 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.078 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-18T19:33:37.078 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-18T19:33:37.079 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T19:33:37.079 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-18T19:33:37.079 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.080 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-18T19:33:37.080 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.080 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-18T19:33:37.081 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.081 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-18T19:33:37.082 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-18T19:33:37.082 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.082 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-18T19:33:37.083 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-18T19:33:37.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.083 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T19:33:37.084 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-18T19:33:37.084 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.084 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T19:33:37.084 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T19:33:37.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.085 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-18T19:33:37.085 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.086 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-18T19:33:37.086 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-18T19:33:37.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-18T19:33:37.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-18T19:33:37.087 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-18T19:33:37.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-18T19:33:37.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-18T19:33:37.088 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T19:33:37.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T19:33:37.089 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-18T19:33:37.089 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.090 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-18T19:33:37.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.091 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-18T19:33:37.091 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.091 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-18T19:33:37.092 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.092 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-18T19:33:37.092 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-18T19:33:37.093 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-18T19:33:37.093 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],[v2:172.21.15.88:3302,v1:172.21.15.88:6791]" 2023-10-18T19:33:37.093 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on pool no app = False 2023-10-18T19:33:37.094 INFO:teuthology.orchestra.run.smithi184.stdout: ms bind msgr2 = False 2023-10-18T19:33:37.094 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore warn on legacy statfs = False 2023-10-18T19:33:37.095 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore warn on no per pool omap = False 2023-10-18T19:33:37.095 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn min per osd = 0 2023-10-18T19:33:37.095 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = fe6fac15-13f3-4a33-b6ef-f18d02d18f87 2023-10-18T19:33:37.096 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.096 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-18T19:33:37.096 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-18T19:33:37.097 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.097 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-18T19:33:37.097 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-18T19:33:37.098 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.098 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-18T19:33:37.099 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-18T19:33:37.099 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.099 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-18T19:33:37.100 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-18T19:33:37.100 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-18T19:33:37.100 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.101 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-18T19:33:37.101 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-18T19:33:37.101 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.102 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-18T19:33:37.102 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.103 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-18T19:33:37.103 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.103 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-18T19:33:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-18T19:33:37.104 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-18T19:33:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-18T19:33:37.105 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-18T19:33:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: bdev async discard = True 2023-10-18T19:33:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: bdev enable discard = True 2023-10-18T19:33:37.106 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore allocator = bitmap 2023-10-18T19:33:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-18T19:33:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-18T19:33:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 1/20 2023-10-18T19:33:37.107 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 1/20 2023-10-18T19:33:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-18T19:33:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-18T19:33:37.108 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 4/10 2023-10-18T19:33:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T19:33:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-18T19:33:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-18T19:33:37.109 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-10-18T19:33:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-10-18T19:33:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-18T19:33:37.110 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.111 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-18T19:33:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-18T19:33:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-18T19:33:37.111 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-18T19:33:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-18T19:33:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.112 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-18T19:33:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.113 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-18T19:33:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-18T19:33:37.113 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-18T19:33:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-18T19:33:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-18T19:33:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-18T19:33:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-18T19:33:37.114 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-18T19:33:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-18T19:33:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.115 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T19:33:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T19:33:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T19:33:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T19:33:37.116 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T19:33:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T19:33:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-10-18T19:33:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = False 2023-10-18T19:33:37.117 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-18T19:33:37.117 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-18T19:33:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-18T19:33:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-18T19:33:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-18T19:33:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T19:33:37.118 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T19:33:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-10-18T19:33:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-18T19:33:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-18T19:33:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.119 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.120 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-18T19:33:37.120 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-18T19:33:37.120 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-18T19:33:37.121 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-18T19:33:37.121 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-18T19:33:37.121 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-18T19:33:37.122 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-10-18T19:33:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-10-18T19:33:37.122 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-18T19:33:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-10-18T19:33:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-10-18T19:33:37.123 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-10-18T19:33:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-10-18T19:33:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-18T19:33:37.124 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.125 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.125 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-10-18T19:33:37.125 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-10-18T19:33:37.126 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T19:33:37.126 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-10-18T19:33:37.126 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.127 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-10-18T19:33:37.127 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.127 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-10-18T19:33:37.127 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.127 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-10-18T19:33:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-10-18T19:33:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-10-18T19:33:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-10-18T19:33:37.128 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T19:33:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-10-18T19:33:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T19:33:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T19:33:37.130 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.130 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-10-18T19:33:37.130 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.130 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-10-18T19:33:37.131 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-10-18T19:33:37.131 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-10-18T19:33:37.131 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-10-18T19:33:37.131 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-10-18T19:33:37.132 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-10-18T19:33:37.132 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-10-18T19:33:37.132 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T19:33:37.133 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T19:33:37.133 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-10-18T19:33:37.133 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.133 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-10-18T19:33:37.134 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.134 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-10-18T19:33:37.134 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.134 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-10-18T19:33:37.134 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.135 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-10-18T19:33:37.135 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-10-18T19:33:37.135 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-10-18T19:33:37.135 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790],[v2:172.21.15.88:3302,v1:172.21.15.88:6791]" 2023-10-18T19:33:37.135 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on pool no app = False 2023-10-18T19:33:37.136 INFO:teuthology.orchestra.run.smithi192.stdout: ms bind msgr2 = False 2023-10-18T19:33:37.136 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore warn on legacy statfs = False 2023-10-18T19:33:37.136 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore warn on no per pool omap = False 2023-10-18T19:33:37.136 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn min per osd = 0 2023-10-18T19:33:37.136 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = fe6fac15-13f3-4a33-b6ef-f18d02d18f87 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-10-18T19:33:37.137 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-10-18T19:33:37.138 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.138 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-10-18T19:33:37.138 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-10-18T19:33:37.138 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.138 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-10-18T19:33:37.139 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-10-18T19:33:37.139 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-10-18T19:33:37.139 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.139 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-10-18T19:33:37.139 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.140 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-10-18T19:33:37.141 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.141 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-10-18T19:33:37.141 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-10-18T19:33:37.141 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.141 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-10-18T19:33:37.142 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-10-18T19:33:37.142 INFO:teuthology.orchestra.run.smithi192.stdout: bdev async discard = True 2023-10-18T19:33:37.142 INFO:teuthology.orchestra.run.smithi192.stdout: bdev enable discard = True 2023-10-18T19:33:37.142 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore allocator = bitmap 2023-10-18T19:33:37.142 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 1/20 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 1/20 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-10-18T19:33:37.143 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 4/10 2023-10-18T19:33:37.144 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T19:33:37.144 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-10-18T19:33:37.144 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-10-18T19:33:37.144 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-10-18T19:33:37.144 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-10-18T19:33:37.145 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-18T19:33:37.145 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.145 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-10-18T19:33:37.145 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-18T19:33:37.145 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-10-18T19:33:37.146 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.147 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-10-18T19:33:37.147 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-18T19:33:37.147 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-18T19:33:37.147 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-10-18T19:33:37.147 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-18T19:33:37.148 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-10-18T19:33:37.148 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-10-18T19:33:37.148 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-18T19:33:37.148 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-10-18T19:33:37.148 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T19:33:37.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T19:33:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T19:33:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T19:33:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-10-18T19:33:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = False 2023-10-18T19:33:37.151 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-18T19:33:37.151 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-10-18T19:33:37.151 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-10-18T19:33:37.151 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-10-18T19:33:37.151 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-18T19:33:37.152 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.153 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.153 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-10-18T19:33:37.153 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-10-18T19:33:37.153 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-10-18T19:33:37.153 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-18T19:33:37.154 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-10-18T19:33:37.155 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-10-18T19:33:37.155 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-10-18T19:33:37.155 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-10-18T19:33:37.155 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-18T19:33:37.155 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-18T19:33:37.156 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-18T19:33:37.158 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-18T19:33:37.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-18T19:33:37.290 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-18T19:33:37.290 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:37.291 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-18T19:33:37.337 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:37.337 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-18T19:33:37.424 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:33:37.425 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:37.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T19:33:37.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T19:33:37.559 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:37.559 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:37.645 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-10-18T19:33:37.645 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:37.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T19:33:37.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T19:33:37.749 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:37.750 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:37.836 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-10-18T19:33:37.836 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:37.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T19:33:37.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T19:33:37.937 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:37.938 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:38.024 INFO:tasks.ceph:Setting up mon nodes... 2023-10-18T19:33:38.025 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-18T19:33:38.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T19:33:38.167 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T19:33:38.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T19:33:38.315 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T19:33:38.320 INFO:tasks.ceph:Setting up mds nodes... 2023-10-18T19:33:38.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T19:33:38.466 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T19:33:38.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-18T19:33:38.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T19:33:38.692 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T19:33:38.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-18T19:33:38.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T19:33:38.913 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T19:33:38.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-18T19:33:38.988 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-18T19:33:38.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T19:33:39.298 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-18T19:33:39.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-18T19:33:39.961 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-18T19:33:39.996 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-18T19:33:39.996 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-18T19:33:39.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-18T19:33:40.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T19:33:40.073 INFO:tasks.ceph:role: osd.0 2023-10-18T19:33:40.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:33:40.074 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T19:33:40.152 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T19:33:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T19:33:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T19:33:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-18T19:33:40.153 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T19:33:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-18T19:33:40.154 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T19:33:40.154 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T19:33:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T19:33:40.154 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T19:33:40.577 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-18T19:33:40.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-18T19:33:40.583 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-18T19:33:40.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-18T19:33:40.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-18T19:33:40.917 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T19:33:40.917 INFO:tasks.ceph:role: osd.1 2023-10-18T19:33:40.918 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:33:40.918 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T19:33:40.995 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T19:33:40.996 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T19:33:40.996 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T19:33:40.996 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-18T19:33:40.996 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T19:33:40.997 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-18T19:33:40.997 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T19:33:40.997 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T19:33:40.997 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T19:33:40.997 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T19:33:41.404 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-18T19:33:41.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-18T19:33:41.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-18T19:33:41.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-18T19:33:41.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-18T19:33:41.689 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T19:33:41.689 INFO:tasks.ceph:role: osd.2 2023-10-18T19:33:41.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:33:41.690 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T19:33:41.768 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T19:33:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T19:33:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T19:33:41.768 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-18T19:33:41.768 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T19:33:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-18T19:33:41.769 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T19:33:41.769 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T19:33:41.769 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T19:33:41.770 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T19:33:42.202 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-18T19:33:42.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-18T19:33:42.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-18T19:33:42.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-18T19:33:42.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-18T19:33:42.534 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T19:33:42.535 INFO:tasks.ceph:role: osd.3 2023-10-18T19:33:42.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:33:42.535 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T19:33:42.611 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T19:33:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T19:33:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T19:33:42.612 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-18T19:33:42.613 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T19:33:42.613 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-18T19:33:42.613 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T19:33:42.614 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T19:33:42.614 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T19:33:42.615 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T19:33:43.043 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-18T19:33:43.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-18T19:33:43.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-18T19:33:43.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-18T19:33:43.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:43.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.385 7fc337a70dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-18T19:33:43.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.385 7fc337a70dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-18T19:33:43.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.385 7fc337a70dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T19:33:43.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.385 7fc337a70dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T19:33:43.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.385 7fc337a70dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T19:33:43.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:43.387 7fc337a70dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-18T19:33:46.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T19:33:46.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.434 7fb483ff1dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-18T19:33:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.435 7fb483ff1dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-18T19:33:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.435 7fb483ff1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T19:33:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.435 7fb483ff1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T19:33:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.435 7fb483ff1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T19:33:46.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:46.436 7fb483ff1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-18T19:33:49.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T19:33:49.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.480 7f45e124fdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-18T19:33:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.480 7f45e124fdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-18T19:33:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.480 7f45e124fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T19:33:49.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.480 7f45e124fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T19:33:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.480 7f45e124fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T19:33:49.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:49.482 7f45e124fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-18T19:33:52.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T19:33:52.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.540 7f66c9750dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-18T19:33:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.540 7f66c9750dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-18T19:33:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.540 7f66c9750dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T19:33:52.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.540 7f66c9750dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T19:33:52.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.540 7f66c9750dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T19:33:52.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:52.542 7f66c9750dc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-18T19:33:55.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T19:33:55.463 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-18T19:33:55.463 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-18T19:33:55.535 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-18T19:33:55.644 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-18T19:33:55.752 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.753 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-18T19:33:55.861 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-18T19:33:55.970 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:55.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-18T19:33:56.079 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:56.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-18T19:33:56.188 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:56.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-18T19:33:56.297 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:56.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-18T19:33:56.406 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-18T19:33:56.407 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-18T19:33:56.462 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-18T19:33:56.463 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-18T19:33:56.515 INFO:tasks.ceph:Adding keys to all mons... 2023-10-18T19:33:56.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T19:33:56.582 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-10-18T19:33:56.582 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQASMzBl/SzpCRAAz8c9ZUJ6DAgIVCGvFHN1pw== 2023-10-18T19:33:56.583 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-10-18T19:33:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQASMzBl6Lm3EhAAEiftd9SAdz7AImUENEKteg== 2023-10-18T19:33:56.583 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-10-18T19:33:56.583 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQASMzBlrxqyGxAAq0JMwW4AQt7IhTr8W3fJqQ== 2023-10-18T19:33:56.583 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-10-18T19:33:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQASMzBlxyk7KRAAdxtvqQMkGUcd0aP4XsmI2g== 2023-10-18T19:33:56.584 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-10-18T19:33:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQASMzBlFupdNhAA/xKVXHt60FJQA9kpIEB/Ag== 2023-10-18T19:33:56.584 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-10-18T19:33:56.584 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAXMzBl25kHFxAAx2MZHS1zYKH3BMiMwzJbZQ== 2023-10-18T19:33:56.585 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-10-18T19:33:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAaMzBlG/P9GRAAaOkBKknwPuzo/VCPcs0Rmw== 2023-10-18T19:33:56.585 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-10-18T19:33:56.585 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAdMzBlvfWzHBAA/fzesRF5JPIDQ8UdI8OG6g== 2023-10-18T19:33:56.585 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-10-18T19:33:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAgMzBlR9tFIBAAShb29uN9Rl1Qg+HxaeW0NQ== 2023-10-18T19:33:56.586 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-10-18T19:33:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQATMzBl81TAERAAsyS//78PvcKLhBpCGnUKnA== 2023-10-18T19:33:56.586 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-10-18T19:33:56.586 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQATMzBlm1RAORAA4/JBxPF5vODrswOUW6gHxg== 2023-10-18T19:33:56.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T19:33:56.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T19:33:56.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T19:33:57.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T19:33:57.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T19:33:57.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T19:33:57.399 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T19:33:57.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T19:33:57.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T19:33:57.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T19:33:57.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T19:33:58.040 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-18T19:33:58.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-18T19:33:58.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T19:33:58.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-18T19:33:58.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-18T19:33:58.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T19:33:58.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-18T19:33:58.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-18T19:33:58.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T19:33:58.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-18T19:33:58.887 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T19:33:58.941 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-18T19:33:58.942 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-18T19:33:58.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-18T19:33:58.992 INFO:tasks.ceph.mon.a:Started 2023-10-18T19:33:58.992 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-18T19:33:58.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-18T19:33:58.998 INFO:tasks.ceph.mon.b:Started 2023-10-18T19:33:58.999 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-18T19:33:58.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-18T19:33:59.004 INFO:tasks.ceph.mon.c:Started 2023-10-18T19:33:59.005 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-18T19:33:59.005 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-18T19:33:59.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-18T19:33:59.012 INFO:tasks.ceph.mgr.x:Started 2023-10-18T19:33:59.013 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-18T19:33:59.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-18T19:33:59.019 INFO:tasks.ceph.mgr.y:Started 2023-10-18T19:33:59.020 INFO:tasks.ceph:Setting crush tunables to default 2023-10-18T19:33:59.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-10-18T19:33:59.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.281 7f790579d700 1 Processor -- start 2023-10-18T19:33:59.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.281 7f790579d700 1 -- start start 2023-10-18T19:33:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.281 7f790579d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.281 7f790579d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 0x7f79001b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f790579d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7900115ee0 con 0x7f79000f1e90 2023-10-18T19:33:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f790579d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79001b5700 con 0x7f79000f1a40 2023-10-18T19:33:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f790579d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79001150d0 con 0x7f7900115a90 2023-10-18T19:33:59.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48832/0 (socket says 172.21.15.88:48832) 2023-10-18T19:33:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 -- 172.21.15.88:0/4170312598 learned_addr learned my addr 172.21.15.88:0/4170312598 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:33:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78fe3fd700 1 --2- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 0x7f79001b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 msgr2=0x7f79000f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-18T19:33:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 msgr2=0x7f79000f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T19:33:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T19:33:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78febfe700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T19:33:59.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78fe3fd700 1 -- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 msgr2=0x7f79001b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T19:33:59.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78fe3fd700 1 -- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 msgr2=0x7f79001b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T19:33:59.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78fe3fd700 1 --2- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 0x7f79001b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-18T19:33:59.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.282 7f78fe3fd700 1 --2- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 0x7f79001b48d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-18T19:33:59.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72673058 0 0) 0x7f78f8001490 con 0x7f79000f1e90 2023-10-18T19:33:59.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e4003270 con 0x7f79000f1e90 2023-10-18T19:33:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948325979 0 0) 0x7f78f8001960 con 0x7f79000f1e90 2023-10-18T19:33:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 msgr2=0x7f79000f1410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T19:33:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7900115a90 0x7f79000f1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 msgr2=0x7f79001b48d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T19:33:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.473 7f78fdbfc700 1 --2- 172.21.15.88:0/4170312598 >> v2:172.21.15.88:3300/0 conn(0x7f79000f1a40 0x7f79001b48d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790010f900 con 0x7f79000f1e90 2023-10-18T19:33:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2321079530 0 0) 0x7f78f8001ec0 con 0x7f79000f1e90 2023-10-18T19:33:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 >> v1:172.21.15.88:6789/0 conn(0x7f79000f1e90 legacy=0x7f79001b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:33:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78e40038f0 0x7f78e4003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78e40045d0 0x7f78e4004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e4009810 0x7f78e400bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79001b5700 con 0x7f78e4009810 2023-10-18T19:33:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79001150d0 con 0x7f78e40045d0 2023-10-18T19:33:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e400c2f0 con 0x7f78e40038f0 2023-10-18T19:33:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78fe3fd700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78e40045d0 0x7f78e4004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.474 7f78ff3ff700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e4009810 0x7f78e400bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78febfe700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78e40038f0 0x7f78e4003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78e40038f0 msgr2=0x7f78e4003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:33:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78e40038f0 0x7f78e4003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78e40045d0 msgr2=0x7f78e4004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:33:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78e40045d0 0x7f78e4004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 -- 172.21.15.88:0/4170312598 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e400c520 con 0x7f78e4009810 2023-10-18T19:33:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.475 7f78ff3ff700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e4009810 0x7f78e400bc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f78e40055a0 tx=0x7f78f8007c90).ready entity=mon.0 client_cookie=5af8c273976af572 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:33:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78e400c520 con 0x7f78e4009810 2023-10-18T19:33:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f80069a0 con 0x7f78e4009810 2023-10-18T19:33:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f78fdbfc700 1 -- 172.21.15.88:0/4170312598 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78f8006d70 con 0x7f78e4009810 2023-10-18T19:33:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f790579d700 1 -- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e4009810 msgr2=0x7f78e400bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:33:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f790579d700 1 --2- 172.21.15.88:0/4170312598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78e4009810 0x7f78e400bc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f78e40055a0 tx=0x7f78f8007c90).stop 2023-10-18T19:33:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.476 7f78ff3ff700 1 -- 172.21.15.88:0/4170312598 reap_dead start 2023-10-18T19:33:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.477 7f790579d700 1 -- 172.21.15.88:0/4170312598 shutdown_connections 2023-10-18T19:33:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.477 7f790579d700 1 -- 172.21.15.88:0/4170312598 >> 172.21.15.88:0/4170312598 conn(0x7f79001172c0 msgr2=0x7f79000f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:33:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.477 7f790579d700 1 -- 172.21.15.88:0/4170312598 shutdown_connections 2023-10-18T19:33:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.477 7f790579d700 1 -- 172.21.15.88:0/4170312598 wait complete. 2023-10-18T19:33:59.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.502 7f790579d700 1 Processor -- start 2023-10-18T19:33:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.502 7f790579d700 1 -- start start 2023-10-18T19:33:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f79000d2210 0x7f79001c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79001c6660 0x7f79001b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:33:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000d1400 con 0x7f79001c6660 2023-10-18T19:33:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000e05e0 con 0x7f79000de0c0 2023-10-18T19:33:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f790579d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79000d1740 con 0x7f79000d2210 2023-10-18T19:33:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44402/0 (socket says 172.21.15.88:44402) 2023-10-18T19:33:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 -- 172.21.15.88:0/2097144121 learned_addr learned my addr 172.21.15.88:0/2097144121 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:33:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78ff3ff700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79001c6660 0x7f79001b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78fe3fd700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f79000d2210 0x7f79001c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:33:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 -- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f79000d2210 msgr2=0x7f79001c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:33:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f79000d2210 0x7f79001c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 -- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79001c6660 msgr2=0x7f79001b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:33:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.503 7f78febfe700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79001c6660 0x7f79001b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78febfe700 1 -- 172.21.15.88:0/2097144121 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000deaf0 con 0x7f79000de0c0 2023-10-18T19:33:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78febfe700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f79000d12b0 tx=0x7f78f000f930).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:33:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f79000deaf0 con 0x7f79000de0c0 2023-10-18T19:33:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0013610 con 0x7f79000de0c0 2023-10-18T19:33:59.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f790579d700 1 -- 172.21.15.88:0/2097144121 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79001c6ab0 con 0x7f79000de0c0 2023-10-18T19:33:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f78f00139e0 con 0x7f79000de0c0 2023-10-18T19:33:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f790579d700 1 -- 172.21.15.88:0/2097144121 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79001b6230 con 0x7f79000de0c0 2023-10-18T19:33:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.504 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f78f0023060 con 0x7f79000de0c0 2023-10-18T19:33:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.505 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f78f001c770 con 0x7f79000de0c0 2023-10-18T19:33:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.505 7f790579d700 1 -- 172.21.15.88:0/2097144121 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79000f0460 con 0x7f79000de0c0 2023-10-18T19:33:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.508 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f78f0013400 con 0x7f79000de0c0 2023-10-18T19:33:59.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.578 7f790579d700 1 -- 172.21.15.88:0/2097144121 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f79000a5ea0 con 0x7f79000de0c0 2023-10-18T19:33:59.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.584 7f78effff700 1 -- 172.21.15.88:0/2097144121 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f78f0000c30 con 0x7f79000de0c0 2023-10-18T19:33:59.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 -- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 msgr2=0x7f79000d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:33:59.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f79000d12b0 tx=0x7f78f000f930).stop 2023-10-18T19:33:59.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 -- 172.21.15.88:0/2097144121 shutdown_connections 2023-10-18T19:33:59.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79001c6660 0x7f79001b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79000de0c0 0x7f79000d1be0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 --2- 172.21.15.88:0/2097144121 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f79000d2210 0x7f79001c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:33:59.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.585 7f790579d700 1 -- 172.21.15.88:0/2097144121 >> 172.21.15.88:0/2097144121 conn(0x7f79001210f0 msgr2=0x7f79000d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:33:59.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.586 7f790579d700 1 -- 172.21.15.88:0/2097144121 shutdown_connections 2023-10-18T19:33:59.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:33:59.586 7f790579d700 1 -- 172.21.15.88:0/2097144121 wait complete. 2023-10-18T19:33:59.590 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-10-18T19:33:59.604 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-18T19:33:59.605 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:59.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-18T19:33:59.676 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:59.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-18T19:33:59.787 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:59.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-18T19:33:59.900 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:33:59.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-18T19:34:00.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 8dd014e9-edff-49f4-a64e-a9a08eb5bbf2 0 2023-10-18T19:34:00.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.249 7f435f19d700 1 Processor -- start 2023-10-18T19:34:00.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 -- start start 2023-10-18T19:34:00.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 0x7f43581b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 0x7f43581bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4358115ee0 con 0x7f4358115a90 2023-10-18T19:34:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435810f460 con 0x7f43580f1c10 2023-10-18T19:34:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.250 7f435f19d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43581150d0 con 0x7f43581ba290 2023-10-18T19:34:00.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f435c9fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4358115a90 0x7f43580f1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42348/0 (socket says 172.21.15.88:42348) 2023-10-18T19:34:00.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f435c9fe700 1 -- 172.21.15.88:0/269350038 learned_addr learned my addr 172.21.15.88:0/269350038 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:00.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f4357fff700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 0x7f43581b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f435d1ff700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 0x7f43581bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f4357fff700 1 -- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 msgr2=0x7f43581bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f4357fff700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 0x7f43581bc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f4357fff700 1 -- 172.21.15.88:0/269350038 >> v1:172.21.15.88:6789/0 conn(0x7f4358115a90 legacy=0x7f43580f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f4357fff700 1 -- 172.21.15.88:0/269350038 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435810f900 con 0x7f43580f1c10 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.251 7f435d1ff700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 0x7f43581bc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f4357fff700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 0x7f43581b9c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4344002f70 tx=0x7f434400ba20).ready entity=mon.1 client_cookie=b443c8384b0f8fee server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f43577fe700 1 -- 172.21.15.88:0/269350038 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f434400d570 con 0x7f43580f1c10 2023-10-18T19:34:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f43577fe700 1 -- 172.21.15.88:0/269350038 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400d770 con 0x7f43580f1c10 2023-10-18T19:34:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f43577fe700 1 -- 172.21.15.88:0/269350038 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f434400db40 con 0x7f43580f1c10 2023-10-18T19:34:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f435f19d700 1 -- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 msgr2=0x7f43581b9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.252 7f435f19d700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 0x7f43581b9c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4344002f70 tx=0x7f434400ba20).stop 2023-10-18T19:34:00.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 -- 172.21.15.88:0/269350038 shutdown_connections 2023-10-18T19:34:00.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581ba290 0x7f43581bc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 --2- 172.21.15.88:0/269350038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580f1c10 0x7f43581b9c60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 -- 172.21.15.88:0/269350038 >> 172.21.15.88:0/269350038 conn(0x7f43581172c0 msgr2=0x7f43580f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 -- 172.21.15.88:0/269350038 shutdown_connections 2023-10-18T19:34:00.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.253 7f435f19d700 1 -- 172.21.15.88:0/269350038 wait complete. 2023-10-18T19:34:00.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 Processor -- start 2023-10-18T19:34:00.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 -- start start 2023-10-18T19:34:00.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 0x7f43581c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43581c6560 0x7f43580d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 0x7f43580d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43580bd650 con 0x7f43581c6560 2023-10-18T19:34:00.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580de3e0 con 0x7f43580c7460 2023-10-18T19:34:00.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.297 7f435f19d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43580e08e0 con 0x7f43581c69b0 2023-10-18T19:34:00.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f435d1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 0x7f43580d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f435d1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 0x7f43580d50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48950/0 (socket says 172.21.15.88:48950) 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f435d1ff700 1 -- 172.21.15.88:0/3581487193 learned_addr learned my addr 172.21.15.88:0/3581487193 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f435c9fe700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 0x7f43581c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f4357fff700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43581c6560 0x7f43580d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.298 7f435c9fe700 1 -- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 msgr2=0x7f43580d50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435c9fe700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 0x7f43580d50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435c9fe700 1 -- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43581c6560 msgr2=0x7f43580d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435c9fe700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43581c6560 0x7f43580d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435c9fe700 1 -- 172.21.15.88:0/3581487193 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580bdf40 con 0x7f43580c7460 2023-10-18T19:34:00.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435c9fe700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 0x7f43581c5f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f43580e10d0 tx=0x7f434c00c840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43580bdf40 con 0x7f43580c7460 2023-10-18T19:34:00.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c0070d0 con 0x7f43580c7460 2023-10-18T19:34:00.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f434c005620 con 0x7f43580c7460 2023-10-18T19:34:00.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435f19d700 1 -- 172.21.15.88:0/3581487193 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43580de900 con 0x7f43580c7460 2023-10-18T19:34:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f435f19d700 1 -- 172.21.15.88:0/3581487193 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43580c78b0 con 0x7f43580c7460 2023-10-18T19:34:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.299 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f434c005820 con 0x7f43580c7460 2023-10-18T19:34:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.300 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f434c0137c0 con 0x7f43580c7460 2023-10-18T19:34:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.300 7f435f19d700 1 -- 172.21.15.88:0/3581487193 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43580f0460 con 0x7f43580c7460 2023-10-18T19:34:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.303 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f434c00cdd0 con 0x7f43580c7460 2023-10-18T19:34:00.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.379 7f435f19d700 1 -- 172.21.15.88:0/3581487193 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8dd014e9-edff-49f4-a64e-a9a08eb5bbf2", "id": 0} v 0) v1 -- 0x7f43580de650 con 0x7f43580c7460 2023-10-18T19:34:00.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.385 7f4355ffb700 1 -- 172.21.15.88:0/3581487193 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dd014e9-edff-49f4-a64e-a9a08eb5bbf2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f434c000c30 con 0x7f43580c7460 2023-10-18T19:34:00.388 INFO:teuthology.orchestra.run.smithi088.stdout:0 2023-10-18T19:34:00.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 -- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 msgr2=0x7f43581c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 0x7f43581c5f30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f43580e10d0 tx=0x7f434c00c840).stop 2023-10-18T19:34:00.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 -- 172.21.15.88:0/3581487193 shutdown_connections 2023-10-18T19:34:00.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43581c69b0 0x7f43580d50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43580c7460 0x7f43581c5f30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 --2- 172.21.15.88:0/3581487193 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43581c6560 0x7f43580d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 -- 172.21.15.88:0/3581487193 >> 172.21.15.88:0/3581487193 conn(0x7f43580cb0b0 msgr2=0x7f43580ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 -- 172.21.15.88:0/3581487193 shutdown_connections 2023-10-18T19:34:00.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.386 7f435f19d700 1 -- 172.21.15.88:0/3581487193 wait complete. 2023-10-18T19:34:00.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new b8c2b64b-e04e-435d-8eba-9cdc531cfd37 1 2023-10-18T19:34:00.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.612 7fe6f359e700 1 Processor -- start 2023-10-18T19:34:00.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.612 7fe6f359e700 1 -- start start 2023-10-18T19:34:00.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.613 7fe6f359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6f40f1c10 0x7fe6f41b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.613 7fe6f359e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f41ba570 0x7fe6f41bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.613 7fe6f359e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f410f850 con 0x7fe6f4115890 2023-10-18T19:34:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.613 7fe6f359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f410f030 con 0x7fe6f40f1c10 2023-10-18T19:34:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.613 7fe6f359e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41153f0 con 0x7fe6f41ba570 2023-10-18T19:34:00.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6f0dfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe6f4115890 0x7fe6f40f1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42354/0 (socket says 172.21.15.88:42354) 2023-10-18T19:34:00.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6f0dfe700 1 -- 172.21.15.88:0/3881473381 learned_addr learned my addr 172.21.15.88:0/3881473381 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:00.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6ebfff700 1 --2- 172.21.15.88:0/3881473381 >> v2:172.21.15.88:3300/0 conn(0x7fe6f40f1c10 0x7fe6f41b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6f15ff700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f41ba570 0x7fe6f41bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6eb7fe700 1 -- 172.21.15.88:0/3881473381 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890922837 0 0) 0x7fe6e4001110 con 0x7fe6f4115890 2023-10-18T19:34:00.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6eb7fe700 1 -- 172.21.15.88:0/3881473381 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d4003270 con 0x7fe6f4115890 2023-10-18T19:34:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6ebfff700 1 -- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f41ba570 msgr2=0x7fe6f41bc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6ebfff700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f41ba570 0x7fe6f41bc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6ebfff700 1 -- 172.21.15.88:0/3881473381 >> v1:172.21.15.88:6789/0 conn(0x7fe6f4115890 legacy=0x7fe6f40f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.614 7fe6ebfff700 1 -- 172.21.15.88:0/3881473381 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f41160f0 con 0x7fe6f40f1c10 2023-10-18T19:34:00.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6ebfff700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40f1c10 0x7fe6f41b9f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe6f4114e00 tx=0x7fe6dc00ba20).ready entity=mon.0 client_cookie=55ebb0e7f1a939cb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6eb7fe700 1 -- 172.21.15.88:0/3881473381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6f41160f0 con 0x7fe6f40f1c10 2023-10-18T19:34:00.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6eb7fe700 1 -- 172.21.15.88:0/3881473381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00d5c0 con 0x7fe6f40f1c10 2023-10-18T19:34:00.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6eb7fe700 1 -- 172.21.15.88:0/3881473381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6dc00d990 con 0x7fe6f40f1c10 2023-10-18T19:34:00.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6f359e700 1 -- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40f1c10 msgr2=0x7fe6f41b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.615 7fe6f359e700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40f1c10 0x7fe6f41b9f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fe6f4114e00 tx=0x7fe6dc00ba20).stop 2023-10-18T19:34:00.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 -- 172.21.15.88:0/3881473381 shutdown_connections 2023-10-18T19:34:00.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f41ba570 0x7fe6f41bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 --2- 172.21.15.88:0/3881473381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40f1c10 0x7fe6f41b9f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 -- 172.21.15.88:0/3881473381 >> 172.21.15.88:0/3881473381 conn(0x7fe6f41172c0 msgr2=0x7fe6f40f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:00.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 -- 172.21.15.88:0/3881473381 shutdown_connections 2023-10-18T19:34:00.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.616 7fe6f359e700 1 -- 172.21.15.88:0/3881473381 wait complete. 2023-10-18T19:34:00.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.641 7fe6f359e700 1 Processor -- start 2023-10-18T19:34:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.641 7fe6f359e700 1 -- start start 2023-10-18T19:34:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40d1cd0 0x7fe6f40d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f40d2750 0x7fe6f41c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41b7e80 con 0x7fe6f40d1cd0 2023-10-18T19:34:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f41b8130 con 0x7fe6f41b8430 2023-10-18T19:34:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f359e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40b25b0 con 0x7fe6f40d2750 2023-10-18T19:34:00.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44444/0 (socket says 172.21.15.88:44444) 2023-10-18T19:34:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 -- 172.21.15.88:0/2953077771 learned_addr learned my addr 172.21.15.88:0/2953077771 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6ebfff700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40d1cd0 0x7fe6f40d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f15ff700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f40d2750 0x7fe6f41c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 -- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f40d2750 msgr2=0x7fe6f41c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f40d2750 0x7fe6f41c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 -- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40d1cd0 msgr2=0x7fe6f40d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40d1cd0 0x7fe6f40d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.642 7fe6f0dfe700 1 -- 172.21.15.88:0/2953077771 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f41b89e0 con 0x7fe6f41b8430 2023-10-18T19:34:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6f0dfe700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe6e4000ed0 tx=0x7fe6e400c7b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6f41b89e0 con 0x7fe6f41b8430 2023-10-18T19:34:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e40072e0 con 0x7fe6f41b8430 2023-10-18T19:34:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f41c5cb0 con 0x7fe6f41b8430 2023-10-18T19:34:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe6e4005810 con 0x7fe6f41b8430 2023-10-18T19:34:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f41c61e0 con 0x7fe6f41b8430 2023-10-18T19:34:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.643 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe6e4005a10 con 0x7fe6f41b8430 2023-10-18T19:34:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.644 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 857+0+0 (secure 0 0 0) 0x7fe6e4013820 con 0x7fe6f41b8430 2023-10-18T19:34:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.644 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f40f0460 con 0x7fe6f41b8430 2023-10-18T19:34:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.647 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fe6e40070d0 con 0x7fe6f41b8430 2023-10-18T19:34:00.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.722 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8c2b64b-e04e-435d-8eba-9cdc531cfd37", "id": 1} v 0) v1 -- 0x7fe6f40e64f0 con 0x7fe6f41b8430 2023-10-18T19:34:00.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.728 7fe6e9ffb700 1 -- 172.21.15.88:0/2953077771 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8c2b64b-e04e-435d-8eba-9cdc531cfd37", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6f4114ab0 con 0x7fe6f41b8430 2023-10-18T19:34:00.731 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-10-18T19:34:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 msgr2=0x7fe6f40b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe6e4000ed0 tx=0x7fe6e400c7b0).stop 2023-10-18T19:34:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 shutdown_connections 2023-10-18T19:34:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe6f40d2750 0x7fe6f41c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe6f41b8430 0x7fe6f40b1f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 --2- 172.21.15.88:0/2953077771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6f40d1cd0 0x7fe6f40d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 >> 172.21.15.88:0/2953077771 conn(0x7fe6f40d6100 msgr2=0x7fe6f40adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 shutdown_connections 2023-10-18T19:34:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.729 7fe6f359e700 1 -- 172.21.15.88:0/2953077771 wait complete. 2023-10-18T19:34:00.748 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 4527909d-9edd-46d9-abdd-6ab5a4da9e5b 2 2023-10-18T19:34:00.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.946 7fe4e45ff700 1 Processor -- start 2023-10-18T19:34:00.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.946 7fe4e45ff700 1 -- start start 2023-10-18T19:34:00.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e45ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0f1b70 0x7fe4dc0f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e45ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4dc0f25f0 0x7fe4dc1ba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e45ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc0ab340 con 0x7fe4dc10d350 2023-10-18T19:34:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e45ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a8de0 con 0x7fe4dc0f25f0 2023-10-18T19:34:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e45ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1125d0 con 0x7fe4dc0f1b70 2023-10-18T19:34:00.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e0bfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4dc10d350 0x7fe4dc0f6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42358/0 (socket says 172.21.15.88:42358) 2023-10-18T19:34:00.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.947 7fe4e0bfe700 1 -- 172.21.15.88:0/502231846 learned_addr learned my addr 172.21.15.88:0/502231846 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:00.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4dbfff700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0f1b70 0x7fe4dc0f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800795148 0 0) 0x7fe4d0001110 con 0x7fe4dc10d350 2023-10-18T19:34:00.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c0003270 con 0x7fe4dc10d350 2023-10-18T19:34:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4e13ff700 1 --2- 172.21.15.88:0/502231846 >> v2:172.21.15.88:3300/0 conn(0x7fe4dc0f25f0 0x7fe4dc1ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191154997 0 0) 0x7fe4d00015e0 con 0x7fe4dc10d350 2023-10-18T19:34:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0f1b70 msgr2=0x7fe4dc0f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0f1b70 0x7fe4dc0f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 >> v2:172.21.15.88:3300/0 conn(0x7fe4dc0f25f0 msgr2=0x7fe4dc1ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 --2- 172.21.15.88:0/502231846 >> v2:172.21.15.88:3300/0 conn(0x7fe4dc0f25f0 0x7fe4dc1ba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0f2a40 con 0x7fe4dc10d350 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 2321079530 0 0) 0x7fe4d0001b40 con 0x7fe4dc10d350 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 >> v1:172.21.15.88:6789/0 conn(0x7fe4dc10d350 legacy=0x7fe4dc0f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4c0003920 0x7fe4c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c00045d0 0x7fe4c0004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4c0009810 0x7fe4c000bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0a8de0 con 0x7fe4c00045d0 2023-10-18T19:34:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1125d0 con 0x7fe4c0003920 2023-10-18T19:34:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.948 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c000c430 con 0x7fe4c0009810 2023-10-18T19:34:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4c0003920 0x7fe4c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4dbfff700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c00045d0 0x7fe4c0004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e13ff700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4c0009810 0x7fe4c000bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 -- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4c0009810 msgr2=0x7fe4c000bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4c0009810 0x7fe4c000bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 -- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c00045d0 msgr2=0x7fe4c0004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:00.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4c00045d0 0x7fe4c0004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.949 7fe4e0bfe700 1 -- 172.21.15.88:0/502231846 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0f2a40 con 0x7fe4c0003920 2023-10-18T19:34:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4e0bfe700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4c0003920 0x7fe4c0003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe4d0001e40 tx=0x7fe4d00079d0).ready entity=mon.1 client_cookie=e28791af5ac06415 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4dc0f2a40 con 0x7fe4c0003920 2023-10-18T19:34:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00070d0 con 0x7fe4c0003920 2023-10-18T19:34:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4db7fe700 1 -- 172.21.15.88:0/502231846 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4d00074a0 con 0x7fe4c0003920 2023-10-18T19:34:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4e45ff700 1 -- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4c0003920 msgr2=0x7fe4c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4e45ff700 1 --2- 172.21.15.88:0/502231846 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4c0003920 0x7fe4c0003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe4d0001e40 tx=0x7fe4d00079d0).stop 2023-10-18T19:34:00.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.950 7fe4e13ff700 1 -- 172.21.15.88:0/502231846 reap_dead start 2023-10-18T19:34:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.951 7fe4e45ff700 1 -- 172.21.15.88:0/502231846 shutdown_connections 2023-10-18T19:34:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.951 7fe4e45ff700 1 -- 172.21.15.88:0/502231846 >> 172.21.15.88:0/502231846 conn(0x7fe4dc117a20 msgr2=0x7fe4dc0f33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.951 7fe4e45ff700 1 -- 172.21.15.88:0/502231846 shutdown_connections 2023-10-18T19:34:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.951 7fe4e45ff700 1 -- 172.21.15.88:0/502231846 wait complete. 2023-10-18T19:34:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.976 7fe4e45ff700 1 Processor -- start 2023-10-18T19:34:00.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.976 7fe4e45ff700 1 -- start start 2023-10-18T19:34:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0b6ad0 0x7fe4dc0b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4dc1c4190 0x7fe4dc1c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0d0470 con 0x7fe4dc1c4190 2023-10-18T19:34:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0b6f20 con 0x7fe4dc0b6ad0 2023-10-18T19:34:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e45ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0d24b0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.977 7fe4e0bfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48992/0 (socket says 172.21.15.88:48992) 2023-10-18T19:34:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 -- 172.21.15.88:0/504576626 learned_addr learned my addr 172.21.15.88:0/504576626 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e13ff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4dc1c4190 0x7fe4dc1c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4dbfff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0b6ad0 0x7fe4dc0b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 -- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0b6ad0 msgr2=0x7fe4dc0b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0b6ad0 0x7fe4dc0b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 -- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4dc1c4190 msgr2=0x7fe4dc1c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4dc1c4190 0x7fe4dc1c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 -- 172.21.15.88:0/504576626 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0d00b0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.978 7fe4e0bfe700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe4dc0e0fc0 tx=0x7fe4d00076a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4dc0d00b0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00077c0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe4d001b070 con 0x7fe4dc0b6680 2023-10-18T19:34:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc0d0a00 con 0x7fe4dc0b6680 2023-10-18T19:34:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc0d6570 con 0x7fe4dc0b6680 2023-10-18T19:34:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe4d00047e0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.979 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 960+0+0 (secure 0 0 0) 0x7fe4d0025060 con 0x7fe4dc0b6680 2023-10-18T19:34:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.980 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc0f0bc0 con 0x7fe4dc0b6680 2023-10-18T19:34:00.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:00.983 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fe4d00070d0 con 0x7fe4dc0b6680 2023-10-18T19:34:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.060 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd new", "uuid": "4527909d-9edd-46d9-abdd-6ab5a4da9e5b", "id": 2} v 0) v1 -- 0x7fe4dc0a6020 con 0x7fe4dc0b6680 2023-10-18T19:34:01.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.064 7fe4d9ffb700 1 -- 172.21.15.88:0/504576626 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4527909d-9edd-46d9-abdd-6ab5a4da9e5b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4c0003610 con 0x7fe4dc0b6680 2023-10-18T19:34:01.067 INFO:teuthology.orchestra.run.smithi088.stdout:2 2023-10-18T19:34:01.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 msgr2=0x7fe4dc0b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe4dc0e0fc0 tx=0x7fe4d00076a0).stop 2023-10-18T19:34:01.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 shutdown_connections 2023-10-18T19:34:01.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4dc1c4190 0x7fe4dc1c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe4dc0b6680 0x7fe4dc0b7560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 --2- 172.21.15.88:0/504576626 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe4dc0b6ad0 0x7fe4dc0b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 >> 172.21.15.88:0/504576626 conn(0x7fe4dc0d6ad0 msgr2=0x7fe4dc0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:01.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 shutdown_connections 2023-10-18T19:34:01.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.066 7fe4e45ff700 1 -- 172.21.15.88:0/504576626 wait complete. 2023-10-18T19:34:01.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 60440fa3-794f-4b22-b0e6-76801bcaf0c5 3 2023-10-18T19:34:01.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.282 7fb0ae79d700 1 Processor -- start 2023-10-18T19:34:01.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.282 7fb0ae79d700 1 -- start start 2023-10-18T19:34:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0ae79d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0ae79d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a81b9e70 0x7fb0a81bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0ae79d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80f83f0 con 0x7fb0a80f0b80 2023-10-18T19:34:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0ae79d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a810f010 con 0x7fb0a810eaa0 2023-10-18T19:34:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0ae79d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80f2030 con 0x7fb0a81b9e70 2023-10-18T19:34:01.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.283 7fb0a77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52846/0 (socket says 172.21.15.88:52846) 2023-10-18T19:34:01.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 -- 172.21.15.88:0/1292738449 learned_addr learned my addr 172.21.15.88:0/1292738449 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:01.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a6ffd700 1 --1- 172.21.15.88:0/1292738449 >> v1:172.21.15.88:6789/0 conn(0x7fb0a80f0b80 0x7fb0a80f0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42360/0 (socket says 172.21.15.88:42360) 2023-10-18T19:34:01.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a7fff700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a81b9e70 0x7fb0a81bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 -- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a81b9e70 msgr2=0x7fb0a81bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:01.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a81b9e70 0x7fb0a81bc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 -- 172.21.15.88:0/1292738449 >> v1:172.21.15.88:6789/0 conn(0x7fb0a80f0b80 legacy=0x7fb0a80f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a67fc700 1 -- 172.21.15.88:0/1292738449 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418954513 0 0) 0x7fb09c001110 con 0x7fb0a80f0b80 2023-10-18T19:34:01.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 -- 172.21.15.88:0/1292738449 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80f34b0 con 0x7fb0a810eaa0 2023-10-18T19:34:01.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.284 7fb0a77fe700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb0a810f1c0 tx=0x7fb098009a80).ready entity=mon.0 client_cookie=d42fc86ac9621a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:01.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.285 7fb0a67fc700 1 -- 172.21.15.88:0/1292738449 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0a80f34b0 con 0x7fb0a810eaa0 2023-10-18T19:34:01.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.285 7fb0a67fc700 1 -- 172.21.15.88:0/1292738449 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800f510 con 0x7fb0a810eaa0 2023-10-18T19:34:01.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.285 7fb0a67fc700 1 -- 172.21.15.88:0/1292738449 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb09800f6f0 con 0x7fb0a810eaa0 2023-10-18T19:34:01.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.285 7fb0ae79d700 1 -- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a810eaa0 msgr2=0x7fb0a80f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.285 7fb0ae79d700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb0a810f1c0 tx=0x7fb098009a80).stop 2023-10-18T19:34:01.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 -- 172.21.15.88:0/1292738449 shutdown_connections 2023-10-18T19:34:01.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a81b9e70 0x7fb0a81bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 --2- 172.21.15.88:0/1292738449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a810eaa0 0x7fb0a80f7dc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 -- 172.21.15.88:0/1292738449 >> 172.21.15.88:0/1292738449 conn(0x7fb0a8125a10 msgr2=0x7fb0a8125e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:01.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 -- 172.21.15.88:0/1292738449 shutdown_connections 2023-10-18T19:34:01.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.286 7fb0ae79d700 1 -- 172.21.15.88:0/1292738449 wait complete. 2023-10-18T19:34:01.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.311 7fb0ae79d700 1 Processor -- start 2023-10-18T19:34:01.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.311 7fb0ae79d700 1 -- start start 2023-10-18T19:34:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 0x7fb0a80dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a80d5730 0x7fb0a80db7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80dee50 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80df180 con 0x7fb0a80e0bb0 2023-10-18T19:34:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0ae79d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80df830 con 0x7fb0a80d5730 2023-10-18T19:34:01.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0a6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0a77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 0x7fb0a80dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0a6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52850/0 (socket says 172.21.15.88:52850) 2023-10-18T19:34:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0a6ffd700 1 -- 172.21.15.88:0/4254842154 learned_addr learned my addr 172.21.15.88:0/4254842154 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.312 7fb0a7fff700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a80d5730 0x7fb0a80db7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 -- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a80d5730 msgr2=0x7fb0a80db7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a80d5730 0x7fb0a80db7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 -- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 msgr2=0x7fb0a80dfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 0x7fb0a80dfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 -- 172.21.15.88:0/4254842154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80e0300 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a6ffd700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb0a80e0750 tx=0x7fb09c00c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a77fe700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 0x7fb0a80dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb0a80e0300 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0072e0 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80dbdf0 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb09c005750 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.313 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80dc340 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.314 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb09c005950 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.314 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1063+0+0 (secure 0 0 0) 0x7fb09c012850 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.315 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80f0460 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.318 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fb09c0070d0 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.393 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "60440fa3-794f-4b22-b0e6-76801bcaf0c5", "id": 3} v 0) v1 -- 0x7fb0a80e2e50 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.396 7fb0a4ff9700 1 -- 172.21.15.88:0/4254842154 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60440fa3-794f-4b22-b0e6-76801bcaf0c5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb09c000c30 con 0x7fb0a80d4cb0 2023-10-18T19:34:01.400 INFO:teuthology.orchestra.run.smithi088.stdout:3 2023-10-18T19:34:01.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 msgr2=0x7fb0a80d5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb0a80e0750 tx=0x7fb09c00c890).stop 2023-10-18T19:34:01.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 shutdown_connections 2023-10-18T19:34:01.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0a80d5730 0x7fb0a80db7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0a80e0bb0 0x7fb0a80dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 --2- 172.21.15.88:0/4254842154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0a80d4cb0 0x7fb0a80d5100 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 >> 172.21.15.88:0/4254842154 conn(0x7fb0a80b5ae0 msgr2=0x7fb0a80b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:01.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 shutdown_connections 2023-10-18T19:34:01.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.398 7fb0ae79d700 1 -- 172.21.15.88:0/4254842154 wait complete. 2023-10-18T19:34:01.418 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T19:34:01.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-18T19:34:01.423 INFO:tasks.ceph.osd.0:Started 2023-10-18T19:34:01.424 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-18T19:34:01.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-18T19:34:01.429 INFO:tasks.ceph.osd.1:Started 2023-10-18T19:34:01.429 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-18T19:34:01.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-18T19:34:01.435 INFO:tasks.ceph.osd.2:Started 2023-10-18T19:34:01.436 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-18T19:34:01.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-18T19:34:01.442 INFO:tasks.ceph.osd.3:Started 2023-10-18T19:34:01.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:01.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.765 7feba31ff700 1 Processor -- start 2023-10-18T19:34:01.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.765 7feba31ff700 1 -- start start 2023-10-18T19:34:01.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.766 7feba31ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 0x7feb9c10fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.766 7feba31ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 0x7feb9c1b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.766 7feba31ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0ab280 con 0x7feb9c1b9240 2023-10-18T19:34:01.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.766 7feba31ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0f2520 con 0x7feb9c0fa9f0 2023-10-18T19:34:01.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.766 7feba31ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0f2860 con 0x7feb9c110520 2023-10-18T19:34:01.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 0x7feb9c1b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9bbff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feb9c1b9240 0x7feb9c1c00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42394/0 (socket says 172.21.15.88:42394) 2023-10-18T19:34:01.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9bbff700 1 -- 172.21.15.88:0/1334615992 learned_addr learned my addr 172.21.15.88:0/1334615992 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:01.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9b3fe700 1 --2- 172.21.15.88:0/1334615992 >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 0x7feb9c10fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 -- 172.21.15.88:0/1334615992 >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 msgr2=0x7feb9c10fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:01.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 --2- 172.21.15.88:0/1334615992 >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 0x7feb9c10fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 -- 172.21.15.88:0/1334615992 >> v1:172.21.15.88:6789/0 conn(0x7feb9c1b9240 legacy=0x7feb9c1c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 -- 172.21.15.88:0/1334615992 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c124fa0 con 0x7feb9c110520 2023-10-18T19:34:01.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9b3fe700 1 --2- 172.21.15.88:0/1334615992 >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 0x7feb9c10fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:34:01.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.767 7feb9abfd700 1 --2- 172.21.15.88:0/1334615992 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 0x7feb9c1b8c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feb90002f70 tx=0x7feb9000b970).ready entity=mon.2 client_cookie=d4a483e72710c061 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.768 7feb9a3fc700 1 -- 172.21.15.88:0/1334615992 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb9c124fa0 con 0x7feb9c110520 2023-10-18T19:34:01.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.768 7feb9a3fc700 1 -- 172.21.15.88:0/1334615992 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000d5c0 con 0x7feb9c110520 2023-10-18T19:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.768 7feb9a3fc700 1 -- 172.21.15.88:0/1334615992 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb9000d990 con 0x7feb9c110520 2023-10-18T19:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.768 7feba31ff700 1 -- 172.21.15.88:0/1334615992 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 msgr2=0x7feb9c1b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.768 7feba31ff700 1 --2- 172.21.15.88:0/1334615992 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 0x7feb9c1b8c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7feb90002f70 tx=0x7feb9000b970).stop 2023-10-18T19:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 -- 172.21.15.88:0/1334615992 shutdown_connections 2023-10-18T19:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 --2- 172.21.15.88:0/1334615992 >> v2:172.21.15.88:3300/0 conn(0x7feb9c0fa9f0 0x7feb9c10fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 --2- 172.21.15.88:0/1334615992 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c110520 0x7feb9c1b8c10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 -- 172.21.15.88:0/1334615992 >> 172.21.15.88:0/1334615992 conn(0x7feb9c127ee0 msgr2=0x7feb9c128330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 -- 172.21.15.88:0/1334615992 shutdown_connections 2023-10-18T19:34:01.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.769 7feba31ff700 1 -- 172.21.15.88:0/1334615992 wait complete. 2023-10-18T19:34:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.794 7feba31ff700 1 Processor -- start 2023-10-18T19:34:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.794 7feba31ff700 1 -- start start 2023-10-18T19:34:01.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 0x7feb9c1ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb9c1cae50 0x7feb9c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:01.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0b5200 con 0x7feb9c1cae50 2023-10-18T19:34:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0b5540 con 0x7feb9c0b4780 2023-10-18T19:34:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feba31ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0d17f0 con 0x7feb9c1caa00 2023-10-18T19:34:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feb9abfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feb9abfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49036/0 (socket says 172.21.15.88:49036) 2023-10-18T19:34:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feb9abfd700 1 -- 172.21.15.88:0/757131091 learned_addr learned my addr 172.21.15.88:0/757131091 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feb9b3fe700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 0x7feb9c1ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.795 7feb9bbff700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb9c1cae50 0x7feb9c0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 -- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 msgr2=0x7feb9c1ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 0x7feb9c1ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 -- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb9c1cae50 msgr2=0x7feb9c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb9c1cae50 0x7feb9c0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 -- 172.21.15.88:0/757131091 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0cf7d0 con 0x7feb9c1caa00 2023-10-18T19:34:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9b3fe700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 0x7feb9c1ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:34:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb9abfd700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7feb9c1b6b70 tx=0x7feb900068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb9c0cf7d0 con 0x7feb9c1caa00 2023-10-18T19:34:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90011980 con 0x7feb9c1caa00 2023-10-18T19:34:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feba31ff700 1 -- 172.21.15.88:0/757131091 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0b4bd0 con 0x7feb9c1caa00 2023-10-18T19:34:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feb90017040 con 0x7feb9c1caa00 2023-10-18T19:34:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.796 7feba31ff700 1 -- 172.21.15.88:0/757131091 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0d1b10 con 0x7feb9c1caa00 2023-10-18T19:34:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.797 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7feb9001e460 con 0x7feb9c1caa00 2023-10-18T19:34:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.797 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7feb90018070 con 0x7feb9c1caa00 2023-10-18T19:34:01.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.797 7feba31ff700 1 -- 172.21.15.88:0/757131091 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c0b6630 con 0x7feb9c1caa00 2023-10-18T19:34:01.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.802 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7feb90011770 con 0x7feb9c1caa00 2023-10-18T19:34:01.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.876 7feba31ff700 1 -- 172.21.15.88:0/757131091 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb9c0e2250 con 0x7feb9c1caa00 2023-10-18T19:34:01.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.877 7feb98bf9700 1 -- 172.21.15.88:0/757131091 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3247 (secure 0 0 0) 0x7feb9000d3b0 con 0x7feb9c1caa00 2023-10-18T19:34:01.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:01.880 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":6,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:01.395047","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:01.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 -- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 msgr2=0x7feb9c0d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:01.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7feb9c1b6b70 tx=0x7feb900068c0).stop 2023-10-18T19:34:01.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 -- 172.21.15.88:0/757131091 shutdown_connections 2023-10-18T19:34:01.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb9c1cae50 0x7feb9c0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb9c0b4780 0x7feb9c1ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 --2- 172.21.15.88:0/757131091 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb9c1caa00 0x7feb9c0d06d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:01.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 -- 172.21.15.88:0/757131091 >> 172.21.15.88:0/757131091 conn(0x7feb9c0bddc0 msgr2=0x7feb9c0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:01.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 -- 172.21.15.88:0/757131091 shutdown_connections 2023-10-18T19:34:01.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:01.879 7feba31ff700 1 -- 172.21.15.88:0/757131091 wait complete. 2023-10-18T19:34:01.907 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-18T19:34:01.908 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-18T19:34:02.250 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18 19:34:02.248 7f5dccae1dc0 -1 Falling back to public interface 2023-10-18T19:34:02.279 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18 19:34:02.277 7f87eb860dc0 -1 Falling back to public interface 2023-10-18T19:34:02.280 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18 19:34:02.278 7f947bd68dc0 -1 Falling back to public interface 2023-10-18T19:34:02.285 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18 19:34:02.282 7f1dcec45dc0 -1 Falling back to public interface 2023-10-18T19:34:02.311 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:02.489 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.486 7f15b1dff700 1 Processor -- start 2023-10-18T19:34:02.489 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.486 7f15b1dff700 1 -- start start 2023-10-18T19:34:02.491 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15ac0f6620 0x7f15ac1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.491 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac1037e0 0x7f15ac1b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.491 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 0x7f15ac1b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.492 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac1117c0 con 0x7f15ac0f6620 2023-10-18T19:34:02.492 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac104080 con 0x7f15ac103c30 2023-10-18T19:34:02.492 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15b1dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac1160d0 con 0x7f15ac1037e0 2023-10-18T19:34:02.492 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15a9ffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15ac0f6620 0x7f15ac1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.492 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15a97fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac1037e0 0x7f15ac1b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.493 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15a9ffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15ac0f6620 0x7f15ac1031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52938/0 (socket says 172.21.15.88:52938) 2023-10-18T19:34:02.493 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15a9ffe700 1 -- 172.21.15.88:0/2605461497 learned_addr learned my addr 172.21.15.88:0/2605461497 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:02.493 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.487 7f15aa7ff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 0x7f15ac1b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.493 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 -- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac1037e0 msgr2=0x7f15ac1b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:02.493 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac1037e0 0x7f15ac1b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 -- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 msgr2=0x7f15ac1b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 0x7f15ac1b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 -- 172.21.15.88:0/2605461497 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac10c3e0 con 0x7f15ac0f6620 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15aa7ff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 0x7f15ac1b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a9ffe700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac0f6620 0x7f15ac1031b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f15ac116510 tx=0x7f159c00cb60).ready entity=mon.0 client_cookie=2b037f56b92cc1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:02.494 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a8ffc700 1 -- 172.21.15.88:0/2605461497 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15ac10c3e0 con 0x7f15ac0f6620 2023-10-18T19:34:02.495 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a8ffc700 1 -- 172.21.15.88:0/2605461497 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00b9e0 con 0x7f15ac0f6620 2023-10-18T19:34:02.495 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15a8ffc700 1 -- 172.21.15.88:0/2605461497 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f159c014070 con 0x7f15ac0f6620 2023-10-18T19:34:02.495 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15b1dff700 1 -- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac0f6620 msgr2=0x7f15ac1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:02.495 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.488 7f15b1dff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac0f6620 0x7f15ac1031b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f15ac116510 tx=0x7f159c00cb60).stop 2023-10-18T19:34:02.496 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 -- 172.21.15.88:0/2605461497 shutdown_connections 2023-10-18T19:34:02.496 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac103c30 0x7f15ac1b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.496 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac0f6620 0x7f15ac1031b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.497 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 --2- 172.21.15.88:0/2605461497 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac1037e0 0x7f15ac1b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.497 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 -- 172.21.15.88:0/2605461497 >> 172.21.15.88:0/2605461497 conn(0x7f15ac117390 msgr2=0x7f15ac0f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:02.497 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 -- 172.21.15.88:0/2605461497 shutdown_connections 2023-10-18T19:34:02.497 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.489 7f15b1dff700 1 -- 172.21.15.88:0/2605461497 wait complete. 2023-10-18T19:34:02.519 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.513 7f15b1dff700 1 Processor -- start 2023-10-18T19:34:02.519 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 -- start start 2023-10-18T19:34:02.519 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.519 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 0x7f15ac0b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.520 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 0x7f15ac1c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:02.520 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0d93c0 con 0x7f15ac1c2050 2023-10-18T19:34:02.520 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b8c60 con 0x7f15ac0ddb10 2023-10-18T19:34:02.520 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15b1dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0d8990 con 0x7f15ac0dd6c0 2023-10-18T19:34:02.520 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15a9ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.521 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15aa7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 0x7f15ac1c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.521 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15a9ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49080/0 (socket says 172.21.15.88:49080) 2023-10-18T19:34:02.521 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.514 7f15a9ffe700 1 -- 172.21.15.88:0/706445011 learned_addr learned my addr 172.21.15.88:0/706445011 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:02.521 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15a97fd700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 0x7f15ac0b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:02.522 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 -- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 msgr2=0x7f15ac0b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:02.522 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.522 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 -- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 msgr2=0x7f15ac0b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:02.522 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 0x7f15ac0b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.522 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 -- 172.21.15.88:0/706445011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0d85d0 con 0x7f15ac1c2050 2023-10-18T19:34:02.523 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15a9ffe700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:02.523 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15a97fd700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 0x7f15ac0b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:02.523 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15aa7ff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 0x7f15ac1c24a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f15ac0b8a80 tx=0x7f15a400ed50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:02.523 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15ac0d85d0 con 0x7f15ac1c2050 2023-10-18T19:34:02.524 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400c7b0 con 0x7f15ac1c2050 2023-10-18T19:34:02.524 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f15b1dff700 1 -- 172.21.15.88:0/706445011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0bd540 con 0x7f15ac1c2050 2023-10-18T19:34:02.524 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.515 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f15a400f040 con 0x7f15ac1c2050 2023-10-18T19:34:02.524 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.516 7f15b1dff700 1 -- 172.21.15.88:0/706445011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0b9fe0 con 0x7f15ac1c2050 2023-10-18T19:34:02.524 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.516 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 2) v1 ==== 11227+0+0 (secure 0 0 0) 0x7f15a4011070 con 0x7f15ac1c2050 2023-10-18T19:34:02.525 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.516 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7f15a4010040 con 0x7f15ac1c2050 2023-10-18T19:34:02.525 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.517 7f15b1dff700 1 -- 172.21.15.88:0/706445011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0f0530 con 0x7f15ac1c2050 2023-10-18T19:34:02.525 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.519 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f15a400c5a0 con 0x7f15ac1c2050 2023-10-18T19:34:02.602 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.599 7f15b1dff700 1 -- 172.21.15.88:0/706445011 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15ac10c3c0 con 0x7f15ac1c2050 2023-10-18T19:34:02.602 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.600 7f159affd700 1 -- 172.21.15.88:0/706445011 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3247 (secure 0 0 0) 0x7f15ac0ffc70 con 0x7f15ac1c2050 2023-10-18T19:34:02.603 INFO:teuthology.misc.health.smithi088.stdout: 2023-10-18T19:34:02.603 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":6,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:01.395047","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:02.604 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 -- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 msgr2=0x7f15ac1c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:02.604 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 0x7f15ac1c24a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f15ac0b8a80 tx=0x7f15a400ed50).stop 2023-10-18T19:34:02.605 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 -- 172.21.15.88:0/706445011 shutdown_connections 2023-10-18T19:34:02.605 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15ac1c2050 0x7f15ac1c24a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.605 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15ac0dd6c0 0x7f15ac0b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.606 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 --2- 172.21.15.88:0/706445011 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15ac0ddb10 0x7f15ac0b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:02.606 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 -- 172.21.15.88:0/706445011 >> 172.21.15.88:0/706445011 conn(0x7f15ac0b60b0 msgr2=0x7f15ac0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:02.606 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 -- 172.21.15.88:0/706445011 shutdown_connections 2023-10-18T19:34:02.606 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:02.602 7f15b1dff700 1 -- 172.21.15.88:0/706445011 wait complete. 2023-10-18T19:34:02.619 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-18T19:34:03.574 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18 19:34:03.571 7f5dccae1dc0 -1 osd.0 0 log_to_monitors {default=true} 2023-10-18T19:34:03.622 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18 19:34:03.619 7f87eb860dc0 -1 osd.3 0 log_to_monitors {default=true} 2023-10-18T19:34:03.623 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18 19:34:03.621 7f947bd68dc0 -1 osd.2 0 log_to_monitors {default=true} 2023-10-18T19:34:03.629 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18 19:34:03.626 7f1dcec45dc0 -1 osd.1 0 log_to_monitors {default=true} 2023-10-18T19:34:05.491 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18 19:34:05.488 7f87cabfc700 -1 osd.3 0 waiting for initial osdmap 2023-10-18T19:34:05.494 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18 19:34:05.491 7f945affc700 -1 osd.2 0 waiting for initial osdmap 2023-10-18T19:34:05.495 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18 19:34:05.491 7f5dabdfc700 -1 osd.0 0 waiting for initial osdmap 2023-10-18T19:34:05.495 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18 19:34:05.492 7f1dadffc700 -1 osd.1 0 waiting for initial osdmap 2023-10-18T19:34:05.502 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18 19:34:05.500 7f87d87fc700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:34:05.503 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18 19:34:05.501 7f1dbbbfc700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:34:05.504 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18 19:34:05.501 7f9468bfc700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:34:05.504 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18 19:34:05.501 7f5db99fc700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:34:09.023 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:09.210 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.207 7fc6cb1ff700 1 Processor -- start 2023-10-18T19:34:09.210 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.207 7fc6cb1ff700 1 -- start start 2023-10-18T19:34:09.212 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.213 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6c40f6c40 0x7fc6c40f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.213 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.213 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c41120a0 con 0x7fc6c40f6c40 2023-10-18T19:34:09.213 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c410cf80 con 0x7fc6c40f67f0 2023-10-18T19:34:09.214 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6cb1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c410d860 con 0x7fc6c41b28f0 2023-10-18T19:34:09.214 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c2bfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6c40f6c40 0x7fc6c40f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.214 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c3bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.214 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.214 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c2bfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6c40f6c40 0x7fc6c40f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37562/0 (socket says 172.21.15.88:37562) 2023-10-18T19:34:09.215 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c3bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38340/0 (socket says 172.21.15.88:38340) 2023-10-18T19:34:09.215 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c2bfd700 1 -- 172.21.15.88:0/1395946191 learned_addr learned my addr 172.21.15.88:0/1395946191 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:09.215 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.208 7fc6c33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:37240/0 (socket says 172.21.15.88:37240) 2023-10-18T19:34:09.215 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 -- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 msgr2=0x7fc6c41b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:09.215 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.216 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 -- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 msgr2=0x7fc6c40f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:09.216 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.216 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 -- 172.21.15.88:0/1395946191 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40f2350 con 0x7fc6c40f6c40 2023-10-18T19:34:09.216 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c3bff700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:09.216 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c33fe700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c2bfd700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c40f6c40 0x7fc6c40f1d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc6b8002f70 tx=0x7fc6b8009a50).ready entity=mon.0 client_cookie=b95cd7bc173e5bab server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c23fc700 1 -- 172.21.15.88:0/1395946191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6c40f2350 con 0x7fc6c40f6c40 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c23fc700 1 -- 172.21.15.88:0/1395946191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800f510 con 0x7fc6c40f6c40 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6c23fc700 1 -- 172.21.15.88:0/1395946191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6b800f6f0 con 0x7fc6c40f6c40 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6cb1ff700 1 -- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c40f6c40 msgr2=0x7fc6c40f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.217 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.209 7fc6cb1ff700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c40f6c40 0x7fc6c40f1d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc6b8002f70 tx=0x7fc6b8009a50).stop 2023-10-18T19:34:09.218 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 -- 172.21.15.88:0/1395946191 shutdown_connections 2023-10-18T19:34:09.218 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c41b28f0 0x7fc6c41b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.218 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c40f67f0 0x7fc6c40f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.218 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 --2- 172.21.15.88:0/1395946191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c40f6c40 0x7fc6c40f1d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.218 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 -- 172.21.15.88:0/1395946191 >> 172.21.15.88:0/1395946191 conn(0x7fc6c41175a0 msgr2=0x7fc6c40f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:09.219 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 -- 172.21.15.88:0/1395946191 shutdown_connections 2023-10-18T19:34:09.219 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.210 7fc6cb1ff700 1 -- 172.21.15.88:0/1395946191 wait complete. 2023-10-18T19:34:09.237 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.234 7fc6cb1ff700 1 Processor -- start 2023-10-18T19:34:09.237 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 -- start start 2023-10-18T19:34:09.244 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.245 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 0x7fc6c4115090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.245 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c40e0420 0x7fc6c41156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.246 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41160e0 con 0x7fc6c4116e30 2023-10-18T19:34:09.246 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40e0870 con 0x7fc6c41169e0 2023-10-18T19:34:09.246 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6cb1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41c38c0 con 0x7fc6c40e0420 2023-10-18T19:34:09.247 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.235 7fc6c33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.247 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:37250/0 (socket says 172.21.15.88:37250) 2023-10-18T19:34:09.247 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 -- 172.21.15.88:0/323557991 learned_addr learned my addr 172.21.15.88:0/323557991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:09.248 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c2bfd700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 0x7fc6c4115090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.248 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c3bff700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c40e0420 0x7fc6c41156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.248 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 -- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c40e0420 msgr2=0x7fc6c41156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.249 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c40e0420 0x7fc6c41156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.249 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 -- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 msgr2=0x7fc6c4115090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.249 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 0x7fc6c4115090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.250 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 -- 172.21.15.88:0/323557991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40ceac0 con 0x7fc6c41169e0 2023-10-18T19:34:09.250 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c2bfd700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 0x7fc6c4115090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:09.251 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c33fe700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc6c40acc20 tx=0x7fc6b400ed30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:09.251 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6c40ceac0 con 0x7fc6c41169e0 2023-10-18T19:34:09.251 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b400c940 con 0x7fc6c41169e0 2023-10-18T19:34:09.252 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.236 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4115cf0 con 0x7fc6c41169e0 2023-10-18T19:34:09.252 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.237 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc6b400f040 con 0x7fc6c41169e0 2023-10-18T19:34:09.252 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.237 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40ceff0 con 0x7fc6c41169e0 2023-10-18T19:34:09.253 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.237 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc6b4011070 con 0x7fc6c41169e0 2023-10-18T19:34:09.253 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.238 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2054+0+0 (secure 0 0 0) 0x7fc6b4010040 con 0x7fc6c41169e0 2023-10-18T19:34:09.254 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.238 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c40f0740 con 0x7fc6c41169e0 2023-10-18T19:34:09.254 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.242 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc6b400c540 con 0x7fc6c41169e0 2023-10-18T19:34:09.341 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.338 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c41c6e90 con 0x7fc6c41169e0 2023-10-18T19:34:09.342 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.339 7fc6c0bf9700 1 -- 172.21.15.88:0/323557991 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4567 (secure 0 0 0) 0x7fc6b4000c30 con 0x7fc6c41169e0 2023-10-18T19:34:09.342 INFO:teuthology.misc.health.smithi088.stdout: 2023-10-18T19:34:09.342 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":9,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:06.488799","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:09.344 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.340 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 >> v1:172.21.15.88:6800/107321 conn(0x7fc6a401c1b0 legacy=0x7fc6a401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.344 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.340 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 msgr2=0x7fc6c40dfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.344 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.340 7fc6cb1ff700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc6c40acc20 tx=0x7fc6b400ed30).stop 2023-10-18T19:34:09.344 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 shutdown_connections 2023-10-18T19:34:09.344 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc6c40e0420 0x7fc6c41156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.345 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6c41169e0 0x7fc6c40dfdf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.345 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 --2- 172.21.15.88:0/323557991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4116e30 0x7fc6c4115090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.345 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 >> 172.21.15.88:0/323557991 conn(0x7fc6c40aba30 msgr2=0x7fc6c40bb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:09.345 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 shutdown_connections 2023-10-18T19:34:09.345 INFO:teuthology.misc.health.smithi088.stderr:2023-10-18 19:34:09.341 7fc6cb1ff700 1 -- 172.21.15.88:0/323557991 wait complete. 2023-10-18T19:34:09.357 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-18T19:34:09.357 INFO:tasks.ceph:Creating RBD pool 2023-10-18T19:34:09.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-18T19:34:09.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.552 7f93793ff700 1 Processor -- start 2023-10-18T19:34:09.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.552 7f93793ff700 1 -- start start 2023-10-18T19:34:09.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.553 7f93793ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93741108b0 0x7f93741be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.553 7f93793ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93741be7f0 0x7f93741c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.553 7f93793ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740abc70 con 0x7f9374114910 2023-10-18T19:34:09.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.553 7f93793ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93741216f0 con 0x7f93741108b0 2023-10-18T19:34:09.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.553 7f93793ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9374111650 con 0x7f93741be7f0 2023-10-18T19:34:09.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93741108b0 0x7f93741be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f93717fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9374114910 0x7f93741100b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55804/0 (socket says 172.21.15.88:55804) 2023-10-18T19:34:09.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f93717fe700 1 -- 172.21.15.88:0/3532576529 learned_addr learned my addr 172.21.15.88:0/3532576529 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:09.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f9371fff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93741be7f0 0x7f93741c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 -- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93741be7f0 msgr2=0x7f93741c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:09.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93741be7f0 0x7f93741c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 -- 172.21.15.88:0/3532576529 >> v1:172.21.15.88:6789/0 conn(0x7f9374114910 legacy=0x7f93741100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 -- 172.21.15.88:0/3532576529 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93741226d0 con 0x7f93741108b0 2023-10-18T19:34:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f9370ffd700 1 -- 172.21.15.88:0/3532576529 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057983100 0 0) 0x7f9364001110 con 0x7f9374114910 2023-10-18T19:34:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f936bfff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93741108b0 0x7f93741be1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f935c002f70 tx=0x7f935c00b9f0).ready entity=mon.0 client_cookie=6378089f2d1d893c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f9370ffd700 1 -- 172.21.15.88:0/3532576529 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93741226d0 con 0x7f93741108b0 2023-10-18T19:34:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f9370ffd700 1 -- 172.21.15.88:0/3532576529 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00d5c0 con 0x7f93741108b0 2023-10-18T19:34:09.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f9370ffd700 1 -- 172.21.15.88:0/3532576529 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f935c00d990 con 0x7f93741108b0 2023-10-18T19:34:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f93793ff700 1 -- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93741108b0 msgr2=0x7f93741be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.554 7f93793ff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93741108b0 0x7f93741be1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f935c002f70 tx=0x7f935c00b9f0).stop 2023-10-18T19:34:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 -- 172.21.15.88:0/3532576529 shutdown_connections 2023-10-18T19:34:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93741be7f0 0x7f93741c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 --2- 172.21.15.88:0/3532576529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93741108b0 0x7f93741be1c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 -- 172.21.15.88:0/3532576529 >> 172.21.15.88:0/3532576529 conn(0x7f93741176d0 msgr2=0x7f93740f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 -- 172.21.15.88:0/3532576529 shutdown_connections 2023-10-18T19:34:09.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.555 7f93793ff700 1 -- 172.21.15.88:0/3532576529 wait complete. 2023-10-18T19:34:09.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.580 7f93793ff700 1 Processor -- start 2023-10-18T19:34:09.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.580 7f93793ff700 1 -- start start 2023-10-18T19:34:09.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93740e0090 0x7f93740e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 0x7f93741ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740d5ca0 con 0x7f93740e0090 2023-10-18T19:34:09.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937410f5e0 con 0x7f93740e0b10 2023-10-18T19:34:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93793ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f937410ecb0 con 0x7f93740d1ef0 2023-10-18T19:34:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93717fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f9371fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 0x7f93741ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93717fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38364/0 (socket says 172.21.15.88:38364) 2023-10-18T19:34:09.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f93717fe700 1 -- 172.21.15.88:0/3818491989 learned_addr learned my addr 172.21.15.88:0/3818491989 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:09.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.581 7f936bfff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93740e0090 0x7f93740e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:09.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 -- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 msgr2=0x7f93741ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 0x7f93741ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 -- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93740e0090 msgr2=0x7f93740e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:09.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93740e0090 0x7f93740e04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:09.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 -- 172.21.15.88:0/3818491989 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937410efb0 con 0x7f93740d1ef0 2023-10-18T19:34:09.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f9371fff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 0x7f93741ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:09.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93717fe700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9364000bc0 tx=0x7f936400c7b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:09.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f937410efb0 con 0x7f93740d1ef0 2023-10-18T19:34:09.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93640072e0 con 0x7f93740d1ef0 2023-10-18T19:34:09.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93793ff700 1 -- 172.21.15.88:0/3818491989 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93741cac00 con 0x7f93740d1ef0 2023-10-18T19:34:09.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9364005810 con 0x7f93740d1ef0 2023-10-18T19:34:09.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.582 7f93793ff700 1 -- 172.21.15.88:0/3818491989 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93741cb180 con 0x7f93740d1ef0 2023-10-18T19:34:09.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.583 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9364005a10 con 0x7f93740d1ef0 2023-10-18T19:34:09.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.583 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2054+0+0 (secure 0 0 0) 0x7f9364028c20 con 0x7f93740d1ef0 2023-10-18T19:34:09.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.583 7f93793ff700 1 -- 172.21.15.88:0/3818491989 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93740f0870 con 0x7f93740d1ef0 2023-10-18T19:34:09.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.587 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f93640070d0 con 0x7f93740d1ef0 2023-10-18T19:34:09.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:09.683 7f93793ff700 1 -- 172.21.15.88:0/3818491989 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f93741cb870 con 0x7f93740d1ef0 2023-10-18T19:34:10.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.520 7f936a7fc700 1 -- 172.21.15.88:0/3818491989 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9364000c30 con 0x7f93740d1ef0 2023-10-18T19:34:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.522 7f93793ff700 1 -- 172.21.15.88:0/3818491989 >> v1:172.21.15.88:6800/107321 conn(0x7f935801c1b0 legacy=0x7f935801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.522 7f93793ff700 1 -- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 msgr2=0x7f937410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.522 7f93793ff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9364000bc0 tx=0x7f936400c7b0).stop 2023-10-18T19:34:10.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 -- 172.21.15.88:0/3818491989 shutdown_connections 2023-10-18T19:34:10.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93740e0b10 0x7f93741ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93740d1ef0 0x7f937410e3e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 --2- 172.21.15.88:0/3818491989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93740e0090 0x7f93740e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 -- 172.21.15.88:0/3818491989 >> 172.21.15.88:0/3818491989 conn(0x7f93740d7960 msgr2=0x7f93740d3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 -- 172.21.15.88:0/3818491989 shutdown_connections 2023-10-18T19:34:10.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.523 7f93793ff700 1 -- 172.21.15.88:0/3818491989 wait complete. 2023-10-18T19:34:10.529 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2023-10-18T19:34:10.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-18T19:34:10.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.743 7fdb395ff700 1 Processor -- start 2023-10-18T19:34:10.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.743 7fdb395ff700 1 -- start start 2023-10-18T19:34:10.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb395ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 0x7fdb340f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:10.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb395ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb340f22a0 0x7fdb341b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:10.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb395ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb340abc70 con 0x7fdb3410d000 2023-10-18T19:34:10.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb395ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb34112280 con 0x7fdb340f22a0 2023-10-18T19:34:10.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb395ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340f26f0 con 0x7fdb340f1820 2023-10-18T19:34:10.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb317fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb3410d000 0x7fdb340f6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55820/0 (socket says 172.21.15.88:55820) 2023-10-18T19:34:10.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb317fe700 1 -- 172.21.15.88:0/1228871071 learned_addr learned my addr 172.21.15.88:0/1228871071 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:10.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb30ffd700 1 --2- 172.21.15.88:0/1228871071 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 0x7fdb340f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb31fff700 1 --2- 172.21.15.88:0/1228871071 >> v2:172.21.15.88:3300/0 conn(0x7fdb340f22a0 0x7fdb341b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb23fff700 1 -- 172.21.15.88:0/1228871071 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193799219 0 0) 0x7fdb24001110 con 0x7fdb3410d000 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb23fff700 1 -- 172.21.15.88:0/1228871071 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb18003270 con 0x7fdb3410d000 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb30ffd700 1 -- 172.21.15.88:0/1228871071 >> v2:172.21.15.88:3300/0 conn(0x7fdb340f22a0 msgr2=0x7fdb341b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb30ffd700 1 --2- 172.21.15.88:0/1228871071 >> v2:172.21.15.88:3300/0 conn(0x7fdb340f22a0 0x7fdb341b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb30ffd700 1 -- 172.21.15.88:0/1228871071 >> v1:172.21.15.88:6789/0 conn(0x7fdb3410d000 legacy=0x7fdb340f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.744 7fdb30ffd700 1 -- 172.21.15.88:0/1228871071 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34111b90 con 0x7fdb340f1820 2023-10-18T19:34:10.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb30ffd700 1 --2- 172.21.15.88:0/1228871071 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 0x7fdb340f1c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdb28002f70 tx=0x7fdb2800b970).ready entity=mon.2 client_cookie=fe2a40d11765c7e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:10.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb23fff700 1 -- 172.21.15.88:0/1228871071 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb34111b90 con 0x7fdb340f1820 2023-10-18T19:34:10.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb23fff700 1 -- 172.21.15.88:0/1228871071 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800d5c0 con 0x7fdb340f1820 2023-10-18T19:34:10.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb23fff700 1 -- 172.21.15.88:0/1228871071 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb2800d990 con 0x7fdb340f1820 2023-10-18T19:34:10.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb395ff700 1 -- 172.21.15.88:0/1228871071 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 msgr2=0x7fdb340f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.745 7fdb395ff700 1 --2- 172.21.15.88:0/1228871071 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 0x7fdb340f1c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdb28002f70 tx=0x7fdb2800b970).stop 2023-10-18T19:34:10.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 -- 172.21.15.88:0/1228871071 shutdown_connections 2023-10-18T19:34:10.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 --2- 172.21.15.88:0/1228871071 >> v2:172.21.15.88:3300/0 conn(0x7fdb340f22a0 0x7fdb341b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 --2- 172.21.15.88:0/1228871071 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340f1820 0x7fdb340f1c70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 -- 172.21.15.88:0/1228871071 >> 172.21.15.88:0/1228871071 conn(0x7fdb341176d0 msgr2=0x7fdb340f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:10.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 -- 172.21.15.88:0/1228871071 shutdown_connections 2023-10-18T19:34:10.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.746 7fdb395ff700 1 -- 172.21.15.88:0/1228871071 wait complete. 2023-10-18T19:34:10.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.770 7fdb395ff700 1 Processor -- start 2023-10-18T19:34:10.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.770 7fdb395ff700 1 -- start start 2023-10-18T19:34:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb341c6300 0x7fdb341c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb341c6d80 0x7fdb341b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:10.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340d57e0 con 0x7fdb341c6300 2023-10-18T19:34:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341b4c30 con 0x7fdb341c6d80 2023-10-18T19:34:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb395ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340d2fc0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb30ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb341c6300 0x7fdb341c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:10.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb31fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb341c6d80 0x7fdb341b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:10.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38390/0 (socket says 172.21.15.88:38390) 2023-10-18T19:34:10.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 -- 172.21.15.88:0/11765251 learned_addr learned my addr 172.21.15.88:0/11765251 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:10.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 -- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb341c6d80 msgr2=0x7fdb341b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb341c6d80 0x7fdb341b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 -- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb341c6300 msgr2=0x7fdb341c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb341c6300 0x7fdb341c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.771 7fdb317fe700 1 -- 172.21.15.88:0/11765251 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb340d2cc0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb317fe700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdb340d62c0 tx=0x7fdb2400c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb340d2cc0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb240072e0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb395ff700 1 -- 172.21.15.88:0/11765251 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb340d0750 con 0x7fdb340d0fb0 2023-10-18T19:34:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdb24005810 con 0x7fdb340d0fb0 2023-10-18T19:34:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.772 7fdb395ff700 1 -- 172.21.15.88:0/11765251 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb341b42d0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.773 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fdb24005a10 con 0x7fdb340d0fb0 2023-10-18T19:34:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.773 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2396+0+0 (secure 0 0 0) 0x7fdb240287b0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.773 7fdb395ff700 1 -- 172.21.15.88:0/11765251 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb340f0870 con 0x7fdb340d0fb0 2023-10-18T19:34:10.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.776 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fdb240070d0 con 0x7fdb340d0fb0 2023-10-18T19:34:10.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:10.874 7fdb395ff700 1 -- 172.21.15.88:0/11765251 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb340d0da0 con 0x7fdb340d0fb0 2023-10-18T19:34:11.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.524 7fdb227fc700 1 -- 172.21.15.88:0/11765251 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7fdb34114ec0 con 0x7fdb340d0fb0 2023-10-18T19:34:11.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.528 7fdb395ff700 1 -- 172.21.15.88:0/11765251 >> v1:172.21.15.88:6800/107321 conn(0x7fdb1001c1b0 legacy=0x7fdb1001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.528 7fdb395ff700 1 -- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 msgr2=0x7fdb340d4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.528 7fdb395ff700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdb340d62c0 tx=0x7fdb2400c7c0).stop 2023-10-18T19:34:11.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 -- 172.21.15.88:0/11765251 shutdown_connections 2023-10-18T19:34:11.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdb341c6d80 0x7fdb341b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdb340d0fb0 0x7fdb340d4840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 --2- 172.21.15.88:0/11765251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb341c6300 0x7fdb341c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 -- 172.21.15.88:0/11765251 >> 172.21.15.88:0/11765251 conn(0x7fdb341220c0 msgr2=0x7fdb341163d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:11.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.529 7fdb395ff700 1 -- 172.21.15.88:0/11765251 shutdown_connections 2023-10-18T19:34:11.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.530 7fdb395ff700 1 -- 172.21.15.88:0/11765251 wait complete. 2023-10-18T19:34:11.536 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-18T19:34:11.553 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-18T19:34:11.553 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T19:34:11.554 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-18T19:34:11.559 INFO:tasks.ceph.mds.a:Started 2023-10-18T19:34:11.559 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T19:34:11.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-18T19:34:11.564 INFO:tasks.ceph.mds.b:Started 2023-10-18T19:34:11.564 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T19:34:11.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-18T19:34:11.570 INFO:tasks.ceph.mds.c:Started 2023-10-18T19:34:11.570 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-18T19:34:11.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:11.766 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2023-10-18T19:34:11.785 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-10-18T19:34:11.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.788 7f7b0319d700 1 Processor -- start 2023-10-18T19:34:11.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.788 7f7b0319d700 1 -- start start 2023-10-18T19:34:11.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b0319d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b0319d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7afc0f1070 0x7f7afc1b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b0319d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc10f510 con 0x7f7afc0f14c0 2023-10-18T19:34:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b0319d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc0f8a70 con 0x7f7afc0f1070 2023-10-18T19:34:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b0319d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0f1cb0 con 0x7f7afc0f7e50 2023-10-18T19:34:11.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b009fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b009fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38418/0 (socket says 172.21.15.88:38418) 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7b009fe700 1 -- 172.21.15.88:0/3114449706 learned_addr learned my addr 172.21.15.88:0/3114449706 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.789 7f7afbfff700 1 --2- 172.21.15.88:0/3114449706 >> v2:172.21.15.88:3300/0 conn(0x7f7afc0f1070 0x7f7afc1b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7afbfff700 1 -- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 msgr2=0x7f7afc0f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7afbfff700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7afbfff700 1 -- 172.21.15.88:0/3114449706 >> v1:172.21.15.88:6789/0 conn(0x7f7afc0f14c0 legacy=0x7f7afc1b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7afbfff700 1 -- 172.21.15.88:0/3114449706 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc0f3420 con 0x7f7afc0f1070 2023-10-18T19:34:11.795 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-10-18T19:34:11.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7b009fe700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:11.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.790 7f7afbfff700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0f1070 0x7f7afc1b4af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7afc0a8da0 tx=0x7f7ae800ba20).ready entity=mon.0 client_cookie=81f8e4746edbb664 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:11.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.791 7f7afb7fe700 1 -- 172.21.15.88:0/3114449706 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7afc0f3420 con 0x7f7afc0f1070 2023-10-18T19:34:11.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.791 7f7afb7fe700 1 -- 172.21.15.88:0/3114449706 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800d5c0 con 0x7f7afc0f1070 2023-10-18T19:34:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.791 7f7b0319d700 1 -- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0f1070 msgr2=0x7f7afc1b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.791 7f7b0319d700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0f1070 0x7f7afc1b4af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7afc0a8da0 tx=0x7f7ae800ba20).stop 2023-10-18T19:34:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 -- 172.21.15.88:0/3114449706 shutdown_connections 2023-10-18T19:34:11.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0f7e50 0x7f7afc0f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 --2- 172.21.15.88:0/3114449706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0f1070 0x7f7afc1b4af0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 -- 172.21.15.88:0/3114449706 >> 172.21.15.88:0/3114449706 conn(0x7f7afc1258d0 msgr2=0x7f7afc125d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 -- 172.21.15.88:0/3114449706 shutdown_connections 2023-10-18T19:34:11.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.792 7f7b0319d700 1 -- 172.21.15.88:0/3114449706 wait complete. 2023-10-18T19:34:11.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.817 7f7b0319d700 1 Processor -- start 2023-10-18T19:34:11.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.817 7f7b0319d700 1 -- start start 2023-10-18T19:34:11.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:11.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0ce310 0x7f7afc1c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:11.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7afc1c61c0 0x7f7afc1c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:11.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0d9d40 con 0x7f7afc0da520 2023-10-18T19:34:11.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0ce760 con 0x7f7afc1c61c0 2023-10-18T19:34:11.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b0319d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0da080 con 0x7f7afc0ce310 2023-10-18T19:34:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37652/0 (socket says 172.21.15.88:37652) 2023-10-18T19:34:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 -- 172.21.15.88:0/2782152144 learned_addr learned my addr 172.21.15.88:0/2782152144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7afbfff700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0ce310 0x7f7afc1c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:11.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b011ff700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7afc1c61c0 0x7f7afc1c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 -- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0ce310 msgr2=0x7f7afc1c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0ce310 0x7f7afc1c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 -- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7afc1c61c0 msgr2=0x7f7afc1c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7afc1c61c0 0x7f7afc1c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.818 7f7b009fe700 1 -- 172.21.15.88:0/2782152144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae800d990 con 0x7f7afc0da520 2023-10-18T19:34:11.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7b009fe700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7afc0d9bf0 tx=0x7f7af000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:11.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ae800d990 con 0x7f7afc0da520 2023-10-18T19:34:11.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af000ee40 con 0x7f7afc0da520 2023-10-18T19:34:11.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc0db7c0 con 0x7f7afc0da520 2023-10-18T19:34:11.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7af000f040 con 0x7f7afc0da520 2023-10-18T19:34:11.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.819 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc0dad80 con 0x7f7afc0da520 2023-10-18T19:34:11.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.820 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f7af0011070 con 0x7f7afc0da520 2023-10-18T19:34:11.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.820 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f7af0010040 con 0x7f7afc0da520 2023-10-18T19:34:11.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.820 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc1c6e30 con 0x7f7afc0da520 2023-10-18T19:34:11.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.824 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f7af000c5a0 con 0x7f7afc0da520 2023-10-18T19:34:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.922 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7afc0e2d60 con 0x7f7afc0da520 2023-10-18T19:34:11.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.923 7f7af9ffb700 1 -- 172.21.15.88:0/2782152144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+5948 (secure 0 0 0) 0x7f7af0000c30 con 0x7f7afc0da520 2023-10-18T19:34:11.926 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:11.926 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":11,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:11.518362","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 >> v1:172.21.15.88:6800/107321 conn(0x7f7ae401c150 legacy=0x7f7ae401e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 msgr2=0x7f7afc0cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7afc0d9bf0 tx=0x7f7af000ed00).stop 2023-10-18T19:34:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 shutdown_connections 2023-10-18T19:34:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7afc1c61c0 0x7f7afc1c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7afc0da520 0x7f7afc0cdce0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 --2- 172.21.15.88:0/2782152144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7afc0ce310 0x7f7afc1c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 >> 172.21.15.88:0/2782152144 conn(0x7f7afc1b5540 msgr2=0x7f7afc0de390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 shutdown_connections 2023-10-18T19:34:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:11.924 7f7b0319d700 1 -- 172.21.15.88:0/2782152144 wait complete. 2023-10-18T19:34:11.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18 19:34:09.738627', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-18T19:34:11.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:34:12.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 Processor -- start 2023-10-18T19:34:12.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 -- start start 2023-10-18T19:34:12.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80f6d60 0x7feca80f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca81b2a10 0x7feca81b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca81121c0 con 0x7feca81b2a10 2023-10-18T19:34:12.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca810d0a0 con 0x7feca80f6d60 2023-10-18T19:34:12.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.145 7fecb07ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feca810d980 con 0x7feca80f6910 2023-10-18T19:34:12.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38442/0 (socket says 172.21.15.88:38442) 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7feca7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80f6d60 0x7feca80f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 -- 172.21.15.88:0/2506483858 learned_addr learned my addr 172.21.15.88:0/2506483858 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecad5ff700 1 --2- 172.21.15.88:0/2506483858 >> v2:172.21.15.88:3300/0 conn(0x7feca81b2a10 0x7feca81b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 -- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80f6d60 msgr2=0x7feca80f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 --2- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80f6d60 0x7feca80f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 -- 172.21.15.88:0/2506483858 >> v2:172.21.15.88:3300/0 conn(0x7feca81b2a10 msgr2=0x7feca81b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:12.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 --2- 172.21.15.88:0/2506483858 >> v2:172.21.15.88:3300/0 conn(0x7feca81b2a10 0x7feca81b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 -- 172.21.15.88:0/2506483858 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80f2470 con 0x7feca80f6910 2023-10-18T19:34:12.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.146 7fecacdfe700 1 --2- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fec9c002f70 tx=0x7fec9c0099d0).ready entity=mon.2 client_cookie=6bb37cfa7ad806a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:12.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7feca77fe700 1 -- 172.21.15.88:0/2506483858 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feca80f2470 con 0x7feca80f6910 2023-10-18T19:34:12.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7feca77fe700 1 -- 172.21.15.88:0/2506483858 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00f510 con 0x7feca80f6910 2023-10-18T19:34:12.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7feca77fe700 1 -- 172.21.15.88:0/2506483858 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec9c00f6f0 con 0x7feca80f6910 2023-10-18T19:34:12.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 -- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 msgr2=0x7feca80f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 --2- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fec9c002f70 tx=0x7fec9c0099d0).stop 2023-10-18T19:34:12.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 -- 172.21.15.88:0/2506483858 shutdown_connections 2023-10-18T19:34:12.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 --2- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80f6910 0x7feca80f1810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 --2- 172.21.15.88:0/2506483858 >> v2:172.21.15.88:3300/0 conn(0x7feca81b2a10 0x7feca81b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 --2- 172.21.15.88:0/2506483858 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80f6d60 0x7feca80f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 -- 172.21.15.88:0/2506483858 >> 172.21.15.88:0/2506483858 conn(0x7feca81176c0 msgr2=0x7feca80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:12.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 -- 172.21.15.88:0/2506483858 shutdown_connections 2023-10-18T19:34:12.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.147 7fecb07ff700 1 -- 172.21.15.88:0/2506483858 wait complete. 2023-10-18T19:34:12.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.172 7fecb07ff700 1 Processor -- start 2023-10-18T19:34:12.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.172 7fecb07ff700 1 -- start start 2023-10-18T19:34:12.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 0x7feca80cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 0x7feca81c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80cd060 con 0x7feca80cc4a0 2023-10-18T19:34:12.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80ceff0 con 0x7feca80cc050 2023-10-18T19:34:12.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecb07ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feca80d8910 con 0x7feca80d84c0 2023-10-18T19:34:12.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecacdfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 0x7feca80cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:37340/0 (socket says 172.21.15.88:37340) 2023-10-18T19:34:12.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 -- 172.21.15.88:0/1646389985 learned_addr learned my addr 172.21.15.88:0/1646389985 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:12.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecad5ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 0x7feca81c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 -- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 msgr2=0x7feca80cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 0x7feca80cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 -- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 msgr2=0x7feca81c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 0x7feca81c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7feca7fff700 1 -- 172.21.15.88:0/1646389985 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80d06b0 con 0x7feca80cc050 2023-10-18T19:34:12.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecacdfe700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 0x7feca80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:12.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.173 7fecad5ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 0x7feca81c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:12.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7feca7fff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fec9400c000 tx=0x7fec9400eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7feca80d06b0 con 0x7feca80cc050 2023-10-18T19:34:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400c9a0 con 0x7feca80cc050 2023-10-18T19:34:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80ccc50 con 0x7feca80cc050 2023-10-18T19:34:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec9400f040 con 0x7feca80cc050 2023-10-18T19:34:12.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.174 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca81c7110 con 0x7feca80cc050 2023-10-18T19:34:12.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.175 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fec94011070 con 0x7feca80cc050 2023-10-18T19:34:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.175 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7fec94010040 con 0x7feca80cc050 2023-10-18T19:34:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.175 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80f0860 con 0x7feca80cc050 2023-10-18T19:34:12.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.178 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fec9400c5a0 con 0x7feca80cc050 2023-10-18T19:34:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.276 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feca81c7510 con 0x7feca80cc050 2023-10-18T19:34:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.277 7feca5ffb700 1 -- 172.21.15.88:0/1646389985 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec94000c30 con 0x7feca80cc050 2023-10-18T19:34:12.280 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:34:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 >> v1:172.21.15.88:6800/107321 conn(0x7fec9001c1b0 legacy=0x7fec9001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 msgr2=0x7feca81c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fec9400c000 tx=0x7fec9400eca0).stop 2023-10-18T19:34:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 shutdown_connections 2023-10-18T19:34:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cc4a0 0x7feca81c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feca80d84c0 0x7feca80cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 --2- 172.21.15.88:0/1646389985 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feca80cc050 0x7feca81c62d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 >> 172.21.15.88:0/1646389985 conn(0x7feca80d5a80 msgr2=0x7feca80d45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 shutdown_connections 2023-10-18T19:34:12.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.278 7fecb07ff700 1 -- 172.21.15.88:0/1646389985 wait complete. 2023-10-18T19:34:12.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:12.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.494 7f7acc9ff700 1 Processor -- start 2023-10-18T19:34:12.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.494 7f7acc9ff700 1 -- start start 2023-10-18T19:34:12.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7acc9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7acc9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 0x7f7ac80f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7acc9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac80ab280 con 0x7f7ac81b28f0 2023-10-18T19:34:12.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7acc9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac81120a0 con 0x7f7ac80f6c40 2023-10-18T19:34:12.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7acc9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac810cf80 con 0x7f7ac80f67f0 2023-10-18T19:34:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7ac4dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7abffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 0x7f7ac80f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7ac4dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38460/0 (socket says 172.21.15.88:38460) 2023-10-18T19:34:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.495 7f7ac4dfe700 1 -- 172.21.15.88:0/95186452 learned_addr learned my addr 172.21.15.88:0/95186452 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7ac4dfe700 1 -- 172.21.15.88:0/95186452 >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 msgr2=0x7f7ac80f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:12.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7ac4dfe700 1 --2- 172.21.15.88:0/95186452 >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 0x7f7ac80f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7ac4dfe700 1 -- 172.21.15.88:0/95186452 >> v1:172.21.15.88:6789/0 conn(0x7f7ac81b28f0 legacy=0x7f7ac81b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7ac4dfe700 1 -- 172.21.15.88:0/95186452 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac810d860 con 0x7f7ac80f67f0 2023-10-18T19:34:12.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7abffff700 1 --2- 172.21.15.88:0/95186452 >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 0x7f7ac80f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:12.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7ac4dfe700 1 --2- 172.21.15.88:0/95186452 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7ab8002f70 tx=0x7f7ab80099d0).ready entity=mon.2 client_cookie=9b2e527e0f9cbd24 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:12.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7abf7fe700 1 -- 172.21.15.88:0/95186452 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ac810d860 con 0x7f7ac80f67f0 2023-10-18T19:34:12.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7abf7fe700 1 -- 172.21.15.88:0/95186452 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800f510 con 0x7f7ac80f67f0 2023-10-18T19:34:12.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7abf7fe700 1 -- 172.21.15.88:0/95186452 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ab800f6f0 con 0x7f7ac80f67f0 2023-10-18T19:34:12.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7acc9ff700 1 -- 172.21.15.88:0/95186452 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 msgr2=0x7f7ac80f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.496 7f7acc9ff700 1 --2- 172.21.15.88:0/95186452 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7ab8002f70 tx=0x7f7ab80099d0).stop 2023-10-18T19:34:12.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 -- 172.21.15.88:0/95186452 shutdown_connections 2023-10-18T19:34:12.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 --2- 172.21.15.88:0/95186452 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac80f67f0 0x7f7ac80f16f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 --2- 172.21.15.88:0/95186452 >> v2:172.21.15.88:3300/0 conn(0x7f7ac80f6c40 0x7f7ac80f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 -- 172.21.15.88:0/95186452 >> 172.21.15.88:0/95186452 conn(0x7f7ac81175a0 msgr2=0x7f7ac80f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:12.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 -- 172.21.15.88:0/95186452 shutdown_connections 2023-10-18T19:34:12.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.497 7f7acc9ff700 1 -- 172.21.15.88:0/95186452 wait complete. 2023-10-18T19:34:12.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.521 7f7acc9ff700 1 Processor -- start 2023-10-18T19:34:12.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.521 7f7acc9ff700 1 -- start start 2023-10-18T19:34:12.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 0x7f7ac80bc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ac80c6d10 0x7f7ac80bc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c6190 con 0x7f7ac80c68c0 2023-10-18T19:34:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80d2db0 con 0x7f7ac80c6d10 2023-10-18T19:34:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.522 7f7acc9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c64d0 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38468/0 (socket says 172.21.15.88:38468) 2023-10-18T19:34:12.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 -- 172.21.15.88:0/2459152179 learned_addr learned my addr 172.21.15.88:0/2459152179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:12.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac4dfe700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 0x7f7ac80bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7abffff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ac80c6d10 0x7f7ac80bc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:12.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 -- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ac80c6d10 msgr2=0x7f7ac80bc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ac80c6d10 0x7f7ac80bc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 -- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 msgr2=0x7f7ac80bc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 0x7f7ac80bc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac55ff700 1 -- 172.21.15.88:0/2459152179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80d2620 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.523 7f7ac4dfe700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 0x7f7ac80bc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:12.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.524 7f7ac55ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7ac0001250 tx=0x7f7ac000cae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:12.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.525 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ac80d2620 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.525 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0006ab0 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.525 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ac0007030 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.525 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80d29f0 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.525 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac81c1940 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.526 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f7ac0007230 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.526 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f7ac0028cb0 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.527 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac80f0740 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.532 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f7ac00068a0 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.650 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ac80e2250 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.650 7f7abdffb700 1 -- 172.21.15.88:0/2459152179 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f7ac80ffe80 con 0x7f7ac81c0ec0 2023-10-18T19:34:12.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:12.655 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2023-10-18T19:34:12.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 >> v1:172.21.15.88:6800/107321 conn(0x7f7aac01c200 legacy=0x7f7aac01e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 msgr2=0x7f7ac81c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:12.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7ac0001250 tx=0x7f7ac000cae0).stop 2023-10-18T19:34:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 shutdown_connections 2023-10-18T19:34:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ac81c0ec0 0x7f7ac81c1310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ac80c68c0 0x7f7ac80bc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 --2- 172.21.15.88:0/2459152179 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ac80c6d10 0x7f7ac80bc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:12.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 >> 172.21.15.88:0/2459152179 conn(0x7f7ac80bdaa0 msgr2=0x7f7ac81213f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:12.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 shutdown_connections 2023-10-18T19:34:12.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:12.652 7f7acc9ff700 1 -- 172.21.15.88:0/2459152179 wait complete. 2023-10-18T19:34:12.658 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 1 2023-10-18T19:34:14.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:14.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.881 7fd93f39d700 1 Processor -- start 2023-10-18T19:34:14.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.881 7fd93f39d700 1 -- start start 2023-10-18T19:34:14.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93f39d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 0x7fd9381b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:14.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93f39d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9381b78b0 0x7fd9381b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:14.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93f39d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd938111640 con 0x7fd9380f6230 2023-10-18T19:34:14.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93f39d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9381b3390 con 0x7fd9381b78b0 2023-10-18T19:34:14.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93f39d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd93810d040 con 0x7fd9380f6680 2023-10-18T19:34:14.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93cbfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9380f6230 0x7fd9381b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55874/0 (socket says 172.21.15.88:55874) 2023-10-18T19:34:14.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93cbfe700 1 -- 172.21.15.88:0/3892594059 learned_addr learned my addr 172.21.15.88:0/3892594059 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:14.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd937fff700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 0x7fd9381b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:14.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.882 7fd93d3ff700 1 --2- 172.21.15.88:0/3892594059 >> v2:172.21.15.88:3300/0 conn(0x7fd9381b78b0 0x7fd9381b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:14.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd9377fe700 1 -- 172.21.15.88:0/3892594059 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698043205 0 0) 0x7fd92c001110 con 0x7fd9380f6230 2023-10-18T19:34:14.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd9377fe700 1 -- 172.21.15.88:0/3892594059 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd91c003270 con 0x7fd9380f6230 2023-10-18T19:34:14.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93d3ff700 1 -- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 msgr2=0x7fd9381b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:14.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93d3ff700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 0x7fd9381b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:14.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93d3ff700 1 -- 172.21.15.88:0/3892594059 >> v1:172.21.15.88:6789/0 conn(0x7fd9380f6230 legacy=0x7fd9381b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:14.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93d3ff700 1 -- 172.21.15.88:0/3892594059 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93810d560 con 0x7fd9381b78b0 2023-10-18T19:34:14.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd937fff700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 0x7fd9381b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:14.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93d3ff700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9381b78b0 0x7fd9381b9d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd9300032f0 tx=0x7fd930009d10).ready entity=mon.0 client_cookie=862f5a2c84d72b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:14.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd9377fe700 1 -- 172.21.15.88:0/3892594059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd93810d560 con 0x7fd9381b78b0 2023-10-18T19:34:14.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd9377fe700 1 -- 172.21.15.88:0/3892594059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93000b800 con 0x7fd9381b78b0 2023-10-18T19:34:14.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd9377fe700 1 -- 172.21.15.88:0/3892594059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd93000b9e0 con 0x7fd9381b78b0 2023-10-18T19:34:14.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93f39d700 1 -- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9381b78b0 msgr2=0x7fd9381b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:14.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.883 7fd93f39d700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9381b78b0 0x7fd9381b9d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd9300032f0 tx=0x7fd930009d10).stop 2023-10-18T19:34:14.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 -- 172.21.15.88:0/3892594059 shutdown_connections 2023-10-18T19:34:14.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9381b78b0 0x7fd9381b9d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:14.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 --2- 172.21.15.88:0/3892594059 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9380f6680 0x7fd9381b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:14.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 -- 172.21.15.88:0/3892594059 >> 172.21.15.88:0/3892594059 conn(0x7fd938117180 msgr2=0x7fd9380f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:14.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 -- 172.21.15.88:0/3892594059 shutdown_connections 2023-10-18T19:34:14.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.884 7fd93f39d700 1 -- 172.21.15.88:0/3892594059 wait complete. 2023-10-18T19:34:14.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.908 7fd93f39d700 1 Processor -- start 2023-10-18T19:34:14.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.908 7fd93f39d700 1 -- start start 2023-10-18T19:34:14.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 0x7fd9381c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:14.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:14.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 0x7fd9380baea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:14.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd938117560 con 0x7fd9380baa50 2023-10-18T19:34:14.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9380d7c90 con 0x7fd9381c66d0 2023-10-18T19:34:14.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93f39d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9380d7950 con 0x7fd9381c5c50 2023-10-18T19:34:14.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93cbfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 0x7fd9381c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:14.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd937fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:14.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd937fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:37358/0 (socket says 172.21.15.88:37358) 2023-10-18T19:34:14.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd937fff700 1 -- 172.21.15.88:0/1843295195 learned_addr learned my addr 172.21.15.88:0/1843295195 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:14.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.909 7fd93d3ff700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 0x7fd9380baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:14.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 -- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 msgr2=0x7fd9380ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:14.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:14.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 -- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 msgr2=0x7fd9380baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:14.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 0x7fd9380baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:14.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 -- 172.21.15.88:0/1843295195 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380e2610 con 0x7fd9381c5c50 2023-10-18T19:34:14.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd937fff700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:14.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93d3ff700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 0x7fd9380baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:14.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93cbfe700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 0x7fd9381c60a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd9380d8f90 tx=0x7fd92c00c760).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:14.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9380e2610 con 0x7fd9381c5c50 2023-10-18T19:34:14.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0070d0 con 0x7fd9381c5c50 2023-10-18T19:34:14.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9380ce110 con 0x7fd9381c5c50 2023-10-18T19:34:14.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd92c005620 con 0x7fd9381c5c50 2023-10-18T19:34:14.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.910 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9380bb4d0 con 0x7fd9381c5c50 2023-10-18T19:34:14.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.911 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd92c005820 con 0x7fd9381c5c50 2023-10-18T19:34:14.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.911 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7fd92c028a40 con 0x7fd9381c5c50 2023-10-18T19:34:14.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.911 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9380f0320 con 0x7fd9381c5c50 2023-10-18T19:34:14.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:14.915 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd92c00cdf0 con 0x7fd9381c5c50 2023-10-18T19:34:15.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.034 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9380a5e40 con 0x7fd9381c5c50 2023-10-18T19:34:15.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.034 7fd935ffb700 1 -- 172.21.15.88:0/1843295195 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7fd938114970 con 0x7fd9381c5c50 2023-10-18T19:34:15.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:15.037 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2023-10-18T19:34:15.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.035 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 >> v1:172.21.15.88:6800/107321 conn(0x7fd92001c1b0 legacy=0x7fd92001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.035 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 msgr2=0x7fd9381c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.035 7fd93f39d700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 0x7fd9381c60a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd9380d8f90 tx=0x7fd92c00c760).stop 2023-10-18T19:34:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 shutdown_connections 2023-10-18T19:34:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9380baa50 0x7fd9380baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:15.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9381c5c50 0x7fd9381c60a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:15.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 --2- 172.21.15.88:0/1843295195 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9381c66d0 0x7fd9380ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:15.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 >> 172.21.15.88:0/1843295195 conn(0x7fd9380e0580 msgr2=0x7fd938120d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:15.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 shutdown_connections 2023-10-18T19:34:15.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:15.036 7fd93f39d700 1 -- 172.21.15.88:0/1843295195 wait complete. 2023-10-18T19:34:15.041 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 1 2023-10-18T19:34:17.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.263 7fed9b59e700 1 Processor -- start 2023-10-18T19:34:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.263 7fed9b59e700 1 -- start start 2023-10-18T19:34:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.263 7fed9b59e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 0x7fed9c1b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed9b59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 0x7fed9c1b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed9b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c111640 con 0x7fed9c0f6680 2023-10-18T19:34:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed9b59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1b3390 con 0x7fed9c1b78b0 2023-10-18T19:34:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed9b59e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c10d040 con 0x7fed9c0f6230 2023-10-18T19:34:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed98dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 0x7fed9c1b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed995ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 0x7fed9c1b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed93fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fed9c0f6680 0x7fed9c1b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37970/0 (socket says 172.21.15.88:37970) 2023-10-18T19:34:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed93fff700 1 -- 172.21.15.88:0/4061227556 learned_addr learned my addr 172.21.15.88:0/4061227556 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed937fe700 1 -- 172.21.15.88:0/4061227556 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858467245 0 0) 0x7fed84001110 con 0x7fed9c0f6680 2023-10-18T19:34:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed995ff700 1 -- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 msgr2=0x7fed9c1b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed995ff700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 0x7fed9c1b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed995ff700 1 -- 172.21.15.88:0/4061227556 >> v1:172.21.15.88:6789/0 conn(0x7fed9c0f6680 legacy=0x7fed9c1b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed995ff700 1 -- 172.21.15.88:0/4061227556 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c10d560 con 0x7fed9c1b78b0 2023-10-18T19:34:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.264 7fed98dfe700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 0x7fed9c1b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed995ff700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 0x7fed9c1b9d10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fed940032f0 tx=0x7fed94009d40).ready entity=mon.1 client_cookie=7ba9f4123707cbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed937fe700 1 -- 172.21.15.88:0/4061227556 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9c10d560 con 0x7fed9c1b78b0 2023-10-18T19:34:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed937fe700 1 -- 172.21.15.88:0/4061227556 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b800 con 0x7fed9c1b78b0 2023-10-18T19:34:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed937fe700 1 -- 172.21.15.88:0/4061227556 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9400b9e0 con 0x7fed9c1b78b0 2023-10-18T19:34:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed9b59e700 1 -- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 msgr2=0x7fed9c1b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed9b59e700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 0x7fed9c1b9d10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fed940032f0 tx=0x7fed94009d40).stop 2023-10-18T19:34:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.265 7fed9b59e700 1 -- 172.21.15.88:0/4061227556 shutdown_connections 2023-10-18T19:34:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.266 7fed9b59e700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c1b78b0 0x7fed9c1b9d10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.266 7fed9b59e700 1 --2- 172.21.15.88:0/4061227556 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0f6230 0x7fed9c1b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.266 7fed9b59e700 1 -- 172.21.15.88:0/4061227556 >> 172.21.15.88:0/4061227556 conn(0x7fed9c117180 msgr2=0x7fed9c0f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:17.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.266 7fed9b59e700 1 -- 172.21.15.88:0/4061227556 shutdown_connections 2023-10-18T19:34:17.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.266 7fed9b59e700 1 -- 172.21.15.88:0/4061227556 wait complete. 2023-10-18T19:34:17.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.290 7fed9b59e700 1 Processor -- start 2023-10-18T19:34:17.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.290 7fed9b59e700 1 -- start start 2023-10-18T19:34:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c0ba110 0x7fed9c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c1c5970 0x7fed9c1c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0d8080 con 0x7fed9c1c5970 2023-10-18T19:34:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0ccf60 con 0x7fed9c0ba110 2023-10-18T19:34:17.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed9b59e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0ba910 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed93fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c0ba110 0x7fed9c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35238/0 (socket says 172.21.15.88:35238) 2023-10-18T19:34:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 -- 172.21.15.88:0/3488903979 learned_addr learned my addr 172.21.15.88:0/3488903979 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:17.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed995ff700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c1c5970 0x7fed9c1c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 -- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c0ba110 msgr2=0x7fed9c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c0ba110 0x7fed9c0cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 -- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c1c5970 msgr2=0x7fed9c1c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c1c5970 0x7fed9c1c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.291 7fed98dfe700 1 -- 172.21.15.88:0/3488903979 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c1c3590 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed98dfe700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed8c00c000 tx=0x7fed8c00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed9c1c3590 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00c870 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fed8c00f040 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c0ccb30 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.292 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c1c63f0 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.293 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fed8c011070 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.293 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7fed8c010040 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.293 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c0f0320 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.296 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fed8c00c470 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.414 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed9c0f6a00 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.415 7fed91ffb700 1 -- 172.21.15.88:0/3488903979 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fed8c000c30 con 0x7fed9c0b9cc0 2023-10-18T19:34:17.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:17.418 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":2},{"gid":4186,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[]} 2023-10-18T19:34:17.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 >> v1:172.21.15.88:6800/107321 conn(0x7fed8001c150 legacy=0x7fed8001e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 msgr2=0x7fed9c0cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed8c00c000 tx=0x7fed8c00bf70).stop 2023-10-18T19:34:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 shutdown_connections 2023-10-18T19:34:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9c1c5970 0x7fed9c1c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fed9c0b9cc0 0x7fed9c0cbed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 --2- 172.21.15.88:0/3488903979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fed9c0ba110 0x7fed9c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 >> 172.21.15.88:0/3488903979 conn(0x7fed9c120ee0 msgr2=0x7fed9c0d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 shutdown_connections 2023-10-18T19:34:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.416 7fed9b59e700 1 -- 172.21.15.88:0/3488903979 wait complete. 2023-10-18T19:34:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-10-18T19:34:17.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:17.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 Processor -- start 2023-10-18T19:34:17.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 -- start start 2023-10-18T19:34:17.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 0x7f8d4c1b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c0f2100 con 0x7f8d4c1165b0 2023-10-18T19:34:17.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c10d0a0 con 0x7f8d4c1b2990 2023-10-18T19:34:17.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.633 7f8d51bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0f90b0 con 0x7f8d4c116160 2023-10-18T19:34:17.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d4a7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 0x7f8d4c1b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d497fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d497fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44278/0 (socket says 172.21.15.88:44278) 2023-10-18T19:34:17.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35244/0 (socket says 172.21.15.88:35244) 2023-10-18T19:34:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d4a7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 0x7f8d4c1b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59468/0 (socket says 172.21.15.88:59468) 2023-10-18T19:34:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d497fd700 1 -- 172.21.15.88:0/3031812856 learned_addr learned my addr 172.21.15.88:0/3031812856 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 -- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 msgr2=0x7f8d4c1b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 --2- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 0x7f8d4c1b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 -- 172.21.15.88:0/3031812856 >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 msgr2=0x7f8d4c0f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 --2- 172.21.15.88:0/3031812856 >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 -- 172.21.15.88:0/3031812856 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c116ca0 con 0x7f8d4c116160 2023-10-18T19:34:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d497fd700 1 --2- 172.21.15.88:0/3031812856 >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.634 7f8d49ffe700 1 --2- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8d4c0a8f20 tx=0x7f8d3c00b9a0).ready entity=mon.2 client_cookie=5a505d023ad48d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d48ffc700 1 -- 172.21.15.88:0/3031812856 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d4c116ca0 con 0x7f8d4c116160 2023-10-18T19:34:17.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d48ffc700 1 -- 172.21.15.88:0/3031812856 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00d570 con 0x7f8d4c116160 2023-10-18T19:34:17.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d48ffc700 1 -- 172.21.15.88:0/3031812856 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d3c00d940 con 0x7f8d4c116160 2023-10-18T19:34:17.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 -- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 msgr2=0x7f8d4c0f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 --2- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8d4c0a8f20 tx=0x7f8d3c00b9a0).stop 2023-10-18T19:34:17.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 -- 172.21.15.88:0/3031812856 shutdown_connections 2023-10-18T19:34:17.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 --2- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c116160 0x7f8d4c0f0e60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 --2- 172.21.15.88:0/3031812856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c1b2990 0x7f8d4c1b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 --2- 172.21.15.88:0/3031812856 >> v2:172.21.15.88:3300/0 conn(0x7f8d4c1165b0 0x7f8d4c0f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 -- 172.21.15.88:0/3031812856 >> 172.21.15.88:0/3031812856 conn(0x7f8d4c125cf0 msgr2=0x7f8d4c126140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 -- 172.21.15.88:0/3031812856 shutdown_connections 2023-10-18T19:34:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.635 7f8d51bff700 1 -- 172.21.15.88:0/3031812856 wait complete. 2023-10-18T19:34:17.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 Processor -- start 2023-10-18T19:34:17.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 -- start start 2023-10-18T19:34:17.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c0d1bf0 0x7f8d4c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0e62e0 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0aebc0 con 0x7f8d4c0d1bf0 2023-10-18T19:34:17.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.660 7f8d51bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c0e0dd0 con 0x7f8d4c0ba580 2023-10-18T19:34:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d49ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44284/0 (socket says 172.21.15.88:44284) 2023-10-18T19:34:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 -- 172.21.15.88:0/3968724378 learned_addr learned my addr 172.21.15.88:0/3968724378 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d49ffe700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35246/0 (socket says 172.21.15.88:35246) 2023-10-18T19:34:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d4a7ff700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c0d1bf0 0x7f8d4c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 -- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 msgr2=0x7f8d4c0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 -- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c0d1bf0 msgr2=0x7f8d4c0c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c0d1bf0 0x7f8d4c0c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 -- 172.21.15.88:0/3968724378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0b90b0 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d49ffe700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d497fd700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8d4c121460 tx=0x7f8d4000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d4000f040 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000ee40 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.661 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d4000c9a0 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.662 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c0b8460 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.662 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c1be4a0 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.662 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f8d40011070 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.663 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f8d40010040 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.663 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c0f0740 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.666 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f8d4000c5a0 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.763 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d4c0e2250 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.764 7f8d3affd700 1 -- 172.21.15.88:0/3968724378 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5935 (secure 0 0 0) 0x7f8d40000c30 con 0x7f8d4c0ba9d0 2023-10-18T19:34:17.767 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:17.767 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:12.523166","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:17.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 >> v1:172.21.15.88:6800/107321 conn(0x7f8d2801c1b0 legacy=0x7f8d2801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 msgr2=0x7f8d4c0c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8d4c121460 tx=0x7f8d4000ed00).stop 2023-10-18T19:34:17.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 shutdown_connections 2023-10-18T19:34:17.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d4c0d1bf0 0x7f8d4c0c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8d4c0ba580 0x7f8d4c0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 --2- 172.21.15.88:0/3968724378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d4c0ba9d0 0x7f8d4c0c6190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 >> 172.21.15.88:0/3968724378 conn(0x7f8d4c0d6d90 msgr2=0x7f8d4c0d3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:17.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 shutdown_connections 2023-10-18T19:34:17.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.765 7f8d51bff700 1 -- 172.21.15.88:0/3968724378 wait complete. 2023-10-18T19:34:17.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18 19:34:09.738627', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-18T19:34:17.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:34:17.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 Processor -- start 2023-10-18T19:34:17.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 -- start start 2023-10-18T19:34:17.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 0x7f7c480f1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c481b7e40 0x7f7c481ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:17.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480abc70 con 0x7f7c480f81d0 2023-10-18T19:34:17.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480f8ed0 con 0x7f7c481b7e40 2023-10-18T19:34:17.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.986 7f7c501ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c481184b0 con 0x7f7c480f8620 2023-10-18T19:34:17.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c477fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 0x7f7c480f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c47fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7c480f81d0 0x7f7c480f0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37974/0 (socket says 172.21.15.88:37974) 2023-10-18T19:34:17.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c47fff700 1 -- 172.21.15.88:0/3090873738 learned_addr learned my addr 172.21.15.88:0/3090873738 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:17.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 --2- 172.21.15.88:0/3090873738 >> v2:172.21.15.88:3300/0 conn(0x7f7c481b7e40 0x7f7c481ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:17.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 -- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 msgr2=0x7f7c480f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:17.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 0x7f7c480f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c46ffd700 1 -- 172.21.15.88:0/3090873738 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288388202 0 0) 0x7f7c38001110 con 0x7f7c480f81d0 2023-10-18T19:34:17.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 -- 172.21.15.88:0/3090873738 >> v1:172.21.15.88:6789/0 conn(0x7f7c480f81d0 legacy=0x7f7c480f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 -- 172.21.15.88:0/3090873738 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480f2200 con 0x7f7c481b7e40 2023-10-18T19:34:17.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c477fe700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 0x7f7c480f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:17.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c4cfff700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481b7e40 0x7f7c481ba2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7c48116370 tx=0x7f7c40009d40).ready entity=mon.0 client_cookie=d3ee4fb535b054d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:17.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.987 7f7c46ffd700 1 -- 172.21.15.88:0/3090873738 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c480f2200 con 0x7f7c481b7e40 2023-10-18T19:34:17.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c46ffd700 1 -- 172.21.15.88:0/3090873738 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000b7c0 con 0x7f7c481b7e40 2023-10-18T19:34:17.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c46ffd700 1 -- 172.21.15.88:0/3090873738 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c4000b9f0 con 0x7f7c481b7e40 2023-10-18T19:34:17.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 -- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481b7e40 msgr2=0x7f7c481ba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:17.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481b7e40 0x7f7c481ba2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7c48116370 tx=0x7f7c40009d40).stop 2023-10-18T19:34:17.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 -- 172.21.15.88:0/3090873738 shutdown_connections 2023-10-18T19:34:17.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481b7e40 0x7f7c481ba2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 --2- 172.21.15.88:0/3090873738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c480f8620 0x7f7c480f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 -- 172.21.15.88:0/3090873738 >> 172.21.15.88:0/3090873738 conn(0x7f7c48125e20 msgr2=0x7f7c48126270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 -- 172.21.15.88:0/3090873738 shutdown_connections 2023-10-18T19:34:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:17.988 7f7c501ff700 1 -- 172.21.15.88:0/3090873738 wait complete. 2023-10-18T19:34:18.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.012 7f7c501ff700 1 Processor -- start 2023-10-18T19:34:18.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 -- start start 2023-10-18T19:34:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480ba540 con 0x7f7c481c4c30 2023-10-18T19:34:18.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480cff10 con 0x7f7c481c47e0 2023-10-18T19:34:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c501ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480ba880 con 0x7f7c480bad20 2023-10-18T19:34:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c47fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c4cfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c477fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c477fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59484/0 (socket says 172.21.15.88:59484) 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c4cfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44306/0 (socket says 172.21.15.88:44306) 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c47fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35256/0 (socket says 172.21.15.88:35256) 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.013 7f7c477fe700 1 -- 172.21.15.88:0/2275922780 learned_addr learned my addr 172.21.15.88:0/2275922780 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 -- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 msgr2=0x7f7c481c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 -- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 msgr2=0x7f7c480b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 -- 172.21.15.88:0/2275922780 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480bb830 con 0x7f7c481c47e0 2023-10-18T19:34:18.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c4cfff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:18.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c47fff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:18.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c477fe700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7c480b76e0 tx=0x7f7c3c00bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:18.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c480bb830 con 0x7f7c481c47e0 2023-10-18T19:34:18.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c00c9a0 con 0x7f7c481c47e0 2023-10-18T19:34:18.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c480d6eb0 con 0x7f7c481c47e0 2023-10-18T19:34:18.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.014 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7c3c00f040 con 0x7f7c481c47e0 2023-10-18T19:34:18.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.015 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c480cfb50 con 0x7f7c481c47e0 2023-10-18T19:34:18.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.015 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f7c3c011070 con 0x7f7c481c47e0 2023-10-18T19:34:18.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.015 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f7c3c010040 con 0x7f7c481c47e0 2023-10-18T19:34:18.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.016 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c480f0870 con 0x7f7c481c47e0 2023-10-18T19:34:18.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.019 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f7c3c00c5a0 con 0x7f7c481c47e0 2023-10-18T19:34:18.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.116 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c480d01a0 con 0x7f7c481c47e0 2023-10-18T19:34:18.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.116 7f7c457fa700 1 -- 172.21.15.88:0/2275922780 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c3c000c30 con 0x7f7c481c47e0 2023-10-18T19:34:18.119 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:34:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 >> v1:172.21.15.88:6800/107321 conn(0x7f7c2801c1b0 legacy=0x7f7c2801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 msgr2=0x7f7c480b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7c480b76e0 tx=0x7f7c3c00bf70).stop 2023-10-18T19:34:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 shutdown_connections 2023-10-18T19:34:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c481c4c30 0x7f7c480b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7c480bad20 0x7f7c481c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.117 7f7c501ff700 1 --2- 172.21.15.88:0/2275922780 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7c481c47e0 0x7f7c480b32f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.118 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 >> 172.21.15.88:0/2275922780 conn(0x7f7c480ae110 msgr2=0x7f7c480d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.118 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 shutdown_connections 2023-10-18T19:34:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.118 7f7c501ff700 1 -- 172.21.15.88:0/2275922780 wait complete. 2023-10-18T19:34:18.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T19:34:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.334 7f0edefff700 1 Processor -- start 2023-10-18T19:34:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.334 7f0edefff700 1 -- start start 2023-10-18T19:34:18.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ed80f6c40 0x7f0ed80f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed81120a0 con 0x7f0ed80f6c40 2023-10-18T19:34:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed810cf80 con 0x7f0ed81b28f0 2023-10-18T19:34:18.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0edefff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed810d860 con 0x7f0ed80f67f0 2023-10-18T19:34:18.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed73fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed6bfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ed80f6c40 0x7f0ed80f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed73fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35270/0 (socket says 172.21.15.88:35270) 2023-10-18T19:34:18.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed73fe700 1 -- 172.21.15.88:0/182215630 learned_addr learned my addr 172.21.15.88:0/182215630 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59500/0 (socket says 172.21.15.88:59500) 2023-10-18T19:34:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 -- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 msgr2=0x7f0ed80f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 -- 172.21.15.88:0/182215630 >> v2:172.21.15.88:3300/0 conn(0x7f0ed80f6c40 msgr2=0x7f0ed80f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:18.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.335 7f0ed7bff700 1 --2- 172.21.15.88:0/182215630 >> v2:172.21.15.88:3300/0 conn(0x7f0ed80f6c40 0x7f0ed80f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed7bff700 1 -- 172.21.15.88:0/182215630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80f2350 con 0x7f0ed81b28f0 2023-10-18T19:34:18.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed73fe700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:18.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed7bff700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ed8104420 tx=0x7f0ed0009d40).ready entity=mon.1 client_cookie=f024ed3a50154ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:18.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed63fc700 1 -- 172.21.15.88:0/182215630 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ed80f2350 con 0x7f0ed81b28f0 2023-10-18T19:34:18.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed63fc700 1 -- 172.21.15.88:0/182215630 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed000b7c0 con 0x7f0ed81b28f0 2023-10-18T19:34:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0ed63fc700 1 -- 172.21.15.88:0/182215630 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ed000b9a0 con 0x7f0ed81b28f0 2023-10-18T19:34:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0edefff700 1 -- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 msgr2=0x7f0ed81b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.336 7f0edefff700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0ed8104420 tx=0x7f0ed0009d40).stop 2023-10-18T19:34:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 -- 172.21.15.88:0/182215630 shutdown_connections 2023-10-18T19:34:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80f67f0 0x7f0ed80f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 --2- 172.21.15.88:0/182215630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed81b28f0 0x7f0ed81b2d40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 --2- 172.21.15.88:0/182215630 >> v2:172.21.15.88:3300/0 conn(0x7f0ed80f6c40 0x7f0ed80f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 -- 172.21.15.88:0/182215630 >> 172.21.15.88:0/182215630 conn(0x7f0ed81175a0 msgr2=0x7f0ed80f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 -- 172.21.15.88:0/182215630 shutdown_connections 2023-10-18T19:34:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.337 7f0edefff700 1 -- 172.21.15.88:0/182215630 wait complete. 2023-10-18T19:34:18.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.361 7f0edefff700 1 Processor -- start 2023-10-18T19:34:18.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.361 7f0edefff700 1 -- start start 2023-10-18T19:34:18.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80de880 0x7f0ed81c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80f3130 con 0x7f0ed80dde00 2023-10-18T19:34:18.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80bb540 con 0x7f0ed80bdb70 2023-10-18T19:34:18.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0edefff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80bc520 con 0x7f0ed80de880 2023-10-18T19:34:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed73fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed6bfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed6bfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44322/0 (socket says 172.21.15.88:44322) 2023-10-18T19:34:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed7bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80de880 0x7f0ed81c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed73fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59510/0 (socket says 172.21.15.88:59510) 2023-10-18T19:34:18.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.362 7f0ed6bfd700 1 -- 172.21.15.88:0/3801155144 learned_addr learned my addr 172.21.15.88:0/3801155144 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:18.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 -- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80de880 msgr2=0x7f0ed81c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80de880 0x7f0ed81c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 -- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 msgr2=0x7f0ed80d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 -- 172.21.15.88:0/3801155144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80bdfc0 con 0x7f0ed80dde00 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed73fe700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed6bfd700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0ed80bba30 tx=0x7f0ecc00ecd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ed80bdfc0 con 0x7f0ed80dde00 2023-10-18T19:34:18.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc00c790 con 0x7f0ed80dde00 2023-10-18T19:34:18.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0edefff700 1 -- 172.21.15.88:0/3801155144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed80d0080 con 0x7f0ed80dde00 2023-10-18T19:34:18.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.363 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0ecc00f040 con 0x7f0ed80dde00 2023-10-18T19:34:18.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.364 7f0edefff700 1 -- 172.21.15.88:0/3801155144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed81c2500 con 0x7f0ed80dde00 2023-10-18T19:34:18.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.364 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0ecc011070 con 0x7f0ed80dde00 2023-10-18T19:34:18.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.364 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f0ecc010040 con 0x7f0ed80dde00 2023-10-18T19:34:18.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.365 7f0edefff700 1 -- 172.21.15.88:0/3801155144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed80f0740 con 0x7f0ed80dde00 2023-10-18T19:34:18.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.368 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f0ecc00ee10 con 0x7f0ed80dde00 2023-10-18T19:34:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.466 7f0edefff700 1 -- 172.21.15.88:0/3801155144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ed80a5f60 con 0x7f0ed80dde00 2023-10-18T19:34:18.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.466 7f0ed4bf9700 1 -- 172.21.15.88:0/3801155144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+64 (secure 0 0 0) 0x7f0ecc000c30 con 0x7f0ed80dde00 2023-10-18T19:34:18.469 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:18.469 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-10-18T19:34:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:34:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-10-18T19:34:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "rbd" 2023-10-18T19:34:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:34:18.470 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-10-18T19:34:18.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 -- 172.21.15.88:0/3801155144 >> v1:172.21.15.88:6800/107321 conn(0x7f0eb801c1b0 legacy=0x7f0eb801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 -- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 msgr2=0x7f0ed80de250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0ed80bba30 tx=0x7f0ecc00ecd0).stop 2023-10-18T19:34:18.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 -- 172.21.15.88:0/3801155144 shutdown_connections 2023-10-18T19:34:18.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0ed80de880 0x7f0ed81c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.467 7f0edefff700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ed80bdb70 0x7f0ed80d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.468 7f0edefff700 1 --2- 172.21.15.88:0/3801155144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ed80dde00 0x7f0ed80de250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.468 7f0edefff700 1 -- 172.21.15.88:0/3801155144 >> 172.21.15.88:0/3801155144 conn(0x7f0ed80ac2a0 msgr2=0x7f0ed81202b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.468 7f0edefff700 1 -- 172.21.15.88:0/3801155144 shutdown_connections 2023-10-18T19:34:18.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.468 7f0edefff700 1 -- 172.21.15.88:0/3801155144 wait complete. 2023-10-18T19:34:18.486 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T19:34:18.487 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-10-18T19:34:18.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 Processor -- start 2023-10-18T19:34:18.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 -- start start 2023-10-18T19:34:18.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53340f6960 0x7f53341034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 0x7f53341b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5334103f70 0x7f53341b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334111b00 con 0x7f53340f6960 2023-10-18T19:34:18.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341043c0 con 0x7f5334103f70 2023-10-18T19:34:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f5338dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5334116410 con 0x7f5334103b20 2023-10-18T19:34:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53309fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 0x7f53341b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53311fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53340f6960 0x7f53341034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53311fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53340f6960 0x7f53341034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44330/0 (socket says 172.21.15.88:44330) 2023-10-18T19:34:18.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53311fe700 1 -- 172.21.15.88:0/2137407431 learned_addr learned my addr 172.21.15.88:0/2137407431 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53309fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 0x7f53341b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35296/0 (socket says 172.21.15.88:35296) 2023-10-18T19:34:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.689 7f53319ff700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5334103f70 0x7f53341b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 -- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 msgr2=0x7f53341b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 0x7f53341b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 -- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5334103f70 msgr2=0x7f53341b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5334103f70 0x7f53341b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 -- 172.21.15.88:0/2137407431 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533410c720 con 0x7f53340f6960 2023-10-18T19:34:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f53311fe700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340f6960 0x7f53341034f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5334116850 tx=0x7f5324009ab0).ready entity=mon.0 client_cookie=1d59e9dc7ea9ceff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f5323fff700 1 -- 172.21.15.88:0/2137407431 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f533410c720 con 0x7f53340f6960 2023-10-18T19:34:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f5323fff700 1 -- 172.21.15.88:0/2137407431 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400f510 con 0x7f53340f6960 2023-10-18T19:34:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f5323fff700 1 -- 172.21.15.88:0/2137407431 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f532400f6f0 con 0x7f53340f6960 2023-10-18T19:34:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f5338dff700 1 -- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340f6960 msgr2=0x7f53341034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.690 7f5338dff700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340f6960 0x7f53341034f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5334116850 tx=0x7f5324009ab0).stop 2023-10-18T19:34:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 -- 172.21.15.88:0/2137407431 shutdown_connections 2023-10-18T19:34:18.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5334103f70 0x7f53341b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340f6960 0x7f53341034f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 --2- 172.21.15.88:0/2137407431 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5334103b20 0x7f53341b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 -- 172.21.15.88:0/2137407431 >> 172.21.15.88:0/2137407431 conn(0x7f53341176d0 msgr2=0x7f53340f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 -- 172.21.15.88:0/2137407431 shutdown_connections 2023-10-18T19:34:18.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.691 7f5338dff700 1 -- 172.21.15.88:0/2137407431 wait complete. 2023-10-18T19:34:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.715 7f5338dff700 1 Processor -- start 2023-10-18T19:34:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.715 7f5338dff700 1 -- start start 2023-10-18T19:34:18.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 0x7f53340cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f53340cf200 0x7f53341cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340beb70 con 0x7f53340b6a10 2023-10-18T19:34:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340b6570 con 0x7f53340b6e60 2023-10-18T19:34:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f5338dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53341b2db0 con 0x7f53340cf200 2023-10-18T19:34:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f53311fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f53311fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44342/0 (socket says 172.21.15.88:44342) 2023-10-18T19:34:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f53311fe700 1 -- 172.21.15.88:0/587499991 learned_addr learned my addr 172.21.15.88:0/587499991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f53309fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 0x7f53340cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.716 7f53319ff700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f53340cf200 0x7f53341cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 -- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f53340cf200 msgr2=0x7f53341cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f53340cf200 0x7f53341cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 -- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 msgr2=0x7f53340ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 -- 172.21.15.88:0/587499991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53341b4c80 con 0x7f53340b6e60 2023-10-18T19:34:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53311fe700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53309fd700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 0x7f53340cebd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53341b6500 tx=0x7f532800b970).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f53341b4c80 con 0x7f53340b6e60 2023-10-18T19:34:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532801a6c0 con 0x7f53340b6e60 2023-10-18T19:34:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f532801aa90 con 0x7f53340b6e60 2023-10-18T19:34:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f5338dff700 1 -- 172.21.15.88:0/587499991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53340b5ce0 con 0x7f53340b6e60 2023-10-18T19:34:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.717 7f5338dff700 1 -- 172.21.15.88:0/587499991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53341b2a90 con 0x7f53340b6e60 2023-10-18T19:34:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.718 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f532801ac90 con 0x7f53340b6e60 2023-10-18T19:34:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.718 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f5328032520 con 0x7f53340b6e60 2023-10-18T19:34:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.719 7f5338dff700 1 -- 172.21.15.88:0/587499991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53340f0870 con 0x7f53340b6e60 2023-10-18T19:34:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.722 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f532801a2c0 con 0x7f53340b6e60 2023-10-18T19:34:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:18.822 7f5338dff700 1 -- 172.21.15.88:0/587499991 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f53340b6360 con 0x7f53340b6e60 2023-10-18T19:34:19.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.791 7f53227fc700 1 -- 172.21.15.88:0/587499991 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5328000c30 con 0x7f53340b6e60 2023-10-18T19:34:19.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.795 7f5338dff700 1 -- 172.21.15.88:0/587499991 >> v1:172.21.15.88:6800/107321 conn(0x7f531001c1b0 legacy=0x7f531001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:19.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.795 7f5338dff700 1 -- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 msgr2=0x7f53340cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:19.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.795 7f5338dff700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 0x7f53340cebd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53341b6500 tx=0x7f532800b970).stop 2023-10-18T19:34:19.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 -- 172.21.15.88:0/587499991 shutdown_connections 2023-10-18T19:34:19.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f53340cf200 0x7f53341cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:19.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53340b6a10 0x7f53340ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:19.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 --2- 172.21.15.88:0/587499991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53340b6e60 0x7f53340cebd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:19.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 -- 172.21.15.88:0/587499991 >> 172.21.15.88:0/587499991 conn(0x7f53340e0a60 msgr2=0x7f53340df830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:19.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.798 7f5338dff700 1 -- 172.21.15.88:0/587499991 shutdown_connections 2023-10-18T19:34:19.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:19.799 7f5338dff700 1 -- 172.21.15.88:0/587499991 wait complete. 2023-10-18T19:34:19.806 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-10-18T19:34:19.829 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T19:34:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.037 7fc3f0f9d700 1 Processor -- start 2023-10-18T19:34:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.037 7fc3f0f9d700 1 -- start start 2023-10-18T19:34:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.037 7fc3f0f9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 0x7fc3ec0f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3f0f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3f0f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 0x7fc3ec1b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3f0f9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0f8a30 con 0x7fc3ec10cb30 2023-10-18T19:34:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3f0f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec10d560 con 0x7fc3ec0f0a40 2023-10-18T19:34:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3f0f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0f1cb0 con 0x7fc3ec0f14c0 2023-10-18T19:34:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3ea3fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 0x7fc3ec0f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59548/0 (socket says 172.21.15.88:59548) 2023-10-18T19:34:20.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 -- 172.21.15.88:0/2255237139 learned_addr learned my addr 172.21.15.88:0/2255237139 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:20.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3eabff700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 0x7fc3ec1b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 -- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 msgr2=0x7fc3ec1b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 0x7fc3ec1b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 -- 172.21.15.88:0/2255237139 >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 msgr2=0x7fc3ec0f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 --2- 172.21.15.88:0/2255237139 >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 0x7fc3ec0f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3e9bfd700 1 -- 172.21.15.88:0/2255237139 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0f8480 con 0x7fc3ec0f0a40 2023-10-18T19:34:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3eabff700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 0x7fc3ec1b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.038 7fc3ea3fe700 1 --2- 172.21.15.88:0/2255237139 >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 0x7fc3ec0f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3e9bfd700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc3e0002f70 tx=0x7fc3e0009a50).ready entity=mon.1 client_cookie=d973ed84ae1126fd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3e93fc700 1 -- 172.21.15.88:0/2255237139 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3ec0f8480 con 0x7fc3ec0f0a40 2023-10-18T19:34:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3e93fc700 1 -- 172.21.15.88:0/2255237139 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000f510 con 0x7fc3ec0f0a40 2023-10-18T19:34:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3e93fc700 1 -- 172.21.15.88:0/2255237139 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3e000f6f0 con 0x7fc3ec0f0a40 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3f0f9d700 1 -- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 msgr2=0x7fc3ec0f0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.039 7fc3f0f9d700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc3e0002f70 tx=0x7fc3e0009a50).stop 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 -- 172.21.15.88:0/2255237139 shutdown_connections 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec0f14c0 0x7fc3ec1b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 --2- 172.21.15.88:0/2255237139 >> v2:172.21.15.88:3300/0 conn(0x7fc3ec10cb30 0x7fc3ec0f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 --2- 172.21.15.88:0/2255237139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0f0a40 0x7fc3ec0f0e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 -- 172.21.15.88:0/2255237139 >> 172.21.15.88:0/2255237139 conn(0x7fc3ec1258d0 msgr2=0x7fc3ec125d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 -- 172.21.15.88:0/2255237139 shutdown_connections 2023-10-18T19:34:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.040 7fc3f0f9d700 1 -- 172.21.15.88:0/2255237139 wait complete. 2023-10-18T19:34:20.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.064 7fc3f0f9d700 1 Processor -- start 2023-10-18T19:34:20.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.064 7fc3f0f9d700 1 -- start start 2023-10-18T19:34:20.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 0x7fc3ec1b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec1b4770 0x7fc3ec1c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:20.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1bee20 con 0x7fc3ec1b3cf0 2023-10-18T19:34:20.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0dea90 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3f0f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0de750 con 0x7fc3ec1b4770 2023-10-18T19:34:20.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3e9bfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 0x7fc3ec1b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59564/0 (socket says 172.21.15.88:59564) 2023-10-18T19:34:20.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3e9bfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 0x7fc3ec1b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44358/0 (socket says 172.21.15.88:44358) 2023-10-18T19:34:20.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 -- 172.21.15.88:0/1039911900 learned_addr learned my addr 172.21.15.88:0/1039911900 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:20.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3eabff700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec1b4770 0x7fc3ec1c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:20.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 -- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec1b4770 msgr2=0x7fc3ec1c1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:20.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec1b4770 0x7fc3ec1c1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 -- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 msgr2=0x7fc3ec1b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:20.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 0x7fc3ec1b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.065 7fc3ea3fe700 1 -- 172.21.15.88:0/1039911900 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0d8430 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3ea3fe700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc3ec0dec40 tx=0x7fc3dc00ec70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:20.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3ec0d8430 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00c9a0 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec1c1790 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc3dc00f040 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.066 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec1c1c90 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.067 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc3dc011070 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.067 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2777+0+0 (secure 0 0 0) 0x7fc3dc010040 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.067 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec0f0320 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.070 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc3dc00c5a0 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.167 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc3ec0e1e80 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.807 7fc3db7fe700 1 -- 172.21.15.88:0/1039911900 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc3dc000c30 con 0x7fc3ec0dfe10 2023-10-18T19:34:20.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.812 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 >> v1:172.21.15.88:6800/107321 conn(0x7fc3c801c1b0 legacy=0x7fc3c801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:20.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.812 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 msgr2=0x7fc3ec0e0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:20.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.812 7fc3f0f9d700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc3ec0dec40 tx=0x7fc3dc00ec70).stop 2023-10-18T19:34:20.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 shutdown_connections 2023-10-18T19:34:20.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc3ec1b4770 0x7fc3ec1c1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc3ec0dfe10 0x7fc3ec0e0260 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 --2- 172.21.15.88:0/1039911900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3ec1b3cf0 0x7fc3ec1b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:20.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 >> 172.21.15.88:0/1039911900 conn(0x7fc3ec0cd520 msgr2=0x7fc3ec0d9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:20.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.814 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 shutdown_connections 2023-10-18T19:34:20.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:20.815 7fc3f0f9d700 1 -- 172.21.15.88:0/1039911900 wait complete. 2023-10-18T19:34:20.821 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-10-18T19:34:20.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T19:34:21.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.058 7f71c9bff700 1 Processor -- start 2023-10-18T19:34:21.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 -- start start 2023-10-18T19:34:21.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 0x7f71c41ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40abc70 con 0x7f71c40f8620 2023-10-18T19:34:21.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40f8ed0 con 0x7f71c40f81d0 2023-10-18T19:34:21.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c9bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41184b0 con 0x7f71c41b7e40 2023-10-18T19:34:21.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.059 7f71c1ffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 0x7f71c41ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c1ffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44362/0 (socket says 172.21.15.88:44362) 2023-10-18T19:34:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c1ffe700 1 -- 172.21.15.88:0/3718754156 learned_addr learned my addr 172.21.15.88:0/3718754156 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c17fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f71c40f8620 0x7f71c40f15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37976/0 (socket says 172.21.15.88:37976) 2023-10-18T19:34:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 -- 172.21.15.88:0/3718754156 >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 msgr2=0x7f71c40f0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 --2- 172.21.15.88:0/3718754156 >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 -- 172.21.15.88:0/3718754156 >> v1:172.21.15.88:6789/0 conn(0x7f71c40f8620 legacy=0x7f71c40f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 -- 172.21.15.88:0/3718754156 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40f2200 con 0x7f71c41b7e40 2023-10-18T19:34:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c0ffc700 1 -- 172.21.15.88:0/3718754156 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60697940 0 0) 0x7f71b8001110 con 0x7f71c40f8620 2023-10-18T19:34:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c1ffe700 1 --2- 172.21.15.88:0/3718754156 >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c27ff700 1 --2- 172.21.15.88:0/3718754156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 0x7f71c41ba2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f71bc0032f0 tx=0x7f71bc009c90).ready entity=mon.1 client_cookie=50586bb178ac4ed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c0ffc700 1 -- 172.21.15.88:0/3718754156 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71c40f2200 con 0x7f71c41b7e40 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c0ffc700 1 -- 172.21.15.88:0/3718754156 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00b880 con 0x7f71c41b7e40 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c0ffc700 1 -- 172.21.15.88:0/3718754156 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71bc00ba60 con 0x7f71c41b7e40 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.060 7f71c9bff700 1 -- 172.21.15.88:0/3718754156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 msgr2=0x7f71c41ba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 --2- 172.21.15.88:0/3718754156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 0x7f71c41ba2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f71bc0032f0 tx=0x7f71bc009c90).stop 2023-10-18T19:34:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 -- 172.21.15.88:0/3718754156 shutdown_connections 2023-10-18T19:34:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 --2- 172.21.15.88:0/3718754156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c41b7e40 0x7f71c41ba2a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 --2- 172.21.15.88:0/3718754156 >> v2:172.21.15.88:3300/0 conn(0x7f71c40f81d0 0x7f71c40f0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 -- 172.21.15.88:0/3718754156 >> 172.21.15.88:0/3718754156 conn(0x7f71c4125e20 msgr2=0x7f71c4126270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 -- 172.21.15.88:0/3718754156 shutdown_connections 2023-10-18T19:34:21.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.061 7f71c9bff700 1 -- 172.21.15.88:0/3718754156 wait complete. 2023-10-18T19:34:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.085 7f71c9bff700 1 Processor -- start 2023-10-18T19:34:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.085 7f71c9bff700 1 -- start start 2023-10-18T19:34:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c40ba9a0 0x7f71c40bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71c41ca450 0x7f71c41cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40d0820 con 0x7f71c40ba9a0 2023-10-18T19:34:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40ba0b0 con 0x7f71c40ba550 2023-10-18T19:34:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c9bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b9d70 con 0x7f71c41ca450 2023-10-18T19:34:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c1ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c17fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c40ba9a0 0x7f71c40bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c1ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59572/0 (socket says 172.21.15.88:59572) 2023-10-18T19:34:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c1ffe700 1 -- 172.21.15.88:0/3500450630 learned_addr learned my addr 172.21.15.88:0/3500450630 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.086 7f71c27ff700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71c41ca450 0x7f71c41cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 -- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71c41ca450 msgr2=0x7f71c41cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71c41ca450 0x7f71c41cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 -- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c40ba9a0 msgr2=0x7f71c40bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c40ba9a0 0x7f71c40bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 -- 172.21.15.88:0/3500450630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40a8420 con 0x7f71c40ba550 2023-10-18T19:34:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c1ffe700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f71c4121cf0 tx=0x7f71b400ed30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71c40a8420 con 0x7f71c40ba550 2023-10-18T19:34:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400c7b0 con 0x7f71c40ba550 2023-10-18T19:34:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71b400f040 con 0x7f71c40ba550 2023-10-18T19:34:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40bc9a0 con 0x7f71c40ba550 2023-10-18T19:34:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.087 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40bc560 con 0x7f71c40ba550 2023-10-18T19:34:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.088 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f71b4011070 con 0x7f71c40ba550 2023-10-18T19:34:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.088 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3159+0+0 (secure 0 0 0) 0x7f71b4010040 con 0x7f71c40ba550 2023-10-18T19:34:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.089 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40f0870 con 0x7f71c40ba550 2023-10-18T19:34:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.092 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f71b400c5a0 con 0x7f71c40ba550 2023-10-18T19:34:21.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.212 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f71c40d1040 con 0x7f71c40ba550 2023-10-18T19:34:21.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.223 7f71b2ffd700 1 -- 172.21.15.88:0/3500450630 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f71b4000c30 con 0x7f71c40ba550 2023-10-18T19:34:21.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.230 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 >> v1:172.21.15.88:6800/107321 conn(0x7f71a001c1b0 legacy=0x7f71a001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.231 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 msgr2=0x7f71c40bb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.231 7f71c9bff700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f71c4121cf0 tx=0x7f71b400ed30).stop 2023-10-18T19:34:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 shutdown_connections 2023-10-18T19:34:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71c41ca450 0x7f71c41cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71c40ba550 0x7f71c40bb430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 --2- 172.21.15.88:0/3500450630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71c40ba9a0 0x7f71c40bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 >> 172.21.15.88:0/3500450630 conn(0x7f71c40d8b20 msgr2=0x7f71c40f4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 shutdown_connections 2023-10-18T19:34:21.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.234 7f71c9bff700 1 -- 172.21.15.88:0/3500450630 wait complete. 2023-10-18T19:34:21.241 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2023-10-18T19:34:21.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:21.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.476 7fd2a9d9d700 1 Processor -- start 2023-10-18T19:34:21.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.476 7fd2a9d9d700 1 -- start start 2023-10-18T19:34:21.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a9d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a9d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 0x7fd2a41b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a9d9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a4111640 con 0x7fd2a40f6680 2023-10-18T19:34:21.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a9d9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a41b3390 con 0x7fd2a41b78b0 2023-10-18T19:34:21.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a9d9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a410d040 con 0x7fd2a40f6230 2023-10-18T19:34:21.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a33fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a3bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 0x7fd2a41b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a33fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35350/0 (socket says 172.21.15.88:35350) 2023-10-18T19:34:21.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a33fe700 1 -- 172.21.15.88:0/4062869693 learned_addr learned my addr 172.21.15.88:0/4062869693 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:21.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.477 7fd2a2bfd700 1 --1- 172.21.15.88:0/4062869693 >> v1:172.21.15.88:6789/0 conn(0x7fd2a40f6680 0x7fd2a41b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37992/0 (socket says 172.21.15.88:37992) 2023-10-18T19:34:21.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a33fe700 1 -- 172.21.15.88:0/4062869693 >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 msgr2=0x7fd2a41b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:21.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a33fe700 1 --2- 172.21.15.88:0/4062869693 >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 0x7fd2a41b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a33fe700 1 -- 172.21.15.88:0/4062869693 >> v1:172.21.15.88:6789/0 conn(0x7fd2a40f6680 legacy=0x7fd2a41b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a33fe700 1 -- 172.21.15.88:0/4062869693 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a410d560 con 0x7fd2a40f6230 2023-10-18T19:34:21.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a23fc700 1 -- 172.21.15.88:0/4062869693 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349561968 0 0) 0x7fd298001110 con 0x7fd2a40f6680 2023-10-18T19:34:21.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a3bff700 1 --2- 172.21.15.88:0/4062869693 >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 0x7fd2a41b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:21.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a33fe700 1 --2- 172.21.15.88:0/4062869693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd294002f70 tx=0x7fd2940099d0).ready entity=mon.2 client_cookie=f8dde9db7ed4bd5c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a23fc700 1 -- 172.21.15.88:0/4062869693 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2a410d560 con 0x7fd2a40f6230 2023-10-18T19:34:21.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a23fc700 1 -- 172.21.15.88:0/4062869693 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29400f510 con 0x7fd2a40f6230 2023-10-18T19:34:21.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a23fc700 1 -- 172.21.15.88:0/4062869693 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd29400f6f0 con 0x7fd2a40f6230 2023-10-18T19:34:21.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a9d9d700 1 -- 172.21.15.88:0/4062869693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 msgr2=0x7fd2a41b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.478 7fd2a9d9d700 1 --2- 172.21.15.88:0/4062869693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd294002f70 tx=0x7fd2940099d0).stop 2023-10-18T19:34:21.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 -- 172.21.15.88:0/4062869693 shutdown_connections 2023-10-18T19:34:21.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 --2- 172.21.15.88:0/4062869693 >> v2:172.21.15.88:3300/0 conn(0x7fd2a41b78b0 0x7fd2a41b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 --2- 172.21.15.88:0/4062869693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a40f6230 0x7fd2a41b2560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 -- 172.21.15.88:0/4062869693 >> 172.21.15.88:0/4062869693 conn(0x7fd2a4117180 msgr2=0x7fd2a40f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 -- 172.21.15.88:0/4062869693 shutdown_connections 2023-10-18T19:34:21.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.479 7fd2a9d9d700 1 -- 172.21.15.88:0/4062869693 wait complete. 2023-10-18T19:34:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.504 7fd2a9d9d700 1 Processor -- start 2023-10-18T19:34:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.504 7fd2a9d9d700 1 -- start start 2023-10-18T19:34:21.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 0x7fd2a41b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 0x7fd2a41b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40e0500 con 0x7fd2a41c40e0 2023-10-18T19:34:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40dde20 con 0x7fd2a40c9640 2023-10-18T19:34:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a9d9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a40c9a90 con 0x7fd2a41c4530 2023-10-18T19:34:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a2bfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 0x7fd2a41b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a33fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59574/0 (socket says 172.21.15.88:59574) 2023-10-18T19:34:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a33fe700 1 -- 172.21.15.88:0/175279551 learned_addr learned my addr 172.21.15.88:0/175279551 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a3bff700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 0x7fd2a41b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a2bfd700 1 -- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 msgr2=0x7fd2a41b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.505 7fd2a2bfd700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 0x7fd2a41b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a2bfd700 1 -- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 msgr2=0x7fd2a41c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a2bfd700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a2bfd700 1 -- 172.21.15.88:0/175279551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a41b3570 con 0x7fd2a41c40e0 2023-10-18T19:34:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a33fe700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a3bff700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 0x7fd2a41b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a2bfd700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 0x7fd2a41b3ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd298000bc0 tx=0x7fd29800c7d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd2a41b3570 con 0x7fd2a41c40e0 2023-10-18T19:34:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298007e00 con 0x7fd2a41c40e0 2023-10-18T19:34:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a41b4740 con 0x7fd2a41c40e0 2023-10-18T19:34:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd298005560 con 0x7fd2a41c40e0 2023-10-18T19:34:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.506 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a41caf10 con 0x7fd2a41c40e0 2023-10-18T19:34:21.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.507 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd29801b070 con 0x7fd2a41c40e0 2023-10-18T19:34:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.507 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd298028e60 con 0x7fd2a41c40e0 2023-10-18T19:34:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.507 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40f0320 con 0x7fd2a41c40e0 2023-10-18T19:34:21.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.511 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd2980070d0 con 0x7fd2a41c40e0 2023-10-18T19:34:21.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.606 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a40f69f0 con 0x7fd2a41c40e0 2023-10-18T19:34:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.607 7fd2a0bf9700 1 -- 172.21.15.88:0/175279551 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8860 (secure 0 0 0) 0x7fd298000c30 con 0x7fd2a41c40e0 2023-10-18T19:34:21.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:21.610 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:21.212949","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.608 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 >> v1:172.21.15.88:6800/107321 conn(0x7fd28401c1b0 legacy=0x7fd28401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.608 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 msgr2=0x7fd2a41b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.608 7fd2a9d9d700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 0x7fd2a41b3ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd298000bc0 tx=0x7fd29800c7d0).stop 2023-10-18T19:34:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 shutdown_connections 2023-10-18T19:34:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd2a41c4530 0x7fd2a41b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd2a40c9640 0x7fd2a41c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 --2- 172.21.15.88:0/175279551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2a41c40e0 0x7fd2a41b3ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 >> 172.21.15.88:0/175279551 conn(0x7fd2a40ca650 msgr2=0x7fd2a40ac950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 shutdown_connections 2023-10-18T19:34:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.609 7fd2a9d9d700 1 -- 172.21.15.88:0/175279551 wait complete. 2023-10-18T19:34:21.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:21.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.825 7f396bfff700 1 Processor -- start 2023-10-18T19:34:21.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.825 7f396bfff700 1 -- start start 2023-10-18T19:34:21.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f396bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 0x7f39640f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f396bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 0x7f39641b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f396bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3964115fb0 con 0x7f39640f1f60 2023-10-18T19:34:21.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f396bfff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39641b5810 con 0x7f39640f1b10 2023-10-18T19:34:21.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f396bfff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396410f530 con 0x7f3964115b60 2023-10-18T19:34:21.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f3963fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 0x7f39640f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f3968dff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f39640f1f60 0x7f39641b5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37996/0 (socket says 172.21.15.88:37996) 2023-10-18T19:34:21.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f3968dff700 1 -- 172.21.15.88:0/3640718715 learned_addr learned my addr 172.21.15.88:0/3640718715 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:21.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.826 7f39637fe700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 0x7f39641b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3963fff700 1 -- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 msgr2=0x7f39641b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:21.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3963fff700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 0x7f39641b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3963fff700 1 -- 172.21.15.88:0/3640718715 >> v1:172.21.15.88:6789/0 conn(0x7f39640f1f60 legacy=0x7f39641b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3962ffd700 1 -- 172.21.15.88:0/3640718715 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711419526 0 0) 0x7f395c001490 con 0x7f39640f1f60 2023-10-18T19:34:21.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3963fff700 1 -- 172.21.15.88:0/3640718715 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396410f9d0 con 0x7f3964115b60 2023-10-18T19:34:21.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f39637fe700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 0x7f39641b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:34:21.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3963fff700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 0x7f39640f14e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3954002f70 tx=0x7f395400b9a0).ready entity=mon.2 client_cookie=bbcb41d1cb724a86 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3962ffd700 1 -- 172.21.15.88:0/3640718715 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f395400d570 con 0x7f3964115b60 2023-10-18T19:34:21.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f3962ffd700 1 -- 172.21.15.88:0/3640718715 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400d770 con 0x7f3964115b60 2023-10-18T19:34:21.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f396bfff700 1 -- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 msgr2=0x7f39640f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.827 7f396bfff700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 0x7f39640f14e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3954002f70 tx=0x7f395400b9a0).stop 2023-10-18T19:34:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 -- 172.21.15.88:0/3640718715 shutdown_connections 2023-10-18T19:34:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3964115b60 0x7f39640f14e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 --2- 172.21.15.88:0/3640718715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640f1b10 0x7f39641b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 -- 172.21.15.88:0/3640718715 >> 172.21.15.88:0/3640718715 conn(0x7f3964117390 msgr2=0x7f39640f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 -- 172.21.15.88:0/3640718715 shutdown_connections 2023-10-18T19:34:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.828 7f396bfff700 1 -- 172.21.15.88:0/3640718715 wait complete. 2023-10-18T19:34:21.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.852 7f396bfff700 1 Processor -- start 2023-10-18T19:34:21.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 -- start start 2023-10-18T19:34:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640d4610 0x7f39640d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39641c5f80 0x7f39641c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640bdd60 con 0x7f39641c5f80 2023-10-18T19:34:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640d6340 con 0x7f39640d4610 2023-10-18T19:34:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f396bfff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39640d00d0 con 0x7f39640d4a60 2023-10-18T19:34:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f39637fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f3968dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39641c5f80 0x7f39641c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.853 7f3963fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640d4610 0x7f39640d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35374/0 (socket says 172.21.15.88:35374) 2023-10-18T19:34:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 -- 172.21.15.88:0/2978626263 learned_addr learned my addr 172.21.15.88:0/2978626263 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 -- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640d4610 msgr2=0x7f39640d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640d4610 0x7f39640d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 -- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39641c5f80 msgr2=0x7f39641c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39641c5f80 0x7f39641c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 -- 172.21.15.88:0/2978626263 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640cfdd0 con 0x7f39640d4a60 2023-10-18T19:34:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39637fe700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f39640d4ef0 tx=0x7f395800da00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f39640cfdd0 con 0x7f39640d4a60 2023-10-18T19:34:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580127e0 con 0x7f39640d4a60 2023-10-18T19:34:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f396bfff700 1 -- 172.21.15.88:0/2978626263 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39640d05d0 con 0x7f39640d4a60 2023-10-18T19:34:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.854 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f395800f040 con 0x7f39640d4a60 2023-10-18T19:34:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.855 7f396bfff700 1 -- 172.21.15.88:0/2978626263 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39640d1740 con 0x7f39640d4a60 2023-10-18T19:34:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.855 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f3958012bb0 con 0x7f39640d4a60 2023-10-18T19:34:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.855 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f3958010070 con 0x7f39640d4a60 2023-10-18T19:34:21.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.856 7f396bfff700 1 -- 172.21.15.88:0/2978626263 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39640f0530 con 0x7f39640d4a60 2023-10-18T19:34:21.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.859 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f39580123e0 con 0x7f39640d4a60 2023-10-18T19:34:21.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.958 7f396bfff700 1 -- 172.21.15.88:0/2978626263 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39640a5f60 con 0x7f39640d4a60 2023-10-18T19:34:21.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.958 7f39617fa700 1 -- 172.21.15.88:0/2978626263 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8860 (secure 0 0 0) 0x7f395802c2b0 con 0x7f39640d4a60 2023-10-18T19:34:21.960 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:21.961 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:21.212949","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:21.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 >> v1:172.21.15.88:6800/107321 conn(0x7f394401c1b0 legacy=0x7f394401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 msgr2=0x7f39640d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:21.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f39640d4ef0 tx=0x7f395800da00).stop 2023-10-18T19:34:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 shutdown_connections 2023-10-18T19:34:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39641c5f80 0x7f39641c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39640d4610 0x7f39640d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 --2- 172.21.15.88:0/2978626263 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f39640d4a60 0x7f39640d1110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 >> 172.21.15.88:0/2978626263 conn(0x7f39640bb4f0 msgr2=0x7f39640baa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 shutdown_connections 2023-10-18T19:34:21.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:21.960 7f396bfff700 1 -- 172.21.15.88:0/2978626263 wait complete. 2023-10-18T19:34:21.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T19:34:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.179 7fd1047ff700 1 Processor -- start 2023-10-18T19:34:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 -- start start 2023-10-18T19:34:22.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0f1820 0x7fd0fc0f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:22.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 0x7fd0fc1b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:22.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0abc70 con 0x7fd0fc10d000 2023-10-18T19:34:22.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc112280 con 0x7fd0fc0f22a0 2023-10-18T19:34:22.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.180 7fd1047ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0f26f0 con 0x7fd0fc0f1820 2023-10-18T19:34:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd100dfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd0fc10d000 0x7fd0fc0f6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38008/0 (socket says 172.21.15.88:38008) 2023-10-18T19:34:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd100dfe700 1 -- 172.21.15.88:0/1559843855 learned_addr learned my addr 172.21.15.88:0/1559843855 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 0x7fd0fc1b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd0fbfff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0f1820 0x7fd0fc0f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd0fb7fe700 1 -- 172.21.15.88:0/1559843855 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974420307 0 0) 0x7fd0f0001110 con 0x7fd0fc10d000 2023-10-18T19:34:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 -- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0f1820 msgr2=0x7fd0fc0f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0f1820 0x7fd0fc0f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 -- 172.21.15.88:0/1559843855 >> v1:172.21.15.88:6789/0 conn(0x7fd0fc10d000 legacy=0x7fd0fc0f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 -- 172.21.15.88:0/1559843855 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc111b90 con 0x7fd0fc0f22a0 2023-10-18T19:34:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd1015ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 0x7fd0fc1b9e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd0f40032f0 tx=0x7fd0f4009d40).ready entity=mon.1 client_cookie=a3361237d8f65f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.181 7fd0fb7fe700 1 -- 172.21.15.88:0/1559843855 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0fc111b90 con 0x7fd0fc0f22a0 2023-10-18T19:34:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd0fb7fe700 1 -- 172.21.15.88:0/1559843855 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400b800 con 0x7fd0fc0f22a0 2023-10-18T19:34:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd0fb7fe700 1 -- 172.21.15.88:0/1559843855 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f400b9e0 con 0x7fd0fc0f22a0 2023-10-18T19:34:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 -- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 msgr2=0x7fd0fc1b9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 0x7fd0fc1b9e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd0f40032f0 tx=0x7fd0f4009d40).stop 2023-10-18T19:34:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 -- 172.21.15.88:0/1559843855 shutdown_connections 2023-10-18T19:34:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0f22a0 0x7fd0fc1b9e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 --2- 172.21.15.88:0/1559843855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0f1820 0x7fd0fc0f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 -- 172.21.15.88:0/1559843855 >> 172.21.15.88:0/1559843855 conn(0x7fd0fc1176d0 msgr2=0x7fd0fc0f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 -- 172.21.15.88:0/1559843855 shutdown_connections 2023-10-18T19:34:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.182 7fd1047ff700 1 -- 172.21.15.88:0/1559843855 wait complete. 2023-10-18T19:34:22.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.206 7fd1047ff700 1 Processor -- start 2023-10-18T19:34:22.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 -- start start 2023-10-18T19:34:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 0x7fd0fc1c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 0x7fd0fc0b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0e2a60 con 0x7fd0fc0b9680 2023-10-18T19:34:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0bb6c0 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1047ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0de6d0 con 0x7fd0fc0b8bf0 2023-10-18T19:34:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd100dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd0fbfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 0x7fd0fc1c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd100dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59614/0 (socket says 172.21.15.88:59614) 2023-10-18T19:34:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd1015ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 0x7fd0fc0b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.207 7fd100dfe700 1 -- 172.21.15.88:0/4083267361 learned_addr learned my addr 172.21.15.88:0/4083267361 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 -- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 msgr2=0x7fd0fc1c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 0x7fd0fc1c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 -- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 msgr2=0x7fd0fc0b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 0x7fd0fc0b9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 -- 172.21.15.88:0/4083267361 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0ddf80 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd0fbfff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 0x7fd0fc1c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd1015ff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 0x7fd0fc0b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd100dfe700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd0fc0d64f0 tx=0x7fd0f000c890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0fc0ddf80 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00072e0 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc0b92e0 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.208 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0f0005810 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.209 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc1c6ad0 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.209 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd0f0005a10 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.209 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd0f0028620 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.210 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc0f0870 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.213 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd0f00070d0 con 0x7fd0fc0b87a0 2023-10-18T19:34:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:22.337 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd0fc0a5ff0 con 0x7fd0fc0b87a0 2023-10-18T19:34:23.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.223 7fd0f9ffb700 1 -- 172.21.15.88:0/4083267361 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd0f0000c30 con 0x7fd0fc0b87a0 2023-10-18T19:34:23.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 >> v1:172.21.15.88:6800/107321 conn(0x7fd0e401c1b0 legacy=0x7fd0e401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 msgr2=0x7fd0fc1c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd0fc0d64f0 tx=0x7fd0f000c890).stop 2023-10-18T19:34:23.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 shutdown_connections 2023-10-18T19:34:23.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0fc0b9680 0x7fd0fc0b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0fc0b87a0 0x7fd0fc1c5e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 --2- 172.21.15.88:0/4083267361 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0fc0b8bf0 0x7fd0fc1c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.225 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 >> 172.21.15.88:0/4083267361 conn(0x7fd0fc0ac510 msgr2=0x7fd0fc0ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:23.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.226 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 shutdown_connections 2023-10-18T19:34:23.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.226 7fd1047ff700 1 -- 172.21.15.88:0/4083267361 wait complete. 2023-10-18T19:34:23.246 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2023-10-18T19:34:23.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-10-18T19:34:23.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.451 7fd832f9d700 1 Processor -- start 2023-10-18T19:34:23.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.451 7fd832f9d700 1 -- start start 2023-10-18T19:34:23.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd832f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 0x7fd82c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:23.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd832f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 0x7fd82c1b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:23.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd832f9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0ffa70 con 0x7fd82c103800 2023-10-18T19:34:23.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd832f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1117e0 con 0x7fd82c103c50 2023-10-18T19:34:23.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd832f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1040a0 con 0x7fd82c0f6640 2023-10-18T19:34:23.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd82bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 0x7fd82c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:23.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd830fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 0x7fd82c1b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:23.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd82b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd82c103800 0x7fd82c1b5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38024/0 (socket says 172.21.15.88:38024) 2023-10-18T19:34:23.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.452 7fd82b7fe700 1 -- 172.21.15.88:0/3207867135 learned_addr learned my addr 172.21.15.88:0/3207867135 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:23.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82bfff700 1 -- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 msgr2=0x7fd82c1b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:23.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82bfff700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 0x7fd82c1b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82bfff700 1 -- 172.21.15.88:0/3207867135 >> v1:172.21.15.88:6789/0 conn(0x7fd82c103800 legacy=0x7fd82c1b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82affd700 1 -- 172.21.15.88:0/3207867135 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755732350 0 0) 0x7fd820001110 con 0x7fd82c103800 2023-10-18T19:34:23.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82bfff700 1 -- 172.21.15.88:0/3207867135 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c10c400 con 0x7fd82c0f6640 2023-10-18T19:34:23.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd830fff700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 0x7fd82c1b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:23.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82bfff700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 0x7fd82c1031d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd82c116530 tx=0x7fd81c00b9d0).ready entity=mon.2 client_cookie=e73d9f93e07c5a77 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:23.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82affd700 1 -- 172.21.15.88:0/3207867135 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd82c10c400 con 0x7fd82c0f6640 2023-10-18T19:34:23.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82affd700 1 -- 172.21.15.88:0/3207867135 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c00d570 con 0x7fd82c0f6640 2023-10-18T19:34:23.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd82affd700 1 -- 172.21.15.88:0/3207867135 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd81c00d940 con 0x7fd82c0f6640 2023-10-18T19:34:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd832f9d700 1 -- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 msgr2=0x7fd82c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.453 7fd832f9d700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 0x7fd82c1031d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd82c116530 tx=0x7fd81c00b9d0).stop 2023-10-18T19:34:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 -- 172.21.15.88:0/3207867135 shutdown_connections 2023-10-18T19:34:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c103c50 0x7fd82c1b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 --2- 172.21.15.88:0/3207867135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c0f6640 0x7fd82c1031d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 -- 172.21.15.88:0/3207867135 >> 172.21.15.88:0/3207867135 conn(0x7fd82c1173b0 msgr2=0x7fd82c0f2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:23.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 -- 172.21.15.88:0/3207867135 shutdown_connections 2023-10-18T19:34:23.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.454 7fd832f9d700 1 -- 172.21.15.88:0/3207867135 wait complete. 2023-10-18T19:34:23.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.478 7fd832f9d700 1 Processor -- start 2023-10-18T19:34:23.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 -- start start 2023-10-18T19:34:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c1b89e0 0x7fd82c0b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:23.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c1b8fd0 con 0x7fd82c1c2b50 2023-10-18T19:34:23.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0b8d90 con 0x7fd82c1c35d0 2023-10-18T19:34:23.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd832f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0b84f0 con 0x7fd82c1b89e0 2023-10-18T19:34:23.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.479 7fd82b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:23.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd830fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:23.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44428/0 (socket says 172.21.15.88:44428) 2023-10-18T19:34:23.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd830fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59618/0 (socket says 172.21.15.88:59618) 2023-10-18T19:34:23.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 -- 172.21.15.88:0/2375188309 learned_addr learned my addr 172.21.15.88:0/2375188309 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:23.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82bfff700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c1b89e0 0x7fd82c0b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:23.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 -- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c1b89e0 msgr2=0x7fd82c0b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c1b89e0 0x7fd82c0b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 -- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 msgr2=0x7fd82c0bb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:23.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:23.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 -- 172.21.15.88:0/2375188309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0bbd80 con 0x7fd82c1c2b50 2023-10-18T19:34:23.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd830fff700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:23.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd82b7fe700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd820000bc0 tx=0x7fd82000c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:23.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd82c0bbd80 con 0x7fd82c1c2b50 2023-10-18T19:34:23.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8200072e0 con 0x7fd82c1c2b50 2023-10-18T19:34:23.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd820005810 con 0x7fd82c1c2b50 2023-10-18T19:34:23.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.480 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c0bc0a0 con 0x7fd82c1c2b50 2023-10-18T19:34:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.481 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c0bc600 con 0x7fd82c1c2b50 2023-10-18T19:34:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.481 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd820005a10 con 0x7fd82c1c2b50 2023-10-18T19:34:23.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.482 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd8200290d0 con 0x7fd82c1c2b50 2023-10-18T19:34:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.482 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c0f0550 con 0x7fd82c1c2b50 2023-10-18T19:34:23.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.485 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd8200070d0 con 0x7fd82c1c2b50 2023-10-18T19:34:23.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:23.604 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd82c111200 con 0x7fd82c1c2b50 2023-10-18T19:34:24.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.227 7fd8297fa700 1 -- 172.21.15.88:0/2375188309 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd820000c30 con 0x7fd82c1c2b50 2023-10-18T19:34:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 >> v1:172.21.15.88:6800/107321 conn(0x7fd80c01c150 legacy=0x7fd80c01e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 msgr2=0x7fd82c1c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd820000bc0 tx=0x7fd82000c830).stop 2023-10-18T19:34:24.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 shutdown_connections 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd82c1c35d0 0x7fd82c0bb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd82c1b89e0 0x7fd82c0b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 --2- 172.21.15.88:0/2375188309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82c1c2b50 0x7fd82c1c2fa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.229 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 >> 172.21.15.88:0/2375188309 conn(0x7fd82c0ac5c0 msgr2=0x7fd82c0ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.230 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 shutdown_connections 2023-10-18T19:34:24.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.230 7fd832f9d700 1 -- 172.21.15.88:0/2375188309 wait complete. 2023-10-18T19:34:24.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T19:34:24.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 Processor -- start 2023-10-18T19:34:24.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 -- start start 2023-10-18T19:34:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1fc0f1820 0x7ff1fc0f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 0x7ff1fc1b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc0abc70 con 0x7ff1fc10d000 2023-10-18T19:34:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc112280 con 0x7ff1fc0f1820 2023-10-18T19:34:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.459 7ff2009ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0f26f0 con 0x7ff1fc0f22a0 2023-10-18T19:34:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1fc0f1820 0x7ff1fc0f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f95ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 0x7ff1fc1b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:24.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f8dfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff1fc10d000 0x7ff1fc0f6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38034/0 (socket says 172.21.15.88:38034) 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f8dfe700 1 -- 172.21.15.88:0/4080651426 learned_addr learned my addr 172.21.15.88:0/4080651426 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 -- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 msgr2=0x7ff1fc1b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 0x7ff1fc1b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 -- 172.21.15.88:0/4080651426 >> v1:172.21.15.88:6789/0 conn(0x7ff1fc10d000 legacy=0x7ff1fc0f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 -- 172.21.15.88:0/4080651426 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc111b90 con 0x7ff1fc0f1820 2023-10-18T19:34:24.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f95ff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 0x7ff1fc1b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f37fe700 1 -- 172.21.15.88:0/4080651426 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454452983 0 0) 0x7ff1ec001110 con 0x7ff1fc10d000 2023-10-18T19:34:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.460 7ff1f3fff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0f1820 0x7ff1fc0f1c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff1e4002f70 tx=0x7ff1e400b9f0).ready entity=mon.0 client_cookie=7047c8f2b095e903 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff1f37fe700 1 -- 172.21.15.88:0/4080651426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1fc111b90 con 0x7ff1fc0f1820 2023-10-18T19:34:24.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff1f37fe700 1 -- 172.21.15.88:0/4080651426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400d5c0 con 0x7ff1fc0f1820 2023-10-18T19:34:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff1f37fe700 1 -- 172.21.15.88:0/4080651426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e400d990 con 0x7ff1fc0f1820 2023-10-18T19:34:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 -- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0f1820 msgr2=0x7ff1fc0f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0f1820 0x7ff1fc0f1c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff1e4002f70 tx=0x7ff1e400b9f0).stop 2023-10-18T19:34:24.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 -- 172.21.15.88:0/4080651426 shutdown_connections 2023-10-18T19:34:24.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0f22a0 0x7ff1fc1b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 --2- 172.21.15.88:0/4080651426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0f1820 0x7ff1fc0f1c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 -- 172.21.15.88:0/4080651426 >> 172.21.15.88:0/4080651426 conn(0x7ff1fc1176d0 msgr2=0x7ff1fc0f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:24.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 -- 172.21.15.88:0/4080651426 shutdown_connections 2023-10-18T19:34:24.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.461 7ff2009ff700 1 -- 172.21.15.88:0/4080651426 wait complete. 2023-10-18T19:34:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.486 7ff2009ff700 1 Processor -- start 2023-10-18T19:34:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.486 7ff2009ff700 1 -- start start 2023-10-18T19:34:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 0x7ff1fc1bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1fc1c58e0 0x7ff1fc1c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0a8330 con 0x7ff1fc0b3f70 2023-10-18T19:34:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc0bdc10 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff2009ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc116f60 con 0x7ff1fc1c58e0 2023-10-18T19:34:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f8dfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 0x7ff1fc1bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f8dfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44444/0 (socket says 172.21.15.88:44444) 2023-10-18T19:34:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f8dfe700 1 -- 172.21.15.88:0/374246185 learned_addr learned my addr 172.21.15.88:0/374246185 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f95ff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1fc1c58e0 0x7ff1fc1c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f3fff700 1 -- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1fc1c58e0 msgr2=0x7ff1fc1c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f3fff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1fc1c58e0 0x7ff1fc1c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f3fff700 1 -- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 msgr2=0x7ff1fc1bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.487 7ff1f3fff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f3fff700 1 -- 172.21.15.88:0/374246185 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0e0140 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f8dfe700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f3fff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 0x7ff1fc1bf9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff1fc1172f0 tx=0x7ff1e40068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1fc0e0140 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4006a90 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff1e4017040 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff2009ff700 1 -- 172.21.15.88:0/374246185 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc1c6360 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.488 7ff2009ff700 1 -- 172.21.15.88:0/374246185 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc1c6860 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.489 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7ff1e4011b30 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.489 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ff1e4018070 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.490 7ff2009ff700 1 -- 172.21.15.88:0/374246185 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc0f0870 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.492 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7ff1e4011730 con 0x7ff1fc0b43c0 2023-10-18T19:34:24.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:24.612 7ff2009ff700 1 -- 172.21.15.88:0/374246185 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff1fc0bb660 con 0x7ff1fc0b43c0 2023-10-18T19:34:25.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.234 7ff1f1ffb700 1 -- 172.21.15.88:0/374246185 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1e400d3b0 con 0x7ff1fc0b43c0 2023-10-18T19:34:25.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.235 7ff2009ff700 1 -- 172.21.15.88:0/374246185 >> v1:172.21.15.88:6800/107321 conn(0x7ff1e001c1b0 legacy=0x7ff1e001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.235 7ff2009ff700 1 -- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 msgr2=0x7ff1fc1bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.235 7ff2009ff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 0x7ff1fc1bf9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff1fc1172f0 tx=0x7ff1e40068c0).stop 2023-10-18T19:34:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 -- 172.21.15.88:0/374246185 shutdown_connections 2023-10-18T19:34:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1fc1c58e0 0x7ff1fc1c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1fc0b3f70 0x7ff1fc1bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 --2- 172.21.15.88:0/374246185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1fc0b43c0 0x7ff1fc1bf9f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 -- 172.21.15.88:0/374246185 >> 172.21.15.88:0/374246185 conn(0x7ff1fc0ca7b0 msgr2=0x7ff1fc0ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:25.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 -- 172.21.15.88:0/374246185 shutdown_connections 2023-10-18T19:34:25.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.236 7ff2009ff700 1 -- 172.21.15.88:0/374246185 wait complete. 2023-10-18T19:34:25.254 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-18T19:34:25.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:25.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.455 7f5b2ffff700 1 Processor -- start 2023-10-18T19:34:25.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.455 7f5b2ffff700 1 -- start start 2023-10-18T19:34:25.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 0x7f5b301b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 0x7f5b301b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b30111640 con 0x7f5b300f12d0 2023-10-18T19:34:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2ffff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3010d040 con 0x7f5b300f6680 2023-10-18T19:34:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30111d30 con 0x7f5b300f6230 2023-10-18T19:34:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2cffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 0x7f5b301b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2dfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5b300f12d0 0x7f5b300f1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38038/0 (socket says 172.21.15.88:38038) 2023-10-18T19:34:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2d7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 0x7f5b301b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2dfff700 1 -- 172.21.15.88:0/1470110902 learned_addr learned my addr 172.21.15.88:0/1470110902 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2cffd700 1 -- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 msgr2=0x7f5b301b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b1ffff700 1 -- 172.21.15.88:0/1470110902 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501770262 0 0) 0x7f5b28001490 con 0x7f5b300f12d0 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2cffd700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 0x7f5b301b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2cffd700 1 -- 172.21.15.88:0/1470110902 >> v1:172.21.15.88:6789/0 conn(0x7f5b300f12d0 legacy=0x7f5b300f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2cffd700 1 -- 172.21.15.88:0/1470110902 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3010d560 con 0x7f5b300f6680 2023-10-18T19:34:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.456 7f5b2d7fe700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 0x7f5b301b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b2cffd700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 0x7f5b301b2b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5b3010d1f0 tx=0x7f5b2400ba50).ready entity=mon.1 client_cookie=ad33bfe38c29e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b1ffff700 1 -- 172.21.15.88:0/1470110902 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b3010d560 con 0x7f5b300f6680 2023-10-18T19:34:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b1ffff700 1 -- 172.21.15.88:0/1470110902 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400d570 con 0x7f5b300f6680 2023-10-18T19:34:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b1ffff700 1 -- 172.21.15.88:0/1470110902 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b2400d940 con 0x7f5b300f6680 2023-10-18T19:34:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b2ffff700 1 -- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 msgr2=0x7f5b301b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.457 7f5b2ffff700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 0x7f5b301b2b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f5b3010d1f0 tx=0x7f5b2400ba50).stop 2023-10-18T19:34:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 -- 172.21.15.88:0/1470110902 shutdown_connections 2023-10-18T19:34:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b300f6230 0x7f5b301b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 --2- 172.21.15.88:0/1470110902 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b300f6680 0x7f5b301b2b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 -- 172.21.15.88:0/1470110902 >> 172.21.15.88:0/1470110902 conn(0x7f5b30117180 msgr2=0x7f5b300f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 -- 172.21.15.88:0/1470110902 shutdown_connections 2023-10-18T19:34:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.458 7f5b2ffff700 1 -- 172.21.15.88:0/1470110902 wait complete. 2023-10-18T19:34:25.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.482 7f5b2ffff700 1 Processor -- start 2023-10-18T19:34:25.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.482 7f5b2ffff700 1 -- start start 2023-10-18T19:34:25.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 0x7f5b301c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b301c6620 0x7f5b301b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300f69e0 con 0x7f5b300d28f0 2023-10-18T19:34:25.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300bbab0 con 0x7f5b301c5ba0 2023-10-18T19:34:25.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b300d2e80 con 0x7f5b301c6620 2023-10-18T19:34:25.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44458/0 (socket says 172.21.15.88:44458) 2023-10-18T19:34:25.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2d7fe700 1 -- 172.21.15.88:0/407305522 learned_addr learned my addr 172.21.15.88:0/407305522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:25.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2dfff700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b301c6620 0x7f5b301b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.483 7f5b2cffd700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 0x7f5b301c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 -- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b301c6620 msgr2=0x7f5b301b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b301c6620 0x7f5b301b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 -- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 msgr2=0x7f5b301c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 0x7f5b301c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 -- 172.21.15.88:0/407305522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300d4ea0 con 0x7f5b300d28f0 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2cffd700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 0x7f5b301c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2d7fe700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5b301b46f0 tx=0x7f5b2000bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b300d4ea0 con 0x7f5b300d28f0 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2000c9a0 con 0x7f5b300d28f0 2023-10-18T19:34:25.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5b2000f040 con 0x7f5b300d28f0 2023-10-18T19:34:25.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b301b3ba0 con 0x7f5b300d28f0 2023-10-18T19:34:25.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.484 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b301b40a0 con 0x7f5b300d28f0 2023-10-18T19:34:25.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.485 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f5b20011070 con 0x7f5b300d28f0 2023-10-18T19:34:25.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.485 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f5b20010040 con 0x7f5b300d28f0 2023-10-18T19:34:25.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.486 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b300f0320 con 0x7f5b300d28f0 2023-10-18T19:34:25.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.488 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f5b2000c5a0 con 0x7f5b300d28f0 2023-10-18T19:34:25.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.608 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b300d3110 con 0x7f5b300d28f0 2023-10-18T19:34:25.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.609 7f5b1e7fc700 1 -- 172.21.15.88:0/407305522 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f5b20000c30 con 0x7f5b300d28f0 2023-10-18T19:34:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:25.611 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:25.229238","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 >> v1:172.21.15.88:6800/107321 conn(0x7f5b0c01c1b0 legacy=0x7f5b0c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 msgr2=0x7f5b301b9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5b301b46f0 tx=0x7f5b2000bf70).stop 2023-10-18T19:34:25.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 shutdown_connections 2023-10-18T19:34:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b301c6620 0x7f5b301b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b300d28f0 0x7f5b301b9ec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 --2- 172.21.15.88:0/407305522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b301c5ba0 0x7f5b301c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.610 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 >> 172.21.15.88:0/407305522 conn(0x7f5b300d8470 msgr2=0x7f5b300bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:25.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.611 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 shutdown_connections 2023-10-18T19:34:25.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.611 7f5b2ffff700 1 -- 172.21.15.88:0/407305522 wait complete. 2023-10-18T19:34:25.615 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 10 2023-10-18T19:34:25.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:25.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.827 7f25e77ff700 1 Processor -- start 2023-10-18T19:34:25.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.827 7f25e77ff700 1 -- start start 2023-10-18T19:34:25.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25e77ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 0x7f25e00f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25e77ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 0x7f25e01b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25e77ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e0111850 con 0x7f25e01b31f0 2023-10-18T19:34:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25e77ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0111f40 con 0x7f25e010ccc0 2023-10-18T19:34:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25e77ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00f6a30 con 0x7f25e01b2770 2023-10-18T19:34:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25df7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 0x7f25e00f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25d7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 0x7f25e01b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25dffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f25e01b31f0 0x7f25e00f14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38040/0 (socket says 172.21.15.88:38040) 2023-10-18T19:34:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25dffff700 1 -- 172.21.15.88:0/2363399042 learned_addr learned my addr 172.21.15.88:0/2363399042 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25df7fe700 1 -- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 msgr2=0x7f25e01b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25df7fe700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 0x7f25e01b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25df7fe700 1 -- 172.21.15.88:0/2363399042 >> v1:172.21.15.88:6789/0 conn(0x7f25e01b31f0 legacy=0x7f25e00f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25deffd700 1 -- 172.21.15.88:0/2363399042 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894677517 0 0) 0x7f25d8001490 con 0x7f25e01b31f0 2023-10-18T19:34:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25df7fe700 1 -- 172.21.15.88:0/2363399042 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e010d6f0 con 0x7f25e010ccc0 2023-10-18T19:34:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.828 7f25d7fff700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 0x7f25e01b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25df7fe700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 0x7f25e00f6400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f25e0111a70 tx=0x7f25d000ba50).ready entity=mon.1 client_cookie=ced24d8fe67e8043 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25deffd700 1 -- 172.21.15.88:0/2363399042 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25e010d6f0 con 0x7f25e010ccc0 2023-10-18T19:34:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25deffd700 1 -- 172.21.15.88:0/2363399042 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d000d570 con 0x7f25e010ccc0 2023-10-18T19:34:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25deffd700 1 -- 172.21.15.88:0/2363399042 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25d000d940 con 0x7f25e010ccc0 2023-10-18T19:34:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25e77ff700 1 -- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 msgr2=0x7f25e00f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.829 7f25e77ff700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 0x7f25e00f6400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f25e0111a70 tx=0x7f25d000ba50).stop 2023-10-18T19:34:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 -- 172.21.15.88:0/2363399042 shutdown_connections 2023-10-18T19:34:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e010ccc0 0x7f25e00f6400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 --2- 172.21.15.88:0/2363399042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e01b2770 0x7f25e01b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 -- 172.21.15.88:0/2363399042 >> 172.21.15.88:0/2363399042 conn(0x7f25e0117390 msgr2=0x7f25e00f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 -- 172.21.15.88:0/2363399042 shutdown_connections 2023-10-18T19:34:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.830 7f25e77ff700 1 -- 172.21.15.88:0/2363399042 wait complete. 2023-10-18T19:34:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 Processor -- start 2023-10-18T19:34:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 -- start start 2023-10-18T19:34:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 0x7f25e01c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0112880 con 0x7f25e01c6830 2023-10-18T19:34:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00bc750 con 0x7f25e01c63e0 2023-10-18T19:34:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.854 7f25e77ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00d2f70 con 0x7f25e00d7a20 2023-10-18T19:34:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25df7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 0x7f25e01c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59678/0 (socket says 172.21.15.88:59678) 2023-10-18T19:34:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 -- 172.21.15.88:0/2302555448 learned_addr learned my addr 172.21.15.88:0/2302555448 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25dffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44464/0 (socket says 172.21.15.88:44464) 2023-10-18T19:34:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25df7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 0x7f25e01c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35456/0 (socket says 172.21.15.88:35456) 2023-10-18T19:34:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 -- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 msgr2=0x7f25e01c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 0x7f25e01c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 -- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 msgr2=0x7f25e01b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 -- 172.21.15.88:0/2302555448 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00d5020 con 0x7f25e01c63e0 2023-10-18T19:34:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25dffff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:25.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.855 7f25d7fff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f25e010d1d0 tx=0x7f25c800ec20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25e00d5020 con 0x7f25e01c63e0 2023-10-18T19:34:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c800c9a0 con 0x7f25e01c63e0 2023-10-18T19:34:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25c800f040 con 0x7f25e01c63e0 2023-10-18T19:34:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e00d3410 con 0x7f25e01c63e0 2023-10-18T19:34:25.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e00d29e0 con 0x7f25e01c63e0 2023-10-18T19:34:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.856 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f25c8011070 con 0x7f25e01c63e0 2023-10-18T19:34:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.857 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f25c8010040 con 0x7f25e01c63e0 2023-10-18T19:34:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.857 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e00f0530 con 0x7f25e01c63e0 2023-10-18T19:34:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.860 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f25c800c5a0 con 0x7f25e01c63e0 2023-10-18T19:34:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.959 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25e00a5f60 con 0x7f25e01c63e0 2023-10-18T19:34:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.960 7f25dd7fa700 1 -- 172.21.15.88:0/2302555448 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f25c8000c30 con 0x7f25e01c63e0 2023-10-18T19:34:25.962 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:25.962 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.961 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 >> v1:172.21.15.88:6800/107321 conn(0x7f25c401c1b0 legacy=0x7f25c401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.961 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 msgr2=0x7f25e01b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.961 7f25e77ff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f25e010d1d0 tx=0x7f25c800ec20).stop 2023-10-18T19:34:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 shutdown_connections 2023-10-18T19:34:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25e01c6830 0x7f25e01b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f25e00d7a20 0x7f25e01c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 --2- 172.21.15.88:0/2302555448 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f25e01c63e0 0x7f25e01b3780 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 >> 172.21.15.88:0/2302555448 conn(0x7f25e0122130 msgr2=0x7f25e0120bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 shutdown_connections 2023-10-18T19:34:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:25.962 7f25e77ff700 1 -- 172.21.15.88:0/2302555448 wait complete. 2023-10-18T19:34:25.980 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T19:34:25.980 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:34:26.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.178 7f940e1ff700 1 Processor -- start 2023-10-18T19:34:26.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 -- start start 2023-10-18T19:34:26.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 0x7f94080f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 0x7f94081ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94080ab280 con 0x7f94080f67f0 2023-10-18T19:34:26.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080f2520 con 0x7f94080f6c40 2023-10-18T19:34:26.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.179 7f940e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94081120a0 con 0x7f94081b7c40 2023-10-18T19:34:26.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f94063fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94080f67f0 0x7f94080f16f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52006/0 (socket says 172.21.15.88:52006) 2023-10-18T19:34:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f94063fe700 1 -- 172.21.15.88:0/4222527736 learned_addr learned my addr 172.21.15.88:0/4222527736 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 0x7f94081ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9405bfd700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 0x7f94080f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f94053fc700 1 -- 172.21.15.88:0/4222527736 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368460281 0 0) 0x7f93f8001110 con 0x7f94080f67f0 2023-10-18T19:34:26.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 -- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 msgr2=0x7f94080f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:26.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 0x7f94080f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 -- 172.21.15.88:0/4222527736 >> v1:172.21.15.88:6789/0 conn(0x7f94080f67f0 legacy=0x7f94080f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 -- 172.21.15.88:0/4222527736 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940810cf80 con 0x7f94081b7c40 2023-10-18T19:34:26.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9405bfd700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 0x7f94080f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:26.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f9406bff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 0x7f94081ba0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94000032f0 tx=0x7f9400009cc0).ready entity=mon.2 client_cookie=e797aecd904f6f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f94053fc700 1 -- 172.21.15.88:0/4222527736 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f940810cf80 con 0x7f94081b7c40 2023-10-18T19:34:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.180 7f94053fc700 1 -- 172.21.15.88:0/4222527736 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940000b880 con 0x7f94081b7c40 2023-10-18T19:34:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f94053fc700 1 -- 172.21.15.88:0/4222527736 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f940000ba60 con 0x7f94081b7c40 2023-10-18T19:34:26.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 -- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 msgr2=0x7f94081ba0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 0x7f94081ba0a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94000032f0 tx=0x7f9400009cc0).stop 2023-10-18T19:34:26.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 -- 172.21.15.88:0/4222527736 shutdown_connections 2023-10-18T19:34:26.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94081b7c40 0x7f94081ba0a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 --2- 172.21.15.88:0/4222527736 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080f6c40 0x7f94080f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 -- 172.21.15.88:0/4222527736 >> 172.21.15.88:0/4222527736 conn(0x7f94081175a0 msgr2=0x7f94080f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:26.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 -- 172.21.15.88:0/4222527736 shutdown_connections 2023-10-18T19:34:26.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.181 7f940e1ff700 1 -- 172.21.15.88:0/4222527736 wait complete. 2023-10-18T19:34:26.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.205 7f940e1ff700 1 Processor -- start 2023-10-18T19:34:26.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 -- start start 2023-10-18T19:34:26.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080ccd10 0x7f9408121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080b20e0 con 0x7f94080e06e0 2023-10-18T19:34:26.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9408121dc0 con 0x7f94080ccd10 2023-10-18T19:34:26.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f940e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9408122010 con 0x7f94080dfc60 2023-10-18T19:34:26.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f9406bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f9405bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f94063fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080ccd10 0x7f9408121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f9406bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37184/0 (socket says 172.21.15.88:37184) 2023-10-18T19:34:26.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f9405bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42820/0 (socket says 172.21.15.88:42820) 2023-10-18T19:34:26.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.206 7f9406bff700 1 -- 172.21.15.88:0/2894934772 learned_addr learned my addr 172.21.15.88:0/2894934772 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:26.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 -- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 msgr2=0x7f94080e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 -- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080ccd10 msgr2=0x7f9408121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080ccd10 0x7f9408121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 -- 172.21.15.88:0/2894934772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080b30a0 con 0x7f94080e06e0 2023-10-18T19:34:26.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9405bfd700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:26.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f9406bff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f94080b25d0 tx=0x7f9400006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:26.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f94080b30a0 con 0x7f94080e06e0 2023-10-18T19:34:26.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400011af0 con 0x7f94080e06e0 2023-10-18T19:34:26.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9400017040 con 0x7f94080e06e0 2023-10-18T19:34:26.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.207 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94081c60e0 con 0x7f94080e06e0 2023-10-18T19:34:26.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.208 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94081c65e0 con 0x7f94080e06e0 2023-10-18T19:34:26.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.208 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f940001c470 con 0x7f94080e06e0 2023-10-18T19:34:26.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.208 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9400018030 con 0x7f94080e06e0 2023-10-18T19:34:26.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.209 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94080f0740 con 0x7f94080e06e0 2023-10-18T19:34:26.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.212 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f94000118e0 con 0x7f94080e06e0 2023-10-18T19:34:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.309 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 --> v1:172.21.15.88:6800/107321 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f94080882a0 con 0x7f93e401c1b0 2023-10-18T19:34:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.318 7f93f77fe700 1 -- 172.21.15.88:0/2894934772 <== mgr.4110 v1:172.21.15.88:6800/107321 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306121 (unknown 2965378022 0 3514325572) 0x7f93f8001210 con 0x7f93e401c1b0 2023-10-18T19:34:26.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:26.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 >> v1:172.21.15.88:6800/107321 conn(0x7f93e401c1b0 legacy=0x7f93e401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 msgr2=0x7f94081c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f94080b25d0 tx=0x7f9400006c40).stop 2023-10-18T19:34:26.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 shutdown_connections 2023-10-18T19:34:26.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94080e06e0 0x7f94081c5ab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f94080ccd10 0x7f9408121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 --2- 172.21.15.88:0/2894934772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f94080dfc60 0x7f94080e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 >> 172.21.15.88:0/2894934772 conn(0x7f94080b94b0 msgr2=0x7f94080d57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 shutdown_connections 2023-10-18T19:34:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.322 7f940e1ff700 1 -- 172.21.15.88:0/2894934772 wait complete. 2023-10-18T19:34:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:34:26.340 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-18 19:34:25.945706","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194912,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292448,"statfs":{"total":386547056640,"available":382251466752,"internally_reserved":4294967296,"allocated":589824,"data_stored":149528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000437"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272531","last_change":"2023-10-18 19:34:21.266064","last_active":"2023-10-18 19:34:21.272531","last_peered":"2023-10-18 19:34:21.272531","last_clean":"2023-10-18 19:34:21.272531","last_became_active":"2023-10-18 19:34:21.265745","last_became_peered":"2023-10-18 19:34:21.265745","last_unstale":"2023-10-18 19:34:21.272531","last_undegraded":"2023-10-18 19:34:21.272531","last_fullsized":"2023-10-18 19:34:21.272531","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225960","last_change":"2023-10-18 19:34:20.848544","last_active":"2023-10-18 19:34:21.225960","last_peered":"2023-10-18 19:34:21.225960","last_clean":"2023-10-18 19:34:21.225960","last_became_active":"2023-10-18 19:34:20.848186","last_became_peered":"2023-10-18 19:34:20.848186","last_unstale":"2023-10-18 19:34:21.225960","last_undegraded":"2023-10-18 19:34:21.225960","last_fullsized":"2023-10-18 19:34:21.225960","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254972","last_change":"2023-10-18 19:34:21.249452","last_active":"2023-10-18 19:34:21.254972","last_peered":"2023-10-18 19:34:21.254972","last_clean":"2023-10-18 19:34:21.254972","last_became_active":"2023-10-18 19:34:21.249103","last_became_peered":"2023-10-18 19:34:21.249103","last_unstale":"2023-10-18 19:34:21.254972","last_undegraded":"2023-10-18 19:34:21.254972","last_fullsized":"2023-10-18 19:34:21.254972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227163","last_change":"2023-10-18 19:34:20.835459","last_active":"2023-10-18 19:34:21.227163","last_peered":"2023-10-18 19:34:21.227163","last_clean":"2023-10-18 19:34:21.227163","last_became_active":"2023-10-18 19:34:20.835145","last_became_peered":"2023-10-18 19:34:20.835145","last_unstale":"2023-10-18 19:34:21.227163","last_undegraded":"2023-10-18 19:34:21.227163","last_fullsized":"2023-10-18 19:34:21.227163","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271140","last_change":"2023-10-18 19:34:21.262486","last_active":"2023-10-18 19:34:21.271140","last_peered":"2023-10-18 19:34:21.271140","last_clean":"2023-10-18 19:34:21.271140","last_became_active":"2023-10-18 19:34:21.261956","last_became_peered":"2023-10-18 19:34:21.261956","last_unstale":"2023-10-18 19:34:21.271140","last_undegraded":"2023-10-18 19:34:21.271140","last_fullsized":"2023-10-18 19:34:21.271140","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227255","last_change":"2023-10-18 19:34:20.854649","last_active":"2023-10-18 19:34:21.227255","last_peered":"2023-10-18 19:34:21.227255","last_clean":"2023-10-18 19:34:21.227255","last_became_active":"2023-10-18 19:34:20.854333","last_became_peered":"2023-10-18 19:34:20.854333","last_unstale":"2023-10-18 19:34:21.227255","last_undegraded":"2023-10-18 19:34:21.227255","last_fullsized":"2023-10-18 19:34:21.227255","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.257946","last_change":"2023-10-18 19:34:21.246025","last_active":"2023-10-18 19:34:21.257946","last_peered":"2023-10-18 19:34:21.257946","last_clean":"2023-10-18 19:34:21.257946","last_became_active":"2023-10-18 19:34:21.245735","last_became_peered":"2023-10-18 19:34:21.245735","last_unstale":"2023-10-18 19:34:21.257946","last_undegraded":"2023-10-18 19:34:21.257946","last_fullsized":"2023-10-18 19:34:21.257946","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223152","last_change":"2023-10-18 19:34:20.853312","last_active":"2023-10-18 19:34:21.223152","last_peered":"2023-10-18 19:34:21.223152","last_clean":"2023-10-18 19:34:21.223152","last_became_active":"2023-10-18 19:34:20.852964","last_became_peered":"2023-10-18 19:34:20.852964","last_unstale":"2023-10-18 19:34:21.223152","last_undegraded":"2023-10-18 19:34:21.223152","last_fullsized":"2023-10-18 19:34:21.223152","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271780","last_change":"2023-10-18 19:34:21.265408","last_active":"2023-10-18 19:34:21.271780","last_peered":"2023-10-18 19:34:21.271780","last_clean":"2023-10-18 19:34:21.271780","last_became_active":"2023-10-18 19:34:21.265029","last_became_peered":"2023-10-18 19:34:21.265029","last_unstale":"2023-10-18 19:34:21.271780","last_undegraded":"2023-10-18 19:34:21.271780","last_fullsized":"2023-10-18 19:34:21.271780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237708","last_change":"2023-10-18 19:34:20.825709","last_active":"2023-10-18 19:34:21.237708","last_peered":"2023-10-18 19:34:21.237708","last_clean":"2023-10-18 19:34:21.237708","last_became_active":"2023-10-18 19:34:20.825364","last_became_peered":"2023-10-18 19:34:20.825364","last_unstale":"2023-10-18 19:34:21.237708","last_undegraded":"2023-10-18 19:34:21.237708","last_fullsized":"2023-10-18 19:34:21.237708","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.255066","last_change":"2023-10-18 19:34:21.250032","last_active":"2023-10-18 19:34:21.255066","last_peered":"2023-10-18 19:34:21.255066","last_clean":"2023-10-18 19:34:21.255066","last_became_active":"2023-10-18 19:34:21.245104","last_became_peered":"2023-10-18 19:34:21.245104","last_unstale":"2023-10-18 19:34:21.255066","last_undegraded":"2023-10-18 19:34:21.255066","last_fullsized":"2023-10-18 19:34:21.255066","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237886","last_change":"2023-10-18 19:34:20.862583","last_active":"2023-10-18 19:34:21.237886","last_peered":"2023-10-18 19:34:21.237886","last_clean":"2023-10-18 19:34:21.237886","last_became_active":"2023-10-18 19:34:20.862262","last_became_peered":"2023-10-18 19:34:20.862262","last_unstale":"2023-10-18 19:34:21.237886","last_undegraded":"2023-10-18 19:34:21.237886","last_fullsized":"2023-10-18 19:34:21.237886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271127","last_change":"2023-10-18 19:34:21.265750","last_active":"2023-10-18 19:34:21.271127","last_peered":"2023-10-18 19:34:21.271127","last_clean":"2023-10-18 19:34:21.271127","last_became_active":"2023-10-18 19:34:21.265449","last_became_peered":"2023-10-18 19:34:21.265449","last_unstale":"2023-10-18 19:34:21.271127","last_undegraded":"2023-10-18 19:34:21.271127","last_fullsized":"2023-10-18 19:34:21.271127","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264519","last_change":"2023-10-18 19:34:20.855201","last_active":"2023-10-18 19:34:21.264519","last_peered":"2023-10-18 19:34:21.264519","last_clean":"2023-10-18 19:34:21.264519","last_became_active":"2023-10-18 19:34:20.854344","last_became_peered":"2023-10-18 19:34:20.854344","last_unstale":"2023-10-18 19:34:21.264519","last_undegraded":"2023-10-18 19:34:21.264519","last_fullsized":"2023-10-18 19:34:21.264519","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254841","last_change":"2023-10-18 19:34:21.249688","last_active":"2023-10-18 19:34:21.254841","last_peered":"2023-10-18 19:34:21.254841","last_clean":"2023-10-18 19:34:21.254841","last_became_active":"2023-10-18 19:34:21.246078","last_became_peered":"2023-10-18 19:34:21.246078","last_unstale":"2023-10-18 19:34:21.254841","last_undegraded":"2023-10-18 19:34:21.254841","last_fullsized":"2023-10-18 19:34:21.254841","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279052","last_change":"2023-10-18 19:34:20.857791","last_active":"2023-10-18 19:34:21.279052","last_peered":"2023-10-18 19:34:21.279052","last_clean":"2023-10-18 19:34:21.279052","last_became_active":"2023-10-18 19:34:20.857489","last_became_peered":"2023-10-18 19:34:20.857489","last_unstale":"2023-10-18 19:34:21.279052","last_undegraded":"2023-10-18 19:34:21.279052","last_fullsized":"2023-10-18 19:34:21.279052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253320","last_change":"2023-10-18 19:34:21.245879","last_active":"2023-10-18 19:34:21.253320","last_peered":"2023-10-18 19:34:21.253320","last_clean":"2023-10-18 19:34:21.253320","last_became_active":"2023-10-18 19:34:21.245587","last_became_peered":"2023-10-18 19:34:21.245587","last_unstale":"2023-10-18 19:34:21.253320","last_undegraded":"2023-10-18 19:34:21.253320","last_fullsized":"2023-10-18 19:34:21.253320","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273782","last_change":"2023-10-18 19:34:20.857559","last_active":"2023-10-18 19:34:21.273782","last_peered":"2023-10-18 19:34:21.273782","last_clean":"2023-10-18 19:34:21.273782","last_became_active":"2023-10-18 19:34:20.857227","last_became_peered":"2023-10-18 19:34:20.857227","last_unstale":"2023-10-18 19:34:21.273782","last_undegraded":"2023-10-18 19:34:21.273782","last_fullsized":"2023-10-18 19:34:21.273782","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262911","last_change":"2023-10-18 19:34:21.258745","last_active":"2023-10-18 19:34:21.262911","last_peered":"2023-10-18 19:34:21.262911","last_clean":"2023-10-18 19:34:21.262911","last_became_active":"2023-10-18 19:34:21.258295","last_became_peered":"2023-10-18 19:34:21.258295","last_unstale":"2023-10-18 19:34:21.262911","last_undegraded":"2023-10-18 19:34:21.262911","last_fullsized":"2023-10-18 19:34:21.262911","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227006","last_change":"2023-10-18 19:34:20.836255","last_active":"2023-10-18 19:34:21.227006","last_peered":"2023-10-18 19:34:21.227006","last_clean":"2023-10-18 19:34:21.227006","last_became_active":"2023-10-18 19:34:20.835941","last_became_peered":"2023-10-18 19:34:20.835941","last_unstale":"2023-10-18 19:34:21.227006","last_undegraded":"2023-10-18 19:34:21.227006","last_fullsized":"2023-10-18 19:34:21.227006","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262394","last_change":"2023-10-18 19:34:21.253538","last_active":"2023-10-18 19:34:21.262394","last_peered":"2023-10-18 19:34:21.262394","last_clean":"2023-10-18 19:34:21.262394","last_became_active":"2023-10-18 19:34:21.253274","last_became_peered":"2023-10-18 19:34:21.253274","last_unstale":"2023-10-18 19:34:21.262394","last_undegraded":"2023-10-18 19:34:21.262394","last_fullsized":"2023-10-18 19:34:21.262394","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235274","last_change":"2023-10-18 19:34:20.857139","last_active":"2023-10-18 19:34:21.235274","last_peered":"2023-10-18 19:34:21.235274","last_clean":"2023-10-18 19:34:21.235274","last_became_active":"2023-10-18 19:34:20.856766","last_became_peered":"2023-10-18 19:34:20.856766","last_unstale":"2023-10-18 19:34:21.235274","last_undegraded":"2023-10-18 19:34:21.235274","last_fullsized":"2023-10-18 19:34:21.235274","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276422","last_change":"2023-10-18 19:34:21.272980","last_active":"2023-10-18 19:34:21.276422","last_peered":"2023-10-18 19:34:21.276422","last_clean":"2023-10-18 19:34:21.276422","last_became_active":"2023-10-18 19:34:21.272618","last_became_peered":"2023-10-18 19:34:21.272618","last_unstale":"2023-10-18 19:34:21.276422","last_undegraded":"2023-10-18 19:34:21.276422","last_fullsized":"2023-10-18 19:34:21.276422","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276732","last_change":"2023-10-18 19:34:20.828547","last_active":"2023-10-18 19:34:21.276732","last_peered":"2023-10-18 19:34:21.276732","last_clean":"2023-10-18 19:34:21.276732","last_became_active":"2023-10-18 19:34:20.828036","last_became_peered":"2023-10-18 19:34:20.828036","last_unstale":"2023-10-18 19:34:21.276732","last_undegraded":"2023-10-18 19:34:21.276732","last_fullsized":"2023-10-18 19:34:21.276732","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271801","last_change":"2023-10-18 19:34:21.265823","last_active":"2023-10-18 19:34:21.271801","last_peered":"2023-10-18 19:34:21.271801","last_clean":"2023-10-18 19:34:21.271801","last_became_active":"2023-10-18 19:34:21.265276","last_became_peered":"2023-10-18 19:34:21.265276","last_unstale":"2023-10-18 19:34:21.271801","last_undegraded":"2023-10-18 19:34:21.271801","last_fullsized":"2023-10-18 19:34:21.271801","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.268602","last_change":"2023-10-18 19:34:20.856792","last_active":"2023-10-18 19:34:21.268602","last_peered":"2023-10-18 19:34:21.268602","last_clean":"2023-10-18 19:34:21.268602","last_became_active":"2023-10-18 19:34:20.856486","last_became_peered":"2023-10-18 19:34:20.856486","last_unstale":"2023-10-18 19:34:21.268602","last_undegraded":"2023-10-18 19:34:21.268602","last_fullsized":"2023-10-18 19:34:21.268602","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270893","last_change":"2023-10-18 19:34:21.265884","last_active":"2023-10-18 19:34:21.270893","last_peered":"2023-10-18 19:34:21.270893","last_clean":"2023-10-18 19:34:21.270893","last_became_active":"2023-10-18 19:34:21.265564","last_became_peered":"2023-10-18 19:34:21.265564","last_unstale":"2023-10-18 19:34:21.270893","last_undegraded":"2023-10-18 19:34:21.270893","last_fullsized":"2023-10-18 19:34:21.270893","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279112","last_change":"2023-10-18 19:34:20.858811","last_active":"2023-10-18 19:34:21.279112","last_peered":"2023-10-18 19:34:21.279112","last_clean":"2023-10-18 19:34:21.279112","last_became_active":"2023-10-18 19:34:20.858481","last_became_peered":"2023-10-18 19:34:20.858481","last_unstale":"2023-10-18 19:34:21.279112","last_undegraded":"2023-10-18 19:34:21.279112","last_fullsized":"2023-10-18 19:34:21.279112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254341","last_change":"2023-10-18 19:34:21.246195","last_active":"2023-10-18 19:34:21.254341","last_peered":"2023-10-18 19:34:21.254341","last_clean":"2023-10-18 19:34:21.254341","last_became_active":"2023-10-18 19:34:21.245896","last_became_peered":"2023-10-18 19:34:21.245896","last_unstale":"2023-10-18 19:34:21.254341","last_undegraded":"2023-10-18 19:34:21.254341","last_fullsized":"2023-10-18 19:34:21.254341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236208","last_change":"2023-10-18 19:34:20.855423","last_active":"2023-10-18 19:34:21.236208","last_peered":"2023-10-18 19:34:21.236208","last_clean":"2023-10-18 19:34:21.236208","last_became_active":"2023-10-18 19:34:20.854593","last_became_peered":"2023-10-18 19:34:20.854593","last_unstale":"2023-10-18 19:34:21.236208","last_undegraded":"2023-10-18 19:34:21.236208","last_fullsized":"2023-10-18 19:34:21.236208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261064","last_change":"2023-10-18 19:34:21.256949","last_active":"2023-10-18 19:34:21.261064","last_peered":"2023-10-18 19:34:21.261064","last_clean":"2023-10-18 19:34:21.261064","last_became_active":"2023-10-18 19:34:21.256623","last_became_peered":"2023-10-18 19:34:21.256623","last_unstale":"2023-10-18 19:34:21.261064","last_undegraded":"2023-10-18 19:34:21.261064","last_fullsized":"2023-10-18 19:34:21.261064","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.247595","last_change":"2023-10-18 19:34:20.846802","last_active":"2023-10-18 19:34:21.247595","last_peered":"2023-10-18 19:34:21.247595","last_clean":"2023-10-18 19:34:21.247595","last_became_active":"2023-10-18 19:34:20.846249","last_became_peered":"2023-10-18 19:34:20.846249","last_unstale":"2023-10-18 19:34:21.247595","last_undegraded":"2023-10-18 19:34:21.247595","last_fullsized":"2023-10-18 19:34:21.247595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260942","last_change":"2023-10-18 19:34:21.258895","last_active":"2023-10-18 19:34:21.260942","last_peered":"2023-10-18 19:34:21.260942","last_clean":"2023-10-18 19:34:21.260942","last_became_active":"2023-10-18 19:34:21.256384","last_became_peered":"2023-10-18 19:34:21.256384","last_unstale":"2023-10-18 19:34:21.260942","last_undegraded":"2023-10-18 19:34:21.260942","last_fullsized":"2023-10-18 19:34:21.260942","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273620","last_change":"2023-10-18 19:34:20.850016","last_active":"2023-10-18 19:34:21.273620","last_peered":"2023-10-18 19:34:21.273620","last_clean":"2023-10-18 19:34:21.273620","last_became_active":"2023-10-18 19:34:20.849501","last_became_peered":"2023-10-18 19:34:20.849501","last_unstale":"2023-10-18 19:34:21.273620","last_undegraded":"2023-10-18 19:34:21.273620","last_fullsized":"2023-10-18 19:34:21.273620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262892","last_change":"2023-10-18 19:34:21.258646","last_active":"2023-10-18 19:34:21.262892","last_peered":"2023-10-18 19:34:21.262892","last_clean":"2023-10-18 19:34:21.262892","last_became_active":"2023-10-18 19:34:21.257999","last_became_peered":"2023-10-18 19:34:21.257999","last_unstale":"2023-10-18 19:34:21.262892","last_undegraded":"2023-10-18 19:34:21.262892","last_fullsized":"2023-10-18 19:34:21.262892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235868","last_change":"2023-10-18 19:34:20.856264","last_active":"2023-10-18 19:34:21.235868","last_peered":"2023-10-18 19:34:21.235868","last_clean":"2023-10-18 19:34:21.235868","last_became_active":"2023-10-18 19:34:20.856072","last_became_peered":"2023-10-18 19:34:20.856072","last_unstale":"2023-10-18 19:34:21.235868","last_undegraded":"2023-10-18 19:34:21.235868","last_fullsized":"2023-10-18 19:34:21.235868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.248119","last_change":"2023-10-18 19:34:21.242536","last_active":"2023-10-18 19:34:21.248119","last_peered":"2023-10-18 19:34:21.248119","last_clean":"2023-10-18 19:34:21.248119","last_became_active":"2023-10-18 19:34:21.242187","last_became_peered":"2023-10-18 19:34:21.242187","last_unstale":"2023-10-18 19:34:21.248119","last_undegraded":"2023-10-18 19:34:21.248119","last_fullsized":"2023-10-18 19:34:21.248119","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237026","last_change":"2023-10-18 19:34:20.844847","last_active":"2023-10-18 19:34:21.237026","last_peered":"2023-10-18 19:34:21.237026","last_clean":"2023-10-18 19:34:21.237026","last_became_active":"2023-10-18 19:34:20.844528","last_became_peered":"2023-10-18 19:34:20.844528","last_unstale":"2023-10-18 19:34:21.237026","last_undegraded":"2023-10-18 19:34:21.237026","last_fullsized":"2023-10-18 19:34:21.237026","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276339","last_change":"2023-10-18 19:34:21.272824","last_active":"2023-10-18 19:34:21.276339","last_peered":"2023-10-18 19:34:21.276339","last_clean":"2023-10-18 19:34:21.276339","last_became_active":"2023-10-18 19:34:21.272631","last_became_peered":"2023-10-18 19:34:21.272631","last_unstale":"2023-10-18 19:34:21.276339","last_undegraded":"2023-10-18 19:34:21.276339","last_fullsized":"2023-10-18 19:34:21.276339","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236296","last_change":"2023-10-18 19:34:20.833452","last_active":"2023-10-18 19:34:21.236296","last_peered":"2023-10-18 19:34:21.236296","last_clean":"2023-10-18 19:34:21.236296","last_became_active":"2023-10-18 19:34:20.832840","last_became_peered":"2023-10-18 19:34:20.832840","last_unstale":"2023-10-18 19:34:21.236296","last_undegraded":"2023-10-18 19:34:21.236296","last_fullsized":"2023-10-18 19:34:21.236296","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261308","last_change":"2023-10-18 19:34:21.255174","last_active":"2023-10-18 19:34:21.261308","last_peered":"2023-10-18 19:34:21.261308","last_clean":"2023-10-18 19:34:21.261308","last_became_active":"2023-10-18 19:34:21.252377","last_became_peered":"2023-10-18 19:34:21.252377","last_unstale":"2023-10-18 19:34:21.261308","last_undegraded":"2023-10-18 19:34:21.261308","last_fullsized":"2023-10-18 19:34:21.261308","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251597","last_change":"2023-10-18 19:34:11.535715","last_active":"2023-10-18 19:34:21.251597","last_peered":"2023-10-18 19:34:21.251597","last_clean":"2023-10-18 19:34:21.251597","last_became_active":"2023-10-18 19:34:11.534518","last_became_peered":"2023-10-18 19:34:11.534518","last_unstale":"2023-10-18 19:34:21.251597","last_undegraded":"2023-10-18 19:34:21.251597","last_fullsized":"2023-10-18 19:34:21.251597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236775","last_change":"2023-10-18 19:34:20.857782","last_active":"2023-10-18 19:34:21.236775","last_peered":"2023-10-18 19:34:21.236775","last_clean":"2023-10-18 19:34:21.236775","last_became_active":"2023-10-18 19:34:20.853192","last_became_peered":"2023-10-18 19:34:20.853192","last_unstale":"2023-10-18 19:34:21.236775","last_undegraded":"2023-10-18 19:34:21.236775","last_fullsized":"2023-10-18 19:34:21.236775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261029","last_change":"2023-10-18 19:34:21.257423","last_active":"2023-10-18 19:34:21.261029","last_peered":"2023-10-18 19:34:21.261029","last_clean":"2023-10-18 19:34:21.261029","last_became_active":"2023-10-18 19:34:21.256448","last_became_peered":"2023-10-18 19:34:21.256448","last_unstale":"2023-10-18 19:34:21.261029","last_undegraded":"2023-10-18 19:34:21.261029","last_fullsized":"2023-10-18 19:34:21.261029","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.231638","last_change":"2023-10-18 19:34:11.532756","last_active":"2023-10-18 19:34:21.231638","last_peered":"2023-10-18 19:34:21.231638","last_clean":"2023-10-18 19:34:21.231638","last_became_active":"2023-10-18 19:34:11.532425","last_became_peered":"2023-10-18 19:34:11.532425","last_unstale":"2023-10-18 19:34:21.231638","last_undegraded":"2023-10-18 19:34:21.231638","last_fullsized":"2023-10-18 19:34:21.231638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262706","last_change":"2023-10-18 19:34:20.852964","last_active":"2023-10-18 19:34:21.262706","last_peered":"2023-10-18 19:34:21.262706","last_clean":"2023-10-18 19:34:21.262706","last_became_active":"2023-10-18 19:34:20.852642","last_became_peered":"2023-10-18 19:34:20.852642","last_unstale":"2023-10-18 19:34:21.262706","last_undegraded":"2023-10-18 19:34:21.262706","last_fullsized":"2023-10-18 19:34:21.262706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235826","last_change":"2023-10-18 19:34:11.534856","last_active":"2023-10-18 19:34:21.235826","last_peered":"2023-10-18 19:34:21.235826","last_clean":"2023-10-18 19:34:21.235826","last_became_active":"2023-10-18 19:34:11.534541","last_became_peered":"2023-10-18 19:34:11.534541","last_unstale":"2023-10-18 19:34:21.235826","last_undegraded":"2023-10-18 19:34:21.235826","last_fullsized":"2023-10-18 19:34:21.235826","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223233","last_change":"2023-10-18 19:34:20.847678","last_active":"2023-10-18 19:34:21.223233","last_peered":"2023-10-18 19:34:21.223233","last_clean":"2023-10-18 19:34:21.223233","last_became_active":"2023-10-18 19:34:20.847107","last_became_peered":"2023-10-18 19:34:20.847107","last_unstale":"2023-10-18 19:34:21.223233","last_undegraded":"2023-10-18 19:34:21.223233","last_fullsized":"2023-10-18 19:34:21.223233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260656","last_change":"2023-10-18 19:34:21.255564","last_active":"2023-10-18 19:34:21.260656","last_peered":"2023-10-18 19:34:21.260656","last_clean":"2023-10-18 19:34:21.260656","last_became_active":"2023-10-18 19:34:21.255230","last_became_peered":"2023-10-18 19:34:21.255230","last_unstale":"2023-10-18 19:34:21.260656","last_undegraded":"2023-10-18 19:34:21.260656","last_fullsized":"2023-10-18 19:34:21.260656","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236452","last_change":"2023-10-18 19:34:11.535128","last_active":"2023-10-18 19:34:21.236452","last_peered":"2023-10-18 19:34:21.236452","last_clean":"2023-10-18 19:34:21.236452","last_became_active":"2023-10-18 19:34:11.534248","last_became_peered":"2023-10-18 19:34:11.534248","last_unstale":"2023-10-18 19:34:21.236452","last_undegraded":"2023-10-18 19:34:21.236452","last_fullsized":"2023-10-18 19:34:21.236452","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245021","last_change":"2023-10-18 19:34:20.855194","last_active":"2023-10-18 19:34:21.245021","last_peered":"2023-10-18 19:34:21.245021","last_clean":"2023-10-18 19:34:21.245021","last_became_active":"2023-10-18 19:34:20.854897","last_became_peered":"2023-10-18 19:34:20.854897","last_unstale":"2023-10-18 19:34:21.245021","last_undegraded":"2023-10-18 19:34:21.245021","last_fullsized":"2023-10-18 19:34:21.245021","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.275744","last_change":"2023-10-18 19:34:21.270017","last_active":"2023-10-18 19:34:21.275744","last_peered":"2023-10-18 19:34:21.275744","last_clean":"2023-10-18 19:34:21.275744","last_became_active":"2023-10-18 19:34:21.269485","last_became_peered":"2023-10-18 19:34:21.269485","last_unstale":"2023-10-18 19:34:21.275744","last_undegraded":"2023-10-18 19:34:21.275744","last_fullsized":"2023-10-18 19:34:21.275744","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.232447","last_change":"2023-10-18 19:34:11.532872","last_active":"2023-10-18 19:34:21.232447","last_peered":"2023-10-18 19:34:21.232447","last_clean":"2023-10-18 19:34:21.232447","last_became_active":"2023-10-18 19:34:11.531562","last_became_peered":"2023-10-18 19:34:11.531562","last_unstale":"2023-10-18 19:34:21.232447","last_undegraded":"2023-10-18 19:34:21.232447","last_fullsized":"2023-10-18 19:34:21.232447","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225490","last_change":"2023-10-18 19:34:20.852891","last_active":"2023-10-18 19:34:21.225490","last_peered":"2023-10-18 19:34:21.225490","last_clean":"2023-10-18 19:34:21.225490","last_became_active":"2023-10-18 19:34:20.852426","last_became_peered":"2023-10-18 19:34:20.852426","last_unstale":"2023-10-18 19:34:21.225490","last_undegraded":"2023-10-18 19:34:21.225490","last_fullsized":"2023-10-18 19:34:21.225490","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271146","last_change":"2023-10-18 19:34:21.266390","last_active":"2023-10-18 19:34:21.271146","last_peered":"2023-10-18 19:34:21.271146","last_clean":"2023-10-18 19:34:21.271146","last_became_active":"2023-10-18 19:34:21.266089","last_became_peered":"2023-10-18 19:34:21.266089","last_unstale":"2023-10-18 19:34:21.271146","last_undegraded":"2023-10-18 19:34:21.271146","last_fullsized":"2023-10-18 19:34:21.271146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223059","last_change":"2023-10-18 19:34:11.532565","last_active":"2023-10-18 19:34:21.223059","last_peered":"2023-10-18 19:34:21.223059","last_clean":"2023-10-18 19:34:21.223059","last_became_active":"2023-10-18 19:34:11.532168","last_became_peered":"2023-10-18 19:34:11.532168","last_unstale":"2023-10-18 19:34:21.223059","last_undegraded":"2023-10-18 19:34:21.223059","last_fullsized":"2023-10-18 19:34:21.223059","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227100","last_change":"2023-10-18 19:34:20.852330","last_active":"2023-10-18 19:34:21.227100","last_peered":"2023-10-18 19:34:21.227100","last_clean":"2023-10-18 19:34:21.227100","last_became_active":"2023-10-18 19:34:20.851992","last_became_peered":"2023-10-18 19:34:20.851992","last_unstale":"2023-10-18 19:34:21.227100","last_undegraded":"2023-10-18 19:34:21.227100","last_fullsized":"2023-10-18 19:34:21.227100","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270746","last_change":"2023-10-18 19:34:21.264314","last_active":"2023-10-18 19:34:21.270746","last_peered":"2023-10-18 19:34:21.270746","last_clean":"2023-10-18 19:34:21.270746","last_became_active":"2023-10-18 19:34:21.263937","last_became_peered":"2023-10-18 19:34:21.263937","last_unstale":"2023-10-18 19:34:21.270746","last_undegraded":"2023-10-18 19:34:21.270746","last_fullsized":"2023-10-18 19:34:21.270746","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225659","last_change":"2023-10-18 19:34:11.533453","last_active":"2023-10-18 19:34:21.225659","last_peered":"2023-10-18 19:34:21.225659","last_clean":"2023-10-18 19:34:21.225659","last_became_active":"2023-10-18 19:34:11.532769","last_became_peered":"2023-10-18 19:34:11.532769","last_unstale":"2023-10-18 19:34:21.225659","last_undegraded":"2023-10-18 19:34:21.225659","last_fullsized":"2023-10-18 19:34:21.225659","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.229268","last_change":"2023-10-18 19:34:20.853145","last_active":"2023-10-18 19:34:21.229268","last_peered":"2023-10-18 19:34:21.229268","last_clean":"2023-10-18 19:34:21.229268","last_became_active":"2023-10-18 19:34:20.852683","last_became_peered":"2023-10-18 19:34:20.852683","last_unstale":"2023-10-18 19:34:21.229268","last_undegraded":"2023-10-18 19:34:21.229268","last_fullsized":"2023-10-18 19:34:21.229268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273041","last_change":"2023-10-18 19:34:21.266346","last_active":"2023-10-18 19:34:21.273041","last_peered":"2023-10-18 19:34:21.273041","last_clean":"2023-10-18 19:34:21.273041","last_became_active":"2023-10-18 19:34:21.265950","last_became_peered":"2023-10-18 19:34:21.265950","last_unstale":"2023-10-18 19:34:21.273041","last_undegraded":"2023-10-18 19:34:21.273041","last_fullsized":"2023-10-18 19:34:21.273041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.240589","last_change":"2023-10-18 19:34:11.533454","last_active":"2023-10-18 19:34:21.240589","last_peered":"2023-10-18 19:34:21.240589","last_clean":"2023-10-18 19:34:21.240589","last_became_active":"2023-10-18 19:34:11.533123","last_became_peered":"2023-10-18 19:34:11.533123","last_unstale":"2023-10-18 19:34:21.240589","last_undegraded":"2023-10-18 19:34:21.240589","last_fullsized":"2023-10-18 19:34:21.240589","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235790","last_change":"2023-10-18 19:34:20.844955","last_active":"2023-10-18 19:34:21.235790","last_peered":"2023-10-18 19:34:21.235790","last_clean":"2023-10-18 19:34:21.235790","last_became_active":"2023-10-18 19:34:20.844711","last_became_peered":"2023-10-18 19:34:20.844711","last_unstale":"2023-10-18 19:34:21.235790","last_undegraded":"2023-10-18 19:34:21.235790","last_fullsized":"2023-10-18 19:34:21.235790","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267224","last_change":"2023-10-18 19:34:21.256370","last_active":"2023-10-18 19:34:21.267224","last_peered":"2023-10-18 19:34:21.267224","last_clean":"2023-10-18 19:34:21.267224","last_became_active":"2023-10-18 19:34:21.256084","last_became_peered":"2023-10-18 19:34:21.256084","last_unstale":"2023-10-18 19:34:21.267224","last_undegraded":"2023-10-18 19:34:21.267224","last_fullsized":"2023-10-18 19:34:21.267224","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261044","last_change":"2023-10-18 19:34:21.253778","last_active":"2023-10-18 19:34:21.261044","last_peered":"2023-10-18 19:34:21.261044","last_clean":"2023-10-18 19:34:21.261044","last_became_active":"2023-10-18 19:34:21.251946","last_became_peered":"2023-10-18 19:34:21.251946","last_unstale":"2023-10-18 19:34:21.261044","last_undegraded":"2023-10-18 19:34:21.261044","last_fullsized":"2023-10-18 19:34:21.261044","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.239348","last_change":"2023-10-18 19:34:20.862585","last_active":"2023-10-18 19:34:21.239348","last_peered":"2023-10-18 19:34:21.239348","last_clean":"2023-10-18 19:34:21.239348","last_became_active":"2023-10-18 19:34:20.862326","last_became_peered":"2023-10-18 19:34:20.862326","last_unstale":"2023-10-18 19:34:21.239348","last_undegraded":"2023-10-18 19:34:21.239348","last_fullsized":"2023-10-18 19:34:21.239348","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264051","last_change":"2023-10-18 19:34:21.259196","last_active":"2023-10-18 19:34:21.264051","last_peered":"2023-10-18 19:34:21.264051","last_clean":"2023-10-18 19:34:21.264051","last_became_active":"2023-10-18 19:34:21.258884","last_became_peered":"2023-10-18 19:34:21.258884","last_unstale":"2023-10-18 19:34:21.264051","last_undegraded":"2023-10-18 19:34:21.264051","last_fullsized":"2023-10-18 19:34:21.264051","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262675","last_change":"2023-10-18 19:34:20.863893","last_active":"2023-10-18 19:34:21.262675","last_peered":"2023-10-18 19:34:21.262675","last_clean":"2023-10-18 19:34:21.262675","last_became_active":"2023-10-18 19:34:20.863549","last_became_peered":"2023-10-18 19:34:20.863549","last_unstale":"2023-10-18 19:34:21.262675","last_undegraded":"2023-10-18 19:34:21.262675","last_fullsized":"2023-10-18 19:34:21.262675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262881","last_change":"2023-10-18 19:34:21.261264","last_active":"2023-10-18 19:34:21.262881","last_peered":"2023-10-18 19:34:21.262881","last_clean":"2023-10-18 19:34:21.262881","last_became_active":"2023-10-18 19:34:21.260951","last_became_peered":"2023-10-18 19:34:21.260951","last_unstale":"2023-10-18 19:34:21.262881","last_undegraded":"2023-10-18 19:34:21.262881","last_fullsized":"2023-10-18 19:34:21.262881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261912","last_change":"2023-10-18 19:34:20.853421","last_active":"2023-10-18 19:34:21.261912","last_peered":"2023-10-18 19:34:21.261912","last_clean":"2023-10-18 19:34:21.261912","last_became_active":"2023-10-18 19:34:20.853091","last_became_peered":"2023-10-18 19:34:20.853091","last_unstale":"2023-10-18 19:34:21.261912","last_undegraded":"2023-10-18 19:34:21.261912","last_fullsized":"2023-10-18 19:34:21.261912","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.278815","last_change":"2023-10-18 19:34:21.274214","last_active":"2023-10-18 19:34:21.278815","last_peered":"2023-10-18 19:34:21.278815","last_clean":"2023-10-18 19:34:21.278815","last_became_active":"2023-10-18 19:34:21.273899","last_became_peered":"2023-10-18 19:34:21.273899","last_unstale":"2023-10-18 19:34:21.278815","last_undegraded":"2023-10-18 19:34:21.278815","last_fullsized":"2023-10-18 19:34:21.278815","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271533","last_change":"2023-10-18 19:34:20.860150","last_active":"2023-10-18 19:34:21.271533","last_peered":"2023-10-18 19:34:21.271533","last_clean":"2023-10-18 19:34:21.271533","last_became_active":"2023-10-18 19:34:20.859836","last_became_peered":"2023-10-18 19:34:20.859836","last_unstale":"2023-10-18 19:34:21.271533","last_undegraded":"2023-10-18 19:34:21.271533","last_fullsized":"2023-10-18 19:34:21.271533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267146","last_change":"2023-10-18 19:34:21.260022","last_active":"2023-10-18 19:34:21.267146","last_peered":"2023-10-18 19:34:21.267146","last_clean":"2023-10-18 19:34:21.267146","last_became_active":"2023-10-18 19:34:21.259630","last_became_peered":"2023-10-18 19:34:21.259630","last_unstale":"2023-10-18 19:34:21.267146","last_undegraded":"2023-10-18 19:34:21.267146","last_fullsized":"2023-10-18 19:34:21.267146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223404","last_change":"2023-10-18 19:34:20.832124","last_active":"2023-10-18 19:34:21.223404","last_peered":"2023-10-18 19:34:21.223404","last_clean":"2023-10-18 19:34:21.223404","last_became_active":"2023-10-18 19:34:20.831830","last_became_peered":"2023-10-18 19:34:20.831830","last_unstale":"2023-10-18 19:34:21.223404","last_undegraded":"2023-10-18 19:34:21.223404","last_fullsized":"2023-10-18 19:34:21.223404","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271045","last_change":"2023-10-18 19:34:21.263372","last_active":"2023-10-18 19:34:21.271045","last_peered":"2023-10-18 19:34:21.271045","last_clean":"2023-10-18 19:34:21.271045","last_became_active":"2023-10-18 19:34:21.256876","last_became_peered":"2023-10-18 19:34:21.256876","last_unstale":"2023-10-18 19:34:21.271045","last_undegraded":"2023-10-18 19:34:21.271045","last_fullsized":"2023-10-18 19:34:21.271045","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245344","last_change":"2023-10-18 19:34:20.846546","last_active":"2023-10-18 19:34:21.245344","last_peered":"2023-10-18 19:34:21.245344","last_clean":"2023-10-18 19:34:21.245344","last_became_active":"2023-10-18 19:34:20.846229","last_became_peered":"2023-10-18 19:34:20.846229","last_unstale":"2023-10-18 19:34:21.245344","last_undegraded":"2023-10-18 19:34:21.245344","last_fullsized":"2023-10-18 19:34:21.245344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254951","last_change":"2023-10-18 19:34:21.248032","last_active":"2023-10-18 19:34:21.254951","last_peered":"2023-10-18 19:34:21.254951","last_clean":"2023-10-18 19:34:21.254951","last_became_active":"2023-10-18 19:34:21.247196","last_became_peered":"2023-10-18 19:34:21.247196","last_unstale":"2023-10-18 19:34:21.254951","last_undegraded":"2023-10-18 19:34:21.254951","last_fullsized":"2023-10-18 19:34:21.254951","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227234","last_change":"2023-10-18 19:34:20.847408","last_active":"2023-10-18 19:34:21.227234","last_peered":"2023-10-18 19:34:21.227234","last_clean":"2023-10-18 19:34:21.227234","last_became_active":"2023-10-18 19:34:20.847100","last_became_peered":"2023-10-18 19:34:20.847100","last_unstale":"2023-10-18 19:34:21.227234","last_undegraded":"2023-10-18 19:34:21.227234","last_fullsized":"2023-10-18 19:34:21.227234","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260917","last_change":"2023-10-18 19:34:21.256724","last_active":"2023-10-18 19:34:21.260917","last_peered":"2023-10-18 19:34:21.260917","last_clean":"2023-10-18 19:34:21.260917","last_became_active":"2023-10-18 19:34:21.256252","last_became_peered":"2023-10-18 19:34:21.256252","last_unstale":"2023-10-18 19:34:21.260917","last_undegraded":"2023-10-18 19:34:21.260917","last_fullsized":"2023-10-18 19:34:21.260917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.226417","last_change":"2023-10-18 19:34:20.846959","last_active":"2023-10-18 19:34:21.226417","last_peered":"2023-10-18 19:34:21.226417","last_clean":"2023-10-18 19:34:21.226417","last_became_active":"2023-10-18 19:34:20.846541","last_became_peered":"2023-10-18 19:34:20.846541","last_unstale":"2023-10-18 19:34:21.226417","last_undegraded":"2023-10-18 19:34:21.226417","last_fullsized":"2023-10-18 19:34:21.226417","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258963","last_change":"2023-10-18 19:34:21.251998","last_active":"2023-10-18 19:34:21.258963","last_peered":"2023-10-18 19:34:21.258963","last_clean":"2023-10-18 19:34:21.258963","last_became_active":"2023-10-18 19:34:21.251641","last_became_peered":"2023-10-18 19:34:21.251641","last_unstale":"2023-10-18 19:34:21.258963","last_undegraded":"2023-10-18 19:34:21.258963","last_fullsized":"2023-10-18 19:34:21.258963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235880","last_change":"2023-10-18 19:34:20.844433","last_active":"2023-10-18 19:34:21.235880","last_peered":"2023-10-18 19:34:21.235880","last_clean":"2023-10-18 19:34:21.235880","last_became_active":"2023-10-18 19:34:20.843767","last_became_peered":"2023-10-18 19:34:20.843767","last_unstale":"2023-10-18 19:34:21.235880","last_undegraded":"2023-10-18 19:34:21.235880","last_fullsized":"2023-10-18 19:34:21.235880","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260971","last_change":"2023-10-18 19:34:21.259590","last_active":"2023-10-18 19:34:21.260971","last_peered":"2023-10-18 19:34:21.260971","last_clean":"2023-10-18 19:34:21.260971","last_became_active":"2023-10-18 19:34:21.257762","last_became_peered":"2023-10-18 19:34:21.257762","last_unstale":"2023-10-18 19:34:21.260971","last_undegraded":"2023-10-18 19:34:21.260971","last_fullsized":"2023-10-18 19:34:21.260971","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251706","last_change":"2023-10-18 19:34:20.845853","last_active":"2023-10-18 19:34:21.251706","last_peered":"2023-10-18 19:34:21.251706","last_clean":"2023-10-18 19:34:21.251706","last_became_active":"2023-10-18 19:34:20.845487","last_became_peered":"2023-10-18 19:34:20.845487","last_unstale":"2023-10-18 19:34:21.251706","last_undegraded":"2023-10-18 19:34:21.251706","last_fullsized":"2023-10-18 19:34:21.251706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261328","last_change":"2023-10-18 19:34:21.255163","last_active":"2023-10-18 19:34:21.261328","last_peered":"2023-10-18 19:34:21.261328","last_clean":"2023-10-18 19:34:21.261328","last_became_active":"2023-10-18 19:34:21.252262","last_became_peered":"2023-10-18 19:34:21.252262","last_unstale":"2023-10-18 19:34:21.261328","last_undegraded":"2023-10-18 19:34:21.261328","last_fullsized":"2023-10-18 19:34:21.261328","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238095","last_change":"2023-10-18 19:34:20.861998","last_active":"2023-10-18 19:34:21.238095","last_peered":"2023-10-18 19:34:21.238095","last_clean":"2023-10-18 19:34:21.238095","last_became_active":"2023-10-18 19:34:20.860333","last_became_peered":"2023-10-18 19:34:20.860333","last_unstale":"2023-10-18 19:34:21.238095","last_undegraded":"2023-10-18 19:34:21.238095","last_fullsized":"2023-10-18 19:34:21.238095","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267358","last_change":"2023-10-18 19:34:21.258083","last_active":"2023-10-18 19:34:21.267358","last_peered":"2023-10-18 19:34:21.267358","last_clean":"2023-10-18 19:34:21.267358","last_became_active":"2023-10-18 19:34:21.257626","last_became_peered":"2023-10-18 19:34:21.257626","last_unstale":"2023-10-18 19:34:21.267358","last_undegraded":"2023-10-18 19:34:21.267358","last_fullsized":"2023-10-18 19:34:21.267358","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227964","last_change":"2023-10-18 19:34:20.855980","last_active":"2023-10-18 19:34:21.227964","last_peered":"2023-10-18 19:34:21.227964","last_clean":"2023-10-18 19:34:21.227964","last_became_active":"2023-10-18 19:34:20.855446","last_became_peered":"2023-10-18 19:34:20.855446","last_unstale":"2023-10-18 19:34:21.227964","last_undegraded":"2023-10-18 19:34:21.227964","last_fullsized":"2023-10-18 19:34:21.227964","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273477","last_change":"2023-10-18 19:34:21.267157","last_active":"2023-10-18 19:34:21.273477","last_peered":"2023-10-18 19:34:21.273477","last_clean":"2023-10-18 19:34:21.273477","last_became_active":"2023-10-18 19:34:21.266854","last_became_peered":"2023-10-18 19:34:21.266854","last_unstale":"2023-10-18 19:34:21.273477","last_undegraded":"2023-10-18 19:34:21.273477","last_fullsized":"2023-10-18 19:34:21.273477","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223905","last_change":"2023-10-18 19:34:20.847879","last_active":"2023-10-18 19:34:21.223905","last_peered":"2023-10-18 19:34:21.223905","last_clean":"2023-10-18 19:34:21.223905","last_became_active":"2023-10-18 19:34:20.847368","last_became_peered":"2023-10-18 19:34:20.847368","last_unstale":"2023-10-18 19:34:21.223905","last_undegraded":"2023-10-18 19:34:21.223905","last_fullsized":"2023-10-18 19:34:21.223905","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274767","last_change":"2023-10-18 19:34:21.271229","last_active":"2023-10-18 19:34:21.274767","last_peered":"2023-10-18 19:34:21.274767","last_clean":"2023-10-18 19:34:21.274767","last_became_active":"2023-10-18 19:34:21.270946","last_became_peered":"2023-10-18 19:34:21.270946","last_unstale":"2023-10-18 19:34:21.274767","last_undegraded":"2023-10-18 19:34:21.274767","last_fullsized":"2023-10-18 19:34:21.274767","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237270","last_change":"2023-10-18 19:34:20.857540","last_active":"2023-10-18 19:34:21.237270","last_peered":"2023-10-18 19:34:21.237270","last_clean":"2023-10-18 19:34:21.237270","last_became_active":"2023-10-18 19:34:20.857056","last_became_peered":"2023-10-18 19:34:20.857056","last_unstale":"2023-10-18 19:34:21.237270","last_undegraded":"2023-10-18 19:34:21.237270","last_fullsized":"2023-10-18 19:34:21.237270","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270725","last_change":"2023-10-18 19:34:21.264597","last_active":"2023-10-18 19:34:21.270725","last_peered":"2023-10-18 19:34:21.270725","last_clean":"2023-10-18 19:34:21.270725","last_became_active":"2023-10-18 19:34:21.264304","last_became_peered":"2023-10-18 19:34:21.264304","last_unstale":"2023-10-18 19:34:21.270725","last_undegraded":"2023-10-18 19:34:21.270725","last_fullsized":"2023-10-18 19:34:21.270725","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235777","last_change":"2023-10-18 19:34:20.830160","last_active":"2023-10-18 19:34:21.235777","last_peered":"2023-10-18 19:34:21.235777","last_clean":"2023-10-18 19:34:21.235777","last_became_active":"2023-10-18 19:34:20.829821","last_became_peered":"2023-10-18 19:34:20.829821","last_unstale":"2023-10-18 19:34:21.235777","last_undegraded":"2023-10-18 19:34:21.235777","last_fullsized":"2023-10-18 19:34:21.235777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263547","last_change":"2023-10-18 19:34:21.250388","last_active":"2023-10-18 19:34:21.263547","last_peered":"2023-10-18 19:34:21.263547","last_clean":"2023-10-18 19:34:21.263547","last_became_active":"2023-10-18 19:34:21.250098","last_became_peered":"2023-10-18 19:34:21.250098","last_unstale":"2023-10-18 19:34:21.263547","last_undegraded":"2023-10-18 19:34:21.263547","last_fullsized":"2023-10-18 19:34:21.263547","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276405","last_change":"2023-10-18 19:34:20.857726","last_active":"2023-10-18 19:34:21.276405","last_peered":"2023-10-18 19:34:21.276405","last_clean":"2023-10-18 19:34:21.276405","last_became_active":"2023-10-18 19:34:20.856983","last_became_peered":"2023-10-18 19:34:20.856983","last_unstale":"2023-10-18 19:34:21.276405","last_undegraded":"2023-10-18 19:34:21.276405","last_fullsized":"2023-10-18 19:34:21.276405","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274573","last_change":"2023-10-18 19:34:21.270485","last_active":"2023-10-18 19:34:21.274573","last_peered":"2023-10-18 19:34:21.274573","last_clean":"2023-10-18 19:34:21.274573","last_became_active":"2023-10-18 19:34:21.270140","last_became_peered":"2023-10-18 19:34:21.270140","last_unstale":"2023-10-18 19:34:21.274573","last_undegraded":"2023-10-18 19:34:21.274573","last_fullsized":"2023-10-18 19:34:21.274573","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.242340","last_change":"2023-10-18 19:34:20.847009","last_active":"2023-10-18 19:34:21.242340","last_peered":"2023-10-18 19:34:21.242340","last_clean":"2023-10-18 19:34:21.242340","last_became_active":"2023-10-18 19:34:20.846481","last_became_peered":"2023-10-18 19:34:20.846481","last_unstale":"2023-10-18 19:34:21.242340","last_undegraded":"2023-10-18 19:34:21.242340","last_fullsized":"2023-10-18 19:34:21.242340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260964","last_change":"2023-10-18 19:34:21.256060","last_active":"2023-10-18 19:34:21.260964","last_peered":"2023-10-18 19:34:21.260964","last_clean":"2023-10-18 19:34:21.260964","last_became_active":"2023-10-18 19:34:21.255703","last_became_peered":"2023-10-18 19:34:21.255703","last_unstale":"2023-10-18 19:34:21.260964","last_undegraded":"2023-10-18 19:34:21.260964","last_fullsized":"2023-10-18 19:34:21.260964","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274523","last_change":"2023-10-18 19:34:20.849799","last_active":"2023-10-18 19:34:21.274523","last_peered":"2023-10-18 19:34:21.274523","last_clean":"2023-10-18 19:34:21.274523","last_became_active":"2023-10-18 19:34:20.849488","last_became_peered":"2023-10-18 19:34:20.849488","last_unstale":"2023-10-18 19:34:21.274523","last_undegraded":"2023-10-18 19:34:21.274523","last_fullsized":"2023-10-18 19:34:21.274523","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261345","last_change":"2023-10-18 19:34:21.260006","last_active":"2023-10-18 19:34:21.261345","last_peered":"2023-10-18 19:34:21.261345","last_clean":"2023-10-18 19:34:21.261345","last_became_active":"2023-10-18 19:34:21.259689","last_became_peered":"2023-10-18 19:34:21.259689","last_unstale":"2023-10-18 19:34:21.261345","last_undegraded":"2023-10-18 19:34:21.261345","last_fullsized":"2023-10-18 19:34:21.261345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236883","last_change":"2023-10-18 19:34:20.858108","last_active":"2023-10-18 19:34:21.236883","last_peered":"2023-10-18 19:34:21.236883","last_clean":"2023-10-18 19:34:21.236883","last_became_active":"2023-10-18 19:34:20.854784","last_became_peered":"2023-10-18 19:34:20.854784","last_unstale":"2023-10-18 19:34:21.236883","last_undegraded":"2023-10-18 19:34:21.236883","last_fullsized":"2023-10-18 19:34:21.236883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267335","last_change":"2023-10-18 19:34:21.257919","last_active":"2023-10-18 19:34:21.267335","last_peered":"2023-10-18 19:34:21.267335","last_clean":"2023-10-18 19:34:21.267335","last_became_active":"2023-10-18 19:34:21.257409","last_became_peered":"2023-10-18 19:34:21.257409","last_unstale":"2023-10-18 19:34:21.267335","last_undegraded":"2023-10-18 19:34:21.267335","last_fullsized":"2023-10-18 19:34:21.267335","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.228386","last_change":"2023-10-18 19:34:20.847577","last_active":"2023-10-18 19:34:21.228386","last_peered":"2023-10-18 19:34:21.228386","last_clean":"2023-10-18 19:34:21.228386","last_became_active":"2023-10-18 19:34:20.842013","last_became_peered":"2023-10-18 19:34:20.842013","last_unstale":"2023-10-18 19:34:21.228386","last_undegraded":"2023-10-18 19:34:21.228386","last_fullsized":"2023-10-18 19:34:21.228386","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258434","last_change":"2023-10-18 19:34:21.251747","last_active":"2023-10-18 19:34:21.258434","last_peered":"2023-10-18 19:34:21.258434","last_clean":"2023-10-18 19:34:21.258434","last_became_active":"2023-10-18 19:34:21.251325","last_became_peered":"2023-10-18 19:34:21.251325","last_unstale":"2023-10-18 19:34:21.258434","last_undegraded":"2023-10-18 19:34:21.258434","last_fullsized":"2023-10-18 19:34:21.258434","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267344","last_change":"2023-10-18 19:34:20.832572","last_active":"2023-10-18 19:34:21.267344","last_peered":"2023-10-18 19:34:21.267344","last_clean":"2023-10-18 19:34:21.267344","last_became_active":"2023-10-18 19:34:20.832216","last_became_peered":"2023-10-18 19:34:20.832216","last_unstale":"2023-10-18 19:34:21.267344","last_undegraded":"2023-10-18 19:34:21.267344","last_fullsized":"2023-10-18 19:34:21.267344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276296","last_change":"2023-10-18 19:34:21.272247","last_active":"2023-10-18 19:34:21.276296","last_peered":"2023-10-18 19:34:21.276296","last_clean":"2023-10-18 19:34:21.276296","last_became_active":"2023-10-18 19:34:21.271930","last_became_peered":"2023-10-18 19:34:21.271930","last_unstale":"2023-10-18 19:34:21.276296","last_undegraded":"2023-10-18 19:34:21.276296","last_fullsized":"2023-10-18 19:34:21.276296","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235502","last_change":"2023-10-18 19:34:20.840841","last_active":"2023-10-18 19:34:21.235502","last_peered":"2023-10-18 19:34:21.235502","last_clean":"2023-10-18 19:34:21.235502","last_became_active":"2023-10-18 19:34:20.840351","last_became_peered":"2023-10-18 19:34:20.840351","last_unstale":"2023-10-18 19:34:21.235502","last_undegraded":"2023-10-18 19:34:21.235502","last_fullsized":"2023-10-18 19:34:21.235502","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262872","last_change":"2023-10-18 19:34:21.258445","last_active":"2023-10-18 19:34:21.262872","last_peered":"2023-10-18 19:34:21.262872","last_clean":"2023-10-18 19:34:21.262872","last_became_active":"2023-10-18 19:34:21.257747","last_became_peered":"2023-10-18 19:34:21.257747","last_unstale":"2023-10-18 19:34:21.262872","last_undegraded":"2023-10-18 19:34:21.262872","last_fullsized":"2023-10-18 19:34:21.262872","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.233329","last_change":"2023-10-18 19:34:20.856638","last_active":"2023-10-18 19:34:21.233329","last_peered":"2023-10-18 19:34:21.233329","last_clean":"2023-10-18 19:34:21.233329","last_became_active":"2023-10-18 19:34:20.856094","last_became_peered":"2023-10-18 19:34:20.856094","last_unstale":"2023-10-18 19:34:21.233329","last_undegraded":"2023-10-18 19:34:21.233329","last_fullsized":"2023-10-18 19:34:21.233329","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254821","last_change":"2023-10-18 19:34:21.249180","last_active":"2023-10-18 19:34:21.254821","last_peered":"2023-10-18 19:34:21.254821","last_clean":"2023-10-18 19:34:21.254821","last_became_active":"2023-10-18 19:34:21.245370","last_became_peered":"2023-10-18 19:34:21.245370","last_unstale":"2023-10-18 19:34:21.254821","last_undegraded":"2023-10-18 19:34:21.254821","last_fullsized":"2023-10-18 19:34:21.254821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.265777","last_change":"2023-10-18 19:34:20.823278","last_active":"2023-10-18 19:34:21.265777","last_peered":"2023-10-18 19:34:21.265777","last_clean":"2023-10-18 19:34:21.265777","last_became_active":"2023-10-18 19:34:20.823003","last_became_peered":"2023-10-18 19:34:20.823003","last_unstale":"2023-10-18 19:34:21.265777","last_undegraded":"2023-10-18 19:34:21.265777","last_fullsized":"2023-10-18 19:34:21.265777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253391","last_change":"2023-10-18 19:34:21.246335","last_active":"2023-10-18 19:34:21.253391","last_peered":"2023-10-18 19:34:21.253391","last_clean":"2023-10-18 19:34:21.253391","last_became_active":"2023-10-18 19:34:21.246040","last_became_peered":"2023-10-18 19:34:21.246040","last_unstale":"2023-10-18 19:34:21.253391","last_undegraded":"2023-10-18 19:34:21.253391","last_fullsized":"2023-10-18 19:34:21.253391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273867","last_change":"2023-10-18 19:34:20.855032","last_active":"2023-10-18 19:34:21.273867","last_peered":"2023-10-18 19:34:21.273867","last_clean":"2023-10-18 19:34:21.273867","last_became_active":"2023-10-18 19:34:20.854673","last_became_peered":"2023-10-18 19:34:20.854673","last_unstale":"2023-10-18 19:34:21.273867","last_undegraded":"2023-10-18 19:34:21.273867","last_fullsized":"2023-10-18 19:34:21.273867","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.259565","last_change":"2023-10-18 19:34:21.254232","last_active":"2023-10-18 19:34:21.259565","last_peered":"2023-10-18 19:34:21.259565","last_clean":"2023-10-18 19:34:21.259565","last_became_active":"2023-10-18 19:34:21.253932","last_became_peered":"2023-10-18 19:34:21.253932","last_unstale":"2023-10-18 19:34:21.259565","last_undegraded":"2023-10-18 19:34:21.259565","last_fullsized":"2023-10-18 19:34:21.259565","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236496","last_change":"2023-10-18 19:34:20.855559","last_active":"2023-10-18 19:34:21.236496","last_peered":"2023-10-18 19:34:21.236496","last_clean":"2023-10-18 19:34:21.236496","last_became_active":"2023-10-18 19:34:20.854845","last_became_peered":"2023-10-18 19:34:20.854845","last_unstale":"2023-10-18 19:34:21.236496","last_undegraded":"2023-10-18 19:34:21.236496","last_fullsized":"2023-10-18 19:34:21.236496","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262693","last_change":"2023-10-18 19:34:21.248190","last_active":"2023-10-18 19:34:21.262693","last_peered":"2023-10-18 19:34:21.262693","last_clean":"2023-10-18 19:34:21.262693","last_became_active":"2023-10-18 19:34:21.247102","last_became_peered":"2023-10-18 19:34:21.247102","last_unstale":"2023-10-18 19:34:21.262693","last_undegraded":"2023-10-18 19:34:21.262693","last_fullsized":"2023-10-18 19:34:21.262693","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236683","last_change":"2023-10-18 19:34:20.857956","last_active":"2023-10-18 19:34:21.236683","last_peered":"2023-10-18 19:34:21.236683","last_clean":"2023-10-18 19:34:21.236683","last_became_active":"2023-10-18 19:34:20.855051","last_became_peered":"2023-10-18 19:34:20.855051","last_unstale":"2023-10-18 19:34:21.236683","last_undegraded":"2023-10-18 19:34:21.236683","last_fullsized":"2023-10-18 19:34:21.236683","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270992","last_change":"2023-10-18 19:34:21.266700","last_active":"2023-10-18 19:34:21.270992","last_peered":"2023-10-18 19:34:21.270992","last_clean":"2023-10-18 19:34:21.270992","last_became_active":"2023-10-18 19:34:21.266409","last_became_peered":"2023-10-18 19:34:21.266409","last_unstale":"2023-10-18 19:34:21.270992","last_undegraded":"2023-10-18 19:34:21.270992","last_fullsized":"2023-10-18 19:34:21.270992","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238606","last_change":"2023-10-18 19:34:20.851465","last_active":"2023-10-18 19:34:21.238606","last_peered":"2023-10-18 19:34:21.238606","last_clean":"2023-10-18 19:34:21.238606","last_became_active":"2023-10-18 19:34:20.851166","last_became_peered":"2023-10-18 19:34:20.851166","last_unstale":"2023-10-18 19:34:21.238606","last_undegraded":"2023-10-18 19:34:21.238606","last_fullsized":"2023-10-18 19:34:21.238606","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253575","last_change":"2023-10-18 19:34:21.245529","last_active":"2023-10-18 19:34:21.253575","last_peered":"2023-10-18 19:34:21.253575","last_clean":"2023-10-18 19:34:21.253575","last_became_active":"2023-10-18 19:34:21.245217","last_became_peered":"2023-10-18 19:34:21.245217","last_unstale":"2023-10-18 19:34:21.253575","last_undegraded":"2023-10-18 19:34:21.253575","last_fullsized":"2023-10-18 19:34:21.253575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236484","last_change":"2023-10-18 19:34:20.837517","last_active":"2023-10-18 19:34:21.236484","last_peered":"2023-10-18 19:34:21.236484","last_clean":"2023-10-18 19:34:21.236484","last_became_active":"2023-10-18 19:34:20.837192","last_became_peered":"2023-10-18 19:34:20.837192","last_unstale":"2023-10-18 19:34:21.236484","last_undegraded":"2023-10-18 19:34:21.236484","last_fullsized":"2023-10-18 19:34:21.236484","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271163","last_change":"2023-10-18 19:34:21.262649","last_active":"2023-10-18 19:34:21.271163","last_peered":"2023-10-18 19:34:21.271163","last_clean":"2023-10-18 19:34:21.271163","last_became_active":"2023-10-18 19:34:21.262175","last_became_peered":"2023-10-18 19:34:21.262175","last_unstale":"2023-10-18 19:34:21.271163","last_undegraded":"2023-10-18 19:34:21.271163","last_fullsized":"2023-10-18 19:34:21.271163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237168","last_change":"2023-10-18 19:34:20.821558","last_active":"2023-10-18 19:34:21.237168","last_peered":"2023-10-18 19:34:21.237168","last_clean":"2023-10-18 19:34:21.237168","last_became_active":"2023-10-18 19:34:20.821225","last_became_peered":"2023-10-18 19:34:20.821225","last_unstale":"2023-10-18 19:34:21.237168","last_undegraded":"2023-10-18 19:34:21.237168","last_fullsized":"2023-10-18 19:34:21.237168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272370","last_change":"2023-10-18 19:34:21.268630","last_active":"2023-10-18 19:34:21.272370","last_peered":"2023-10-18 19:34:21.272370","last_clean":"2023-10-18 19:34:21.272370","last_became_active":"2023-10-18 19:34:21.268347","last_became_peered":"2023-10-18 19:34:21.268347","last_unstale":"2023-10-18 19:34:21.272370","last_undegraded":"2023-10-18 19:34:21.272370","last_fullsized":"2023-10-18 19:34:21.272370","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276681","last_change":"2023-10-18 19:34:20.856427","last_active":"2023-10-18 19:34:21.276681","last_peered":"2023-10-18 19:34:21.276681","last_clean":"2023-10-18 19:34:21.276681","last_became_active":"2023-10-18 19:34:20.855877","last_became_peered":"2023-10-18 19:34:20.855877","last_unstale":"2023-10-18 19:34:21.276681","last_undegraded":"2023-10-18 19:34:21.276681","last_fullsized":"2023-10-18 19:34:21.276681","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267065","last_change":"2023-10-18 19:34:21.259142","last_active":"2023-10-18 19:34:21.267065","last_peered":"2023-10-18 19:34:21.267065","last_clean":"2023-10-18 19:34:21.267065","last_became_active":"2023-10-18 19:34:21.258709","last_became_peered":"2023-10-18 19:34:21.258709","last_unstale":"2023-10-18 19:34:21.267065","last_undegraded":"2023-10-18 19:34:21.267065","last_fullsized":"2023-10-18 19:34:21.267065","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260963","last_change":"2023-10-18 19:34:20.861616","last_active":"2023-10-18 19:34:21.260963","last_peered":"2023-10-18 19:34:21.260963","last_clean":"2023-10-18 19:34:21.260963","last_became_active":"2023-10-18 19:34:20.861363","last_became_peered":"2023-10-18 19:34:20.861363","last_unstale":"2023-10-18 19:34:21.260963","last_undegraded":"2023-10-18 19:34:21.260963","last_fullsized":"2023-10-18 19:34:21.260963","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272280","last_change":"2023-10-18 19:34:21.267981","last_active":"2023-10-18 19:34:21.272280","last_peered":"2023-10-18 19:34:21.272280","last_clean":"2023-10-18 19:34:21.272280","last_became_active":"2023-10-18 19:34:21.267584","last_became_peered":"2023-10-18 19:34:21.267584","last_unstale":"2023-10-18 19:34:21.272280","last_undegraded":"2023-10-18 19:34:21.272280","last_fullsized":"2023-10-18 19:34:21.272280","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261640","last_change":"2023-10-18 19:34:20.855045","last_active":"2023-10-18 19:34:21.261640","last_peered":"2023-10-18 19:34:21.261640","last_clean":"2023-10-18 19:34:21.261640","last_became_active":"2023-10-18 19:34:20.854724","last_became_peered":"2023-10-18 19:34:20.854724","last_unstale":"2023-10-18 19:34:21.261640","last_undegraded":"2023-10-18 19:34:21.261640","last_fullsized":"2023-10-18 19:34:21.261640","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.269720","last_change":"2023-10-18 19:34:21.262741","last_active":"2023-10-18 19:34:21.269720","last_peered":"2023-10-18 19:34:21.269720","last_clean":"2023-10-18 19:34:21.269720","last_became_active":"2023-10-18 19:34:21.262435","last_became_peered":"2023-10-18 19:34:21.262435","last_unstale":"2023-10-18 19:34:21.269720","last_undegraded":"2023-10-18 19:34:21.269720","last_fullsized":"2023-10-18 19:34:21.269720","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236324","last_change":"2023-10-18 19:34:20.850195","last_active":"2023-10-18 19:34:21.236324","last_peered":"2023-10-18 19:34:21.236324","last_clean":"2023-10-18 19:34:21.236324","last_became_active":"2023-10-18 19:34:20.849885","last_became_peered":"2023-10-18 19:34:20.849885","last_unstale":"2023-10-18 19:34:21.236324","last_undegraded":"2023-10-18 19:34:21.236324","last_fullsized":"2023-10-18 19:34:21.236324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254998","last_change":"2023-10-18 19:34:21.248730","last_active":"2023-10-18 19:34:21.254998","last_peered":"2023-10-18 19:34:21.254998","last_clean":"2023-10-18 19:34:21.254998","last_became_active":"2023-10-18 19:34:21.248420","last_became_peered":"2023-10-18 19:34:21.248420","last_unstale":"2023-10-18 19:34:21.254998","last_undegraded":"2023-10-18 19:34:21.254998","last_fullsized":"2023-10-18 19:34:21.254998","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238187","last_change":"2023-10-18 19:34:20.862008","last_active":"2023-10-18 19:34:21.238187","last_peered":"2023-10-18 19:34:21.238187","last_clean":"2023-10-18 19:34:21.238187","last_became_active":"2023-10-18 19:34:20.858973","last_became_peered":"2023-10-18 19:34:20.858973","last_unstale":"2023-10-18 19:34:21.238187","last_undegraded":"2023-10-18 19:34:21.238187","last_fullsized":"2023-10-18 19:34:21.238187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264920","last_change":"2023-10-18 19:34:21.259920","last_active":"2023-10-18 19:34:21.264920","last_peered":"2023-10-18 19:34:21.264920","last_clean":"2023-10-18 19:34:21.264920","last_became_active":"2023-10-18 19:34:21.259474","last_became_peered":"2023-10-18 19:34:21.259474","last_unstale":"2023-10-18 19:34:21.264920","last_undegraded":"2023-10-18 19:34:21.264920","last_fullsized":"2023-10-18 19:34:21.264920","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263166","last_change":"2023-10-18 19:34:20.842664","last_active":"2023-10-18 19:34:21.263166","last_peered":"2023-10-18 19:34:21.263166","last_clean":"2023-10-18 19:34:21.263166","last_became_active":"2023-10-18 19:34:20.842341","last_became_peered":"2023-10-18 19:34:20.842341","last_unstale":"2023-10-18 19:34:21.263166","last_undegraded":"2023-10-18 19:34:21.263166","last_fullsized":"2023-10-18 19:34:21.263166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":37959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048724,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323116,"statfs":{"total":96636764160,"available":95562870784,"internally_reserved":1073741824,"allocated":143360,"data_stored":36943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048728,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323112,"statfs":{"total":96636764160,"available":95562866688,"internally_reserved":1073741824,"allocated":147456,"data_stored":37731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048724,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323116,"statfs":{"total":96636764160,"available":95562870784,"internally_reserved":1073741824,"allocated":143360,"data_stored":36895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]}]}} 2023-10-18T19:34:26.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:34:26.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 Processor -- start 2023-10-18T19:34:26.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 -- start start 2023-10-18T19:34:26.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 0x7f29641b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 0x7f29641bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2964115fb0 con 0x7f2964115b60 2023-10-18T19:34:26.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296410f530 con 0x7f29641ba360 2023-10-18T19:34:26.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.578 7f2969dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29641151a0 con 0x7f29640f1ce0 2023-10-18T19:34:26.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f2961ffe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2964115b60 0x7f29640f14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52016/0 (socket says 172.21.15.88:52016) 2023-10-18T19:34:26.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f2961ffe700 1 -- 172.21.15.88:0/3260447378 learned_addr learned my addr 172.21.15.88:0/3260447378 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:26.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 --2- 172.21.15.88:0/3260447378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 0x7f29641b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f29627ff700 1 --2- 172.21.15.88:0/3260447378 >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 0x7f29641bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 -- 172.21.15.88:0/3260447378 >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 msgr2=0x7f29641bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:26.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 --2- 172.21.15.88:0/3260447378 >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 0x7f29641bc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 -- 172.21.15.88:0/3260447378 >> v1:172.21.15.88:6789/0 conn(0x7f2964115b60 legacy=0x7f29640f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 -- 172.21.15.88:0/3260447378 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296410f9d0 con 0x7f29640f1ce0 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f29627ff700 1 --2- 172.21.15.88:0/3260447378 >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 0x7f29641bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.579 7f295bfff700 1 --2- 172.21.15.88:0/3260447378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 0x7f29641b9d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c00b970).ready entity=mon.1 client_cookie=953c3312718b9f78 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f29617fd700 1 -- 172.21.15.88:0/3260447378 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f294c00d5c0 con 0x7f29640f1ce0 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f29617fd700 1 -- 172.21.15.88:0/3260447378 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00d7c0 con 0x7f29640f1ce0 2023-10-18T19:34:26.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f29617fd700 1 -- 172.21.15.88:0/3260447378 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f294c00db90 con 0x7f29640f1ce0 2023-10-18T19:34:26.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 -- 172.21.15.88:0/3260447378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 msgr2=0x7f29641b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 --2- 172.21.15.88:0/3260447378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 0x7f29641b9d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c00b970).stop 2023-10-18T19:34:26.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 -- 172.21.15.88:0/3260447378 shutdown_connections 2023-10-18T19:34:26.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 --2- 172.21.15.88:0/3260447378 >> v2:172.21.15.88:3300/0 conn(0x7f29641ba360 0x7f29641bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 --2- 172.21.15.88:0/3260447378 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640f1ce0 0x7f29641b9d30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 -- 172.21.15.88:0/3260447378 >> 172.21.15.88:0/3260447378 conn(0x7f2964117390 msgr2=0x7f29640f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:26.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 -- 172.21.15.88:0/3260447378 shutdown_connections 2023-10-18T19:34:26.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.580 7f2969dff700 1 -- 172.21.15.88:0/3260447378 wait complete. 2023-10-18T19:34:26.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 Processor -- start 2023-10-18T19:34:26.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 -- start start 2023-10-18T19:34:26.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 0x7f29640ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29640ce680 0x7f29641c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 0x7f29641c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640d25b0 con 0x7f29640cead0 2023-10-18T19:34:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29641c3ad0 con 0x7f29640d5df0 2023-10-18T19:34:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.605 7f2969dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29640bb940 con 0x7f29640ce680 2023-10-18T19:34:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f2961ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 0x7f29640ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 0x7f29641c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f295bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29640ce680 0x7f29641c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f2961ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 0x7f29640ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44334/0 (socket says 172.21.15.88:44334) 2023-10-18T19:34:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f2961ffe700 1 -- 172.21.15.88:0/615952693 learned_addr learned my addr 172.21.15.88:0/615952693 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 -- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29640ce680 msgr2=0x7f29641c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29640ce680 0x7f29641c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 -- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 msgr2=0x7f29640ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 0x7f29640ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 -- 172.21.15.88:0/615952693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640d2310 con 0x7f29640cead0 2023-10-18T19:34:26.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.606 7f29627ff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 0x7f29641c64e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f29640e0d40 tx=0x7f295c00ed70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29640d2310 con 0x7f29640cead0 2023-10-18T19:34:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00c880 con 0x7f29640cead0 2023-10-18T19:34:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f295c00f040 con 0x7f29640cead0 2023-10-18T19:34:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f2969dff700 1 -- 172.21.15.88:0/615952693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29640d6240 con 0x7f29640cead0 2023-10-18T19:34:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f2969dff700 1 -- 172.21.15.88:0/615952693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29641c6b10 con 0x7f29640cead0 2023-10-18T19:34:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.607 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f295c022060 con 0x7f29640cead0 2023-10-18T19:34:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.608 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f295c010040 con 0x7f29640cead0 2023-10-18T19:34:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.608 7f2969dff700 1 -- 172.21.15.88:0/615952693 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29640f0530 con 0x7f29640cead0 2023-10-18T19:34:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.611 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f295c00c670 con 0x7f29640cead0 2023-10-18T19:34:26.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.705 7f2969dff700 1 -- 172.21.15.88:0/615952693 --> v1:172.21.15.88:6800/107321 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f29640882a0 con 0x7f294801c1b0 2023-10-18T19:34:26.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.713 7f295affd700 1 -- 172.21.15.88:0/615952693 <== mgr.4110 v1:172.21.15.88:6800/107321 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306121 (unknown 2965378022 0 3514325572) 0x7f2954001230 con 0x7f294801c1b0 2023-10-18T19:34:26.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:26.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.716 7f2969dff700 1 -- 172.21.15.88:0/615952693 >> v1:172.21.15.88:6800/107321 conn(0x7f294801c1b0 legacy=0x7f294801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.716 7f2969dff700 1 -- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 msgr2=0x7f29641c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.716 7f2969dff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 0x7f29641c64e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f29640e0d40 tx=0x7f295c00ed70).stop 2023-10-18T19:34:26.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 -- 172.21.15.88:0/615952693 shutdown_connections 2023-10-18T19:34:26.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29640cead0 0x7f29641c64e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29640d5df0 0x7f29640ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 --2- 172.21.15.88:0/615952693 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29640ce680 0x7f29641c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 -- 172.21.15.88:0/615952693 >> 172.21.15.88:0/615952693 conn(0x7f2964121070 msgr2=0x7f29640d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:26.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 -- 172.21.15.88:0/615952693 shutdown_connections 2023-10-18T19:34:26.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.717 7f2969dff700 1 -- 172.21.15.88:0/615952693 wait complete. 2023-10-18T19:34:26.726 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:34:26.735 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-18 19:34:25.945706","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194912,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292448,"statfs":{"total":386547056640,"available":382251466752,"internally_reserved":4294967296,"allocated":589824,"data_stored":149528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000437"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272531","last_change":"2023-10-18 19:34:21.266064","last_active":"2023-10-18 19:34:21.272531","last_peered":"2023-10-18 19:34:21.272531","last_clean":"2023-10-18 19:34:21.272531","last_became_active":"2023-10-18 19:34:21.265745","last_became_peered":"2023-10-18 19:34:21.265745","last_unstale":"2023-10-18 19:34:21.272531","last_undegraded":"2023-10-18 19:34:21.272531","last_fullsized":"2023-10-18 19:34:21.272531","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225960","last_change":"2023-10-18 19:34:20.848544","last_active":"2023-10-18 19:34:21.225960","last_peered":"2023-10-18 19:34:21.225960","last_clean":"2023-10-18 19:34:21.225960","last_became_active":"2023-10-18 19:34:20.848186","last_became_peered":"2023-10-18 19:34:20.848186","last_unstale":"2023-10-18 19:34:21.225960","last_undegraded":"2023-10-18 19:34:21.225960","last_fullsized":"2023-10-18 19:34:21.225960","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254972","last_change":"2023-10-18 19:34:21.249452","last_active":"2023-10-18 19:34:21.254972","last_peered":"2023-10-18 19:34:21.254972","last_clean":"2023-10-18 19:34:21.254972","last_became_active":"2023-10-18 19:34:21.249103","last_became_peered":"2023-10-18 19:34:21.249103","last_unstale":"2023-10-18 19:34:21.254972","last_undegraded":"2023-10-18 19:34:21.254972","last_fullsized":"2023-10-18 19:34:21.254972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227163","last_change":"2023-10-18 19:34:20.835459","last_active":"2023-10-18 19:34:21.227163","last_peered":"2023-10-18 19:34:21.227163","last_clean":"2023-10-18 19:34:21.227163","last_became_active":"2023-10-18 19:34:20.835145","last_became_peered":"2023-10-18 19:34:20.835145","last_unstale":"2023-10-18 19:34:21.227163","last_undegraded":"2023-10-18 19:34:21.227163","last_fullsized":"2023-10-18 19:34:21.227163","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271140","last_change":"2023-10-18 19:34:21.262486","last_active":"2023-10-18 19:34:21.271140","last_peered":"2023-10-18 19:34:21.271140","last_clean":"2023-10-18 19:34:21.271140","last_became_active":"2023-10-18 19:34:21.261956","last_became_peered":"2023-10-18 19:34:21.261956","last_unstale":"2023-10-18 19:34:21.271140","last_undegraded":"2023-10-18 19:34:21.271140","last_fullsized":"2023-10-18 19:34:21.271140","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227255","last_change":"2023-10-18 19:34:20.854649","last_active":"2023-10-18 19:34:21.227255","last_peered":"2023-10-18 19:34:21.227255","last_clean":"2023-10-18 19:34:21.227255","last_became_active":"2023-10-18 19:34:20.854333","last_became_peered":"2023-10-18 19:34:20.854333","last_unstale":"2023-10-18 19:34:21.227255","last_undegraded":"2023-10-18 19:34:21.227255","last_fullsized":"2023-10-18 19:34:21.227255","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.257946","last_change":"2023-10-18 19:34:21.246025","last_active":"2023-10-18 19:34:21.257946","last_peered":"2023-10-18 19:34:21.257946","last_clean":"2023-10-18 19:34:21.257946","last_became_active":"2023-10-18 19:34:21.245735","last_became_peered":"2023-10-18 19:34:21.245735","last_unstale":"2023-10-18 19:34:21.257946","last_undegraded":"2023-10-18 19:34:21.257946","last_fullsized":"2023-10-18 19:34:21.257946","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223152","last_change":"2023-10-18 19:34:20.853312","last_active":"2023-10-18 19:34:21.223152","last_peered":"2023-10-18 19:34:21.223152","last_clean":"2023-10-18 19:34:21.223152","last_became_active":"2023-10-18 19:34:20.852964","last_became_peered":"2023-10-18 19:34:20.852964","last_unstale":"2023-10-18 19:34:21.223152","last_undegraded":"2023-10-18 19:34:21.223152","last_fullsized":"2023-10-18 19:34:21.223152","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271780","last_change":"2023-10-18 19:34:21.265408","last_active":"2023-10-18 19:34:21.271780","last_peered":"2023-10-18 19:34:21.271780","last_clean":"2023-10-18 19:34:21.271780","last_became_active":"2023-10-18 19:34:21.265029","last_became_peered":"2023-10-18 19:34:21.265029","last_unstale":"2023-10-18 19:34:21.271780","last_undegraded":"2023-10-18 19:34:21.271780","last_fullsized":"2023-10-18 19:34:21.271780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237708","last_change":"2023-10-18 19:34:20.825709","last_active":"2023-10-18 19:34:21.237708","last_peered":"2023-10-18 19:34:21.237708","last_clean":"2023-10-18 19:34:21.237708","last_became_active":"2023-10-18 19:34:20.825364","last_became_peered":"2023-10-18 19:34:20.825364","last_unstale":"2023-10-18 19:34:21.237708","last_undegraded":"2023-10-18 19:34:21.237708","last_fullsized":"2023-10-18 19:34:21.237708","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.255066","last_change":"2023-10-18 19:34:21.250032","last_active":"2023-10-18 19:34:21.255066","last_peered":"2023-10-18 19:34:21.255066","last_clean":"2023-10-18 19:34:21.255066","last_became_active":"2023-10-18 19:34:21.245104","last_became_peered":"2023-10-18 19:34:21.245104","last_unstale":"2023-10-18 19:34:21.255066","last_undegraded":"2023-10-18 19:34:21.255066","last_fullsized":"2023-10-18 19:34:21.255066","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237886","last_change":"2023-10-18 19:34:20.862583","last_active":"2023-10-18 19:34:21.237886","last_peered":"2023-10-18 19:34:21.237886","last_clean":"2023-10-18 19:34:21.237886","last_became_active":"2023-10-18 19:34:20.862262","last_became_peered":"2023-10-18 19:34:20.862262","last_unstale":"2023-10-18 19:34:21.237886","last_undegraded":"2023-10-18 19:34:21.237886","last_fullsized":"2023-10-18 19:34:21.237886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271127","last_change":"2023-10-18 19:34:21.265750","last_active":"2023-10-18 19:34:21.271127","last_peered":"2023-10-18 19:34:21.271127","last_clean":"2023-10-18 19:34:21.271127","last_became_active":"2023-10-18 19:34:21.265449","last_became_peered":"2023-10-18 19:34:21.265449","last_unstale":"2023-10-18 19:34:21.271127","last_undegraded":"2023-10-18 19:34:21.271127","last_fullsized":"2023-10-18 19:34:21.271127","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264519","last_change":"2023-10-18 19:34:20.855201","last_active":"2023-10-18 19:34:21.264519","last_peered":"2023-10-18 19:34:21.264519","last_clean":"2023-10-18 19:34:21.264519","last_became_active":"2023-10-18 19:34:20.854344","last_became_peered":"2023-10-18 19:34:20.854344","last_unstale":"2023-10-18 19:34:21.264519","last_undegraded":"2023-10-18 19:34:21.264519","last_fullsized":"2023-10-18 19:34:21.264519","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254841","last_change":"2023-10-18 19:34:21.249688","last_active":"2023-10-18 19:34:21.254841","last_peered":"2023-10-18 19:34:21.254841","last_clean":"2023-10-18 19:34:21.254841","last_became_active":"2023-10-18 19:34:21.246078","last_became_peered":"2023-10-18 19:34:21.246078","last_unstale":"2023-10-18 19:34:21.254841","last_undegraded":"2023-10-18 19:34:21.254841","last_fullsized":"2023-10-18 19:34:21.254841","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279052","last_change":"2023-10-18 19:34:20.857791","last_active":"2023-10-18 19:34:21.279052","last_peered":"2023-10-18 19:34:21.279052","last_clean":"2023-10-18 19:34:21.279052","last_became_active":"2023-10-18 19:34:20.857489","last_became_peered":"2023-10-18 19:34:20.857489","last_unstale":"2023-10-18 19:34:21.279052","last_undegraded":"2023-10-18 19:34:21.279052","last_fullsized":"2023-10-18 19:34:21.279052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253320","last_change":"2023-10-18 19:34:21.245879","last_active":"2023-10-18 19:34:21.253320","last_peered":"2023-10-18 19:34:21.253320","last_clean":"2023-10-18 19:34:21.253320","last_became_active":"2023-10-18 19:34:21.245587","last_became_peered":"2023-10-18 19:34:21.245587","last_unstale":"2023-10-18 19:34:21.253320","last_undegraded":"2023-10-18 19:34:21.253320","last_fullsized":"2023-10-18 19:34:21.253320","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273782","last_change":"2023-10-18 19:34:20.857559","last_active":"2023-10-18 19:34:21.273782","last_peered":"2023-10-18 19:34:21.273782","last_clean":"2023-10-18 19:34:21.273782","last_became_active":"2023-10-18 19:34:20.857227","last_became_peered":"2023-10-18 19:34:20.857227","last_unstale":"2023-10-18 19:34:21.273782","last_undegraded":"2023-10-18 19:34:21.273782","last_fullsized":"2023-10-18 19:34:21.273782","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262911","last_change":"2023-10-18 19:34:21.258745","last_active":"2023-10-18 19:34:21.262911","last_peered":"2023-10-18 19:34:21.262911","last_clean":"2023-10-18 19:34:21.262911","last_became_active":"2023-10-18 19:34:21.258295","last_became_peered":"2023-10-18 19:34:21.258295","last_unstale":"2023-10-18 19:34:21.262911","last_undegraded":"2023-10-18 19:34:21.262911","last_fullsized":"2023-10-18 19:34:21.262911","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227006","last_change":"2023-10-18 19:34:20.836255","last_active":"2023-10-18 19:34:21.227006","last_peered":"2023-10-18 19:34:21.227006","last_clean":"2023-10-18 19:34:21.227006","last_became_active":"2023-10-18 19:34:20.835941","last_became_peered":"2023-10-18 19:34:20.835941","last_unstale":"2023-10-18 19:34:21.227006","last_undegraded":"2023-10-18 19:34:21.227006","last_fullsized":"2023-10-18 19:34:21.227006","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262394","last_change":"2023-10-18 19:34:21.253538","last_active":"2023-10-18 19:34:21.262394","last_peered":"2023-10-18 19:34:21.262394","last_clean":"2023-10-18 19:34:21.262394","last_became_active":"2023-10-18 19:34:21.253274","last_became_peered":"2023-10-18 19:34:21.253274","last_unstale":"2023-10-18 19:34:21.262394","last_undegraded":"2023-10-18 19:34:21.262394","last_fullsized":"2023-10-18 19:34:21.262394","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235274","last_change":"2023-10-18 19:34:20.857139","last_active":"2023-10-18 19:34:21.235274","last_peered":"2023-10-18 19:34:21.235274","last_clean":"2023-10-18 19:34:21.235274","last_became_active":"2023-10-18 19:34:20.856766","last_became_peered":"2023-10-18 19:34:20.856766","last_unstale":"2023-10-18 19:34:21.235274","last_undegraded":"2023-10-18 19:34:21.235274","last_fullsized":"2023-10-18 19:34:21.235274","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276422","last_change":"2023-10-18 19:34:21.272980","last_active":"2023-10-18 19:34:21.276422","last_peered":"2023-10-18 19:34:21.276422","last_clean":"2023-10-18 19:34:21.276422","last_became_active":"2023-10-18 19:34:21.272618","last_became_peered":"2023-10-18 19:34:21.272618","last_unstale":"2023-10-18 19:34:21.276422","last_undegraded":"2023-10-18 19:34:21.276422","last_fullsized":"2023-10-18 19:34:21.276422","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276732","last_change":"2023-10-18 19:34:20.828547","last_active":"2023-10-18 19:34:21.276732","last_peered":"2023-10-18 19:34:21.276732","last_clean":"2023-10-18 19:34:21.276732","last_became_active":"2023-10-18 19:34:20.828036","last_became_peered":"2023-10-18 19:34:20.828036","last_unstale":"2023-10-18 19:34:21.276732","last_undegraded":"2023-10-18 19:34:21.276732","last_fullsized":"2023-10-18 19:34:21.276732","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271801","last_change":"2023-10-18 19:34:21.265823","last_active":"2023-10-18 19:34:21.271801","last_peered":"2023-10-18 19:34:21.271801","last_clean":"2023-10-18 19:34:21.271801","last_became_active":"2023-10-18 19:34:21.265276","last_became_peered":"2023-10-18 19:34:21.265276","last_unstale":"2023-10-18 19:34:21.271801","last_undegraded":"2023-10-18 19:34:21.271801","last_fullsized":"2023-10-18 19:34:21.271801","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.268602","last_change":"2023-10-18 19:34:20.856792","last_active":"2023-10-18 19:34:21.268602","last_peered":"2023-10-18 19:34:21.268602","last_clean":"2023-10-18 19:34:21.268602","last_became_active":"2023-10-18 19:34:20.856486","last_became_peered":"2023-10-18 19:34:20.856486","last_unstale":"2023-10-18 19:34:21.268602","last_undegraded":"2023-10-18 19:34:21.268602","last_fullsized":"2023-10-18 19:34:21.268602","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270893","last_change":"2023-10-18 19:34:21.265884","last_active":"2023-10-18 19:34:21.270893","last_peered":"2023-10-18 19:34:21.270893","last_clean":"2023-10-18 19:34:21.270893","last_became_active":"2023-10-18 19:34:21.265564","last_became_peered":"2023-10-18 19:34:21.265564","last_unstale":"2023-10-18 19:34:21.270893","last_undegraded":"2023-10-18 19:34:21.270893","last_fullsized":"2023-10-18 19:34:21.270893","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279112","last_change":"2023-10-18 19:34:20.858811","last_active":"2023-10-18 19:34:21.279112","last_peered":"2023-10-18 19:34:21.279112","last_clean":"2023-10-18 19:34:21.279112","last_became_active":"2023-10-18 19:34:20.858481","last_became_peered":"2023-10-18 19:34:20.858481","last_unstale":"2023-10-18 19:34:21.279112","last_undegraded":"2023-10-18 19:34:21.279112","last_fullsized":"2023-10-18 19:34:21.279112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254341","last_change":"2023-10-18 19:34:21.246195","last_active":"2023-10-18 19:34:21.254341","last_peered":"2023-10-18 19:34:21.254341","last_clean":"2023-10-18 19:34:21.254341","last_became_active":"2023-10-18 19:34:21.245896","last_became_peered":"2023-10-18 19:34:21.245896","last_unstale":"2023-10-18 19:34:21.254341","last_undegraded":"2023-10-18 19:34:21.254341","last_fullsized":"2023-10-18 19:34:21.254341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236208","last_change":"2023-10-18 19:34:20.855423","last_active":"2023-10-18 19:34:21.236208","last_peered":"2023-10-18 19:34:21.236208","last_clean":"2023-10-18 19:34:21.236208","last_became_active":"2023-10-18 19:34:20.854593","last_became_peered":"2023-10-18 19:34:20.854593","last_unstale":"2023-10-18 19:34:21.236208","last_undegraded":"2023-10-18 19:34:21.236208","last_fullsized":"2023-10-18 19:34:21.236208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261064","last_change":"2023-10-18 19:34:21.256949","last_active":"2023-10-18 19:34:21.261064","last_peered":"2023-10-18 19:34:21.261064","last_clean":"2023-10-18 19:34:21.261064","last_became_active":"2023-10-18 19:34:21.256623","last_became_peered":"2023-10-18 19:34:21.256623","last_unstale":"2023-10-18 19:34:21.261064","last_undegraded":"2023-10-18 19:34:21.261064","last_fullsized":"2023-10-18 19:34:21.261064","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.247595","last_change":"2023-10-18 19:34:20.846802","last_active":"2023-10-18 19:34:21.247595","last_peered":"2023-10-18 19:34:21.247595","last_clean":"2023-10-18 19:34:21.247595","last_became_active":"2023-10-18 19:34:20.846249","last_became_peered":"2023-10-18 19:34:20.846249","last_unstale":"2023-10-18 19:34:21.247595","last_undegraded":"2023-10-18 19:34:21.247595","last_fullsized":"2023-10-18 19:34:21.247595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260942","last_change":"2023-10-18 19:34:21.258895","last_active":"2023-10-18 19:34:21.260942","last_peered":"2023-10-18 19:34:21.260942","last_clean":"2023-10-18 19:34:21.260942","last_became_active":"2023-10-18 19:34:21.256384","last_became_peered":"2023-10-18 19:34:21.256384","last_unstale":"2023-10-18 19:34:21.260942","last_undegraded":"2023-10-18 19:34:21.260942","last_fullsized":"2023-10-18 19:34:21.260942","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273620","last_change":"2023-10-18 19:34:20.850016","last_active":"2023-10-18 19:34:21.273620","last_peered":"2023-10-18 19:34:21.273620","last_clean":"2023-10-18 19:34:21.273620","last_became_active":"2023-10-18 19:34:20.849501","last_became_peered":"2023-10-18 19:34:20.849501","last_unstale":"2023-10-18 19:34:21.273620","last_undegraded":"2023-10-18 19:34:21.273620","last_fullsized":"2023-10-18 19:34:21.273620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262892","last_change":"2023-10-18 19:34:21.258646","last_active":"2023-10-18 19:34:21.262892","last_peered":"2023-10-18 19:34:21.262892","last_clean":"2023-10-18 19:34:21.262892","last_became_active":"2023-10-18 19:34:21.257999","last_became_peered":"2023-10-18 19:34:21.257999","last_unstale":"2023-10-18 19:34:21.262892","last_undegraded":"2023-10-18 19:34:21.262892","last_fullsized":"2023-10-18 19:34:21.262892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235868","last_change":"2023-10-18 19:34:20.856264","last_active":"2023-10-18 19:34:21.235868","last_peered":"2023-10-18 19:34:21.235868","last_clean":"2023-10-18 19:34:21.235868","last_became_active":"2023-10-18 19:34:20.856072","last_became_peered":"2023-10-18 19:34:20.856072","last_unstale":"2023-10-18 19:34:21.235868","last_undegraded":"2023-10-18 19:34:21.235868","last_fullsized":"2023-10-18 19:34:21.235868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.248119","last_change":"2023-10-18 19:34:21.242536","last_active":"2023-10-18 19:34:21.248119","last_peered":"2023-10-18 19:34:21.248119","last_clean":"2023-10-18 19:34:21.248119","last_became_active":"2023-10-18 19:34:21.242187","last_became_peered":"2023-10-18 19:34:21.242187","last_unstale":"2023-10-18 19:34:21.248119","last_undegraded":"2023-10-18 19:34:21.248119","last_fullsized":"2023-10-18 19:34:21.248119","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237026","last_change":"2023-10-18 19:34:20.844847","last_active":"2023-10-18 19:34:21.237026","last_peered":"2023-10-18 19:34:21.237026","last_clean":"2023-10-18 19:34:21.237026","last_became_active":"2023-10-18 19:34:20.844528","last_became_peered":"2023-10-18 19:34:20.844528","last_unstale":"2023-10-18 19:34:21.237026","last_undegraded":"2023-10-18 19:34:21.237026","last_fullsized":"2023-10-18 19:34:21.237026","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276339","last_change":"2023-10-18 19:34:21.272824","last_active":"2023-10-18 19:34:21.276339","last_peered":"2023-10-18 19:34:21.276339","last_clean":"2023-10-18 19:34:21.276339","last_became_active":"2023-10-18 19:34:21.272631","last_became_peered":"2023-10-18 19:34:21.272631","last_unstale":"2023-10-18 19:34:21.276339","last_undegraded":"2023-10-18 19:34:21.276339","last_fullsized":"2023-10-18 19:34:21.276339","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236296","last_change":"2023-10-18 19:34:20.833452","last_active":"2023-10-18 19:34:21.236296","last_peered":"2023-10-18 19:34:21.236296","last_clean":"2023-10-18 19:34:21.236296","last_became_active":"2023-10-18 19:34:20.832840","last_became_peered":"2023-10-18 19:34:20.832840","last_unstale":"2023-10-18 19:34:21.236296","last_undegraded":"2023-10-18 19:34:21.236296","last_fullsized":"2023-10-18 19:34:21.236296","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261308","last_change":"2023-10-18 19:34:21.255174","last_active":"2023-10-18 19:34:21.261308","last_peered":"2023-10-18 19:34:21.261308","last_clean":"2023-10-18 19:34:21.261308","last_became_active":"2023-10-18 19:34:21.252377","last_became_peered":"2023-10-18 19:34:21.252377","last_unstale":"2023-10-18 19:34:21.261308","last_undegraded":"2023-10-18 19:34:21.261308","last_fullsized":"2023-10-18 19:34:21.261308","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251597","last_change":"2023-10-18 19:34:11.535715","last_active":"2023-10-18 19:34:21.251597","last_peered":"2023-10-18 19:34:21.251597","last_clean":"2023-10-18 19:34:21.251597","last_became_active":"2023-10-18 19:34:11.534518","last_became_peered":"2023-10-18 19:34:11.534518","last_unstale":"2023-10-18 19:34:21.251597","last_undegraded":"2023-10-18 19:34:21.251597","last_fullsized":"2023-10-18 19:34:21.251597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236775","last_change":"2023-10-18 19:34:20.857782","last_active":"2023-10-18 19:34:21.236775","last_peered":"2023-10-18 19:34:21.236775","last_clean":"2023-10-18 19:34:21.236775","last_became_active":"2023-10-18 19:34:20.853192","last_became_peered":"2023-10-18 19:34:20.853192","last_unstale":"2023-10-18 19:34:21.236775","last_undegraded":"2023-10-18 19:34:21.236775","last_fullsized":"2023-10-18 19:34:21.236775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261029","last_change":"2023-10-18 19:34:21.257423","last_active":"2023-10-18 19:34:21.261029","last_peered":"2023-10-18 19:34:21.261029","last_clean":"2023-10-18 19:34:21.261029","last_became_active":"2023-10-18 19:34:21.256448","last_became_peered":"2023-10-18 19:34:21.256448","last_unstale":"2023-10-18 19:34:21.261029","last_undegraded":"2023-10-18 19:34:21.261029","last_fullsized":"2023-10-18 19:34:21.261029","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.231638","last_change":"2023-10-18 19:34:11.532756","last_active":"2023-10-18 19:34:21.231638","last_peered":"2023-10-18 19:34:21.231638","last_clean":"2023-10-18 19:34:21.231638","last_became_active":"2023-10-18 19:34:11.532425","last_became_peered":"2023-10-18 19:34:11.532425","last_unstale":"2023-10-18 19:34:21.231638","last_undegraded":"2023-10-18 19:34:21.231638","last_fullsized":"2023-10-18 19:34:21.231638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262706","last_change":"2023-10-18 19:34:20.852964","last_active":"2023-10-18 19:34:21.262706","last_peered":"2023-10-18 19:34:21.262706","last_clean":"2023-10-18 19:34:21.262706","last_became_active":"2023-10-18 19:34:20.852642","last_became_peered":"2023-10-18 19:34:20.852642","last_unstale":"2023-10-18 19:34:21.262706","last_undegraded":"2023-10-18 19:34:21.262706","last_fullsized":"2023-10-18 19:34:21.262706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235826","last_change":"2023-10-18 19:34:11.534856","last_active":"2023-10-18 19:34:21.235826","last_peered":"2023-10-18 19:34:21.235826","last_clean":"2023-10-18 19:34:21.235826","last_became_active":"2023-10-18 19:34:11.534541","last_became_peered":"2023-10-18 19:34:11.534541","last_unstale":"2023-10-18 19:34:21.235826","last_undegraded":"2023-10-18 19:34:21.235826","last_fullsized":"2023-10-18 19:34:21.235826","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223233","last_change":"2023-10-18 19:34:20.847678","last_active":"2023-10-18 19:34:21.223233","last_peered":"2023-10-18 19:34:21.223233","last_clean":"2023-10-18 19:34:21.223233","last_became_active":"2023-10-18 19:34:20.847107","last_became_peered":"2023-10-18 19:34:20.847107","last_unstale":"2023-10-18 19:34:21.223233","last_undegraded":"2023-10-18 19:34:21.223233","last_fullsized":"2023-10-18 19:34:21.223233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260656","last_change":"2023-10-18 19:34:21.255564","last_active":"2023-10-18 19:34:21.260656","last_peered":"2023-10-18 19:34:21.260656","last_clean":"2023-10-18 19:34:21.260656","last_became_active":"2023-10-18 19:34:21.255230","last_became_peered":"2023-10-18 19:34:21.255230","last_unstale":"2023-10-18 19:34:21.260656","last_undegraded":"2023-10-18 19:34:21.260656","last_fullsized":"2023-10-18 19:34:21.260656","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236452","last_change":"2023-10-18 19:34:11.535128","last_active":"2023-10-18 19:34:21.236452","last_peered":"2023-10-18 19:34:21.236452","last_clean":"2023-10-18 19:34:21.236452","last_became_active":"2023-10-18 19:34:11.534248","last_became_peered":"2023-10-18 19:34:11.534248","last_unstale":"2023-10-18 19:34:21.236452","last_undegraded":"2023-10-18 19:34:21.236452","last_fullsized":"2023-10-18 19:34:21.236452","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245021","last_change":"2023-10-18 19:34:20.855194","last_active":"2023-10-18 19:34:21.245021","last_peered":"2023-10-18 19:34:21.245021","last_clean":"2023-10-18 19:34:21.245021","last_became_active":"2023-10-18 19:34:20.854897","last_became_peered":"2023-10-18 19:34:20.854897","last_unstale":"2023-10-18 19:34:21.245021","last_undegraded":"2023-10-18 19:34:21.245021","last_fullsized":"2023-10-18 19:34:21.245021","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.275744","last_change":"2023-10-18 19:34:21.270017","last_active":"2023-10-18 19:34:21.275744","last_peered":"2023-10-18 19:34:21.275744","last_clean":"2023-10-18 19:34:21.275744","last_became_active":"2023-10-18 19:34:21.269485","last_became_peered":"2023-10-18 19:34:21.269485","last_unstale":"2023-10-18 19:34:21.275744","last_undegraded":"2023-10-18 19:34:21.275744","last_fullsized":"2023-10-18 19:34:21.275744","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.232447","last_change":"2023-10-18 19:34:11.532872","last_active":"2023-10-18 19:34:21.232447","last_peered":"2023-10-18 19:34:21.232447","last_clean":"2023-10-18 19:34:21.232447","last_became_active":"2023-10-18 19:34:11.531562","last_became_peered":"2023-10-18 19:34:11.531562","last_unstale":"2023-10-18 19:34:21.232447","last_undegraded":"2023-10-18 19:34:21.232447","last_fullsized":"2023-10-18 19:34:21.232447","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225490","last_change":"2023-10-18 19:34:20.852891","last_active":"2023-10-18 19:34:21.225490","last_peered":"2023-10-18 19:34:21.225490","last_clean":"2023-10-18 19:34:21.225490","last_became_active":"2023-10-18 19:34:20.852426","last_became_peered":"2023-10-18 19:34:20.852426","last_unstale":"2023-10-18 19:34:21.225490","last_undegraded":"2023-10-18 19:34:21.225490","last_fullsized":"2023-10-18 19:34:21.225490","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271146","last_change":"2023-10-18 19:34:21.266390","last_active":"2023-10-18 19:34:21.271146","last_peered":"2023-10-18 19:34:21.271146","last_clean":"2023-10-18 19:34:21.271146","last_became_active":"2023-10-18 19:34:21.266089","last_became_peered":"2023-10-18 19:34:21.266089","last_unstale":"2023-10-18 19:34:21.271146","last_undegraded":"2023-10-18 19:34:21.271146","last_fullsized":"2023-10-18 19:34:21.271146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223059","last_change":"2023-10-18 19:34:11.532565","last_active":"2023-10-18 19:34:21.223059","last_peered":"2023-10-18 19:34:21.223059","last_clean":"2023-10-18 19:34:21.223059","last_became_active":"2023-10-18 19:34:11.532168","last_became_peered":"2023-10-18 19:34:11.532168","last_unstale":"2023-10-18 19:34:21.223059","last_undegraded":"2023-10-18 19:34:21.223059","last_fullsized":"2023-10-18 19:34:21.223059","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227100","last_change":"2023-10-18 19:34:20.852330","last_active":"2023-10-18 19:34:21.227100","last_peered":"2023-10-18 19:34:21.227100","last_clean":"2023-10-18 19:34:21.227100","last_became_active":"2023-10-18 19:34:20.851992","last_became_peered":"2023-10-18 19:34:20.851992","last_unstale":"2023-10-18 19:34:21.227100","last_undegraded":"2023-10-18 19:34:21.227100","last_fullsized":"2023-10-18 19:34:21.227100","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270746","last_change":"2023-10-18 19:34:21.264314","last_active":"2023-10-18 19:34:21.270746","last_peered":"2023-10-18 19:34:21.270746","last_clean":"2023-10-18 19:34:21.270746","last_became_active":"2023-10-18 19:34:21.263937","last_became_peered":"2023-10-18 19:34:21.263937","last_unstale":"2023-10-18 19:34:21.270746","last_undegraded":"2023-10-18 19:34:21.270746","last_fullsized":"2023-10-18 19:34:21.270746","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225659","last_change":"2023-10-18 19:34:11.533453","last_active":"2023-10-18 19:34:21.225659","last_peered":"2023-10-18 19:34:21.225659","last_clean":"2023-10-18 19:34:21.225659","last_became_active":"2023-10-18 19:34:11.532769","last_became_peered":"2023-10-18 19:34:11.532769","last_unstale":"2023-10-18 19:34:21.225659","last_undegraded":"2023-10-18 19:34:21.225659","last_fullsized":"2023-10-18 19:34:21.225659","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.229268","last_change":"2023-10-18 19:34:20.853145","last_active":"2023-10-18 19:34:21.229268","last_peered":"2023-10-18 19:34:21.229268","last_clean":"2023-10-18 19:34:21.229268","last_became_active":"2023-10-18 19:34:20.852683","last_became_peered":"2023-10-18 19:34:20.852683","last_unstale":"2023-10-18 19:34:21.229268","last_undegraded":"2023-10-18 19:34:21.229268","last_fullsized":"2023-10-18 19:34:21.229268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273041","last_change":"2023-10-18 19:34:21.266346","last_active":"2023-10-18 19:34:21.273041","last_peered":"2023-10-18 19:34:21.273041","last_clean":"2023-10-18 19:34:21.273041","last_became_active":"2023-10-18 19:34:21.265950","last_became_peered":"2023-10-18 19:34:21.265950","last_unstale":"2023-10-18 19:34:21.273041","last_undegraded":"2023-10-18 19:34:21.273041","last_fullsized":"2023-10-18 19:34:21.273041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.240589","last_change":"2023-10-18 19:34:11.533454","last_active":"2023-10-18 19:34:21.240589","last_peered":"2023-10-18 19:34:21.240589","last_clean":"2023-10-18 19:34:21.240589","last_became_active":"2023-10-18 19:34:11.533123","last_became_peered":"2023-10-18 19:34:11.533123","last_unstale":"2023-10-18 19:34:21.240589","last_undegraded":"2023-10-18 19:34:21.240589","last_fullsized":"2023-10-18 19:34:21.240589","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235790","last_change":"2023-10-18 19:34:20.844955","last_active":"2023-10-18 19:34:21.235790","last_peered":"2023-10-18 19:34:21.235790","last_clean":"2023-10-18 19:34:21.235790","last_became_active":"2023-10-18 19:34:20.844711","last_became_peered":"2023-10-18 19:34:20.844711","last_unstale":"2023-10-18 19:34:21.235790","last_undegraded":"2023-10-18 19:34:21.235790","last_fullsized":"2023-10-18 19:34:21.235790","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267224","last_change":"2023-10-18 19:34:21.256370","last_active":"2023-10-18 19:34:21.267224","last_peered":"2023-10-18 19:34:21.267224","last_clean":"2023-10-18 19:34:21.267224","last_became_active":"2023-10-18 19:34:21.256084","last_became_peered":"2023-10-18 19:34:21.256084","last_unstale":"2023-10-18 19:34:21.267224","last_undegraded":"2023-10-18 19:34:21.267224","last_fullsized":"2023-10-18 19:34:21.267224","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261044","last_change":"2023-10-18 19:34:21.253778","last_active":"2023-10-18 19:34:21.261044","last_peered":"2023-10-18 19:34:21.261044","last_clean":"2023-10-18 19:34:21.261044","last_became_active":"2023-10-18 19:34:21.251946","last_became_peered":"2023-10-18 19:34:21.251946","last_unstale":"2023-10-18 19:34:21.261044","last_undegraded":"2023-10-18 19:34:21.261044","last_fullsized":"2023-10-18 19:34:21.261044","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.239348","last_change":"2023-10-18 19:34:20.862585","last_active":"2023-10-18 19:34:21.239348","last_peered":"2023-10-18 19:34:21.239348","last_clean":"2023-10-18 19:34:21.239348","last_became_active":"2023-10-18 19:34:20.862326","last_became_peered":"2023-10-18 19:34:20.862326","last_unstale":"2023-10-18 19:34:21.239348","last_undegraded":"2023-10-18 19:34:21.239348","last_fullsized":"2023-10-18 19:34:21.239348","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264051","last_change":"2023-10-18 19:34:21.259196","last_active":"2023-10-18 19:34:21.264051","last_peered":"2023-10-18 19:34:21.264051","last_clean":"2023-10-18 19:34:21.264051","last_became_active":"2023-10-18 19:34:21.258884","last_became_peered":"2023-10-18 19:34:21.258884","last_unstale":"2023-10-18 19:34:21.264051","last_undegraded":"2023-10-18 19:34:21.264051","last_fullsized":"2023-10-18 19:34:21.264051","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262675","last_change":"2023-10-18 19:34:20.863893","last_active":"2023-10-18 19:34:21.262675","last_peered":"2023-10-18 19:34:21.262675","last_clean":"2023-10-18 19:34:21.262675","last_became_active":"2023-10-18 19:34:20.863549","last_became_peered":"2023-10-18 19:34:20.863549","last_unstale":"2023-10-18 19:34:21.262675","last_undegraded":"2023-10-18 19:34:21.262675","last_fullsized":"2023-10-18 19:34:21.262675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262881","last_change":"2023-10-18 19:34:21.261264","last_active":"2023-10-18 19:34:21.262881","last_peered":"2023-10-18 19:34:21.262881","last_clean":"2023-10-18 19:34:21.262881","last_became_active":"2023-10-18 19:34:21.260951","last_became_peered":"2023-10-18 19:34:21.260951","last_unstale":"2023-10-18 19:34:21.262881","last_undegraded":"2023-10-18 19:34:21.262881","last_fullsized":"2023-10-18 19:34:21.262881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261912","last_change":"2023-10-18 19:34:20.853421","last_active":"2023-10-18 19:34:21.261912","last_peered":"2023-10-18 19:34:21.261912","last_clean":"2023-10-18 19:34:21.261912","last_became_active":"2023-10-18 19:34:20.853091","last_became_peered":"2023-10-18 19:34:20.853091","last_unstale":"2023-10-18 19:34:21.261912","last_undegraded":"2023-10-18 19:34:21.261912","last_fullsized":"2023-10-18 19:34:21.261912","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.278815","last_change":"2023-10-18 19:34:21.274214","last_active":"2023-10-18 19:34:21.278815","last_peered":"2023-10-18 19:34:21.278815","last_clean":"2023-10-18 19:34:21.278815","last_became_active":"2023-10-18 19:34:21.273899","last_became_peered":"2023-10-18 19:34:21.273899","last_unstale":"2023-10-18 19:34:21.278815","last_undegraded":"2023-10-18 19:34:21.278815","last_fullsized":"2023-10-18 19:34:21.278815","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271533","last_change":"2023-10-18 19:34:20.860150","last_active":"2023-10-18 19:34:21.271533","last_peered":"2023-10-18 19:34:21.271533","last_clean":"2023-10-18 19:34:21.271533","last_became_active":"2023-10-18 19:34:20.859836","last_became_peered":"2023-10-18 19:34:20.859836","last_unstale":"2023-10-18 19:34:21.271533","last_undegraded":"2023-10-18 19:34:21.271533","last_fullsized":"2023-10-18 19:34:21.271533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267146","last_change":"2023-10-18 19:34:21.260022","last_active":"2023-10-18 19:34:21.267146","last_peered":"2023-10-18 19:34:21.267146","last_clean":"2023-10-18 19:34:21.267146","last_became_active":"2023-10-18 19:34:21.259630","last_became_peered":"2023-10-18 19:34:21.259630","last_unstale":"2023-10-18 19:34:21.267146","last_undegraded":"2023-10-18 19:34:21.267146","last_fullsized":"2023-10-18 19:34:21.267146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223404","last_change":"2023-10-18 19:34:20.832124","last_active":"2023-10-18 19:34:21.223404","last_peered":"2023-10-18 19:34:21.223404","last_clean":"2023-10-18 19:34:21.223404","last_became_active":"2023-10-18 19:34:20.831830","last_became_peered":"2023-10-18 19:34:20.831830","last_unstale":"2023-10-18 19:34:21.223404","last_undegraded":"2023-10-18 19:34:21.223404","last_fullsized":"2023-10-18 19:34:21.223404","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271045","last_change":"2023-10-18 19:34:21.263372","last_active":"2023-10-18 19:34:21.271045","last_peered":"2023-10-18 19:34:21.271045","last_clean":"2023-10-18 19:34:21.271045","last_became_active":"2023-10-18 19:34:21.256876","last_became_peered":"2023-10-18 19:34:21.256876","last_unstale":"2023-10-18 19:34:21.271045","last_undegraded":"2023-10-18 19:34:21.271045","last_fullsized":"2023-10-18 19:34:21.271045","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245344","last_change":"2023-10-18 19:34:20.846546","last_active":"2023-10-18 19:34:21.245344","last_peered":"2023-10-18 19:34:21.245344","last_clean":"2023-10-18 19:34:21.245344","last_became_active":"2023-10-18 19:34:20.846229","last_became_peered":"2023-10-18 19:34:20.846229","last_unstale":"2023-10-18 19:34:21.245344","last_undegraded":"2023-10-18 19:34:21.245344","last_fullsized":"2023-10-18 19:34:21.245344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254951","last_change":"2023-10-18 19:34:21.248032","last_active":"2023-10-18 19:34:21.254951","last_peered":"2023-10-18 19:34:21.254951","last_clean":"2023-10-18 19:34:21.254951","last_became_active":"2023-10-18 19:34:21.247196","last_became_peered":"2023-10-18 19:34:21.247196","last_unstale":"2023-10-18 19:34:21.254951","last_undegraded":"2023-10-18 19:34:21.254951","last_fullsized":"2023-10-18 19:34:21.254951","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227234","last_change":"2023-10-18 19:34:20.847408","last_active":"2023-10-18 19:34:21.227234","last_peered":"2023-10-18 19:34:21.227234","last_clean":"2023-10-18 19:34:21.227234","last_became_active":"2023-10-18 19:34:20.847100","last_became_peered":"2023-10-18 19:34:20.847100","last_unstale":"2023-10-18 19:34:21.227234","last_undegraded":"2023-10-18 19:34:21.227234","last_fullsized":"2023-10-18 19:34:21.227234","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260917","last_change":"2023-10-18 19:34:21.256724","last_active":"2023-10-18 19:34:21.260917","last_peered":"2023-10-18 19:34:21.260917","last_clean":"2023-10-18 19:34:21.260917","last_became_active":"2023-10-18 19:34:21.256252","last_became_peered":"2023-10-18 19:34:21.256252","last_unstale":"2023-10-18 19:34:21.260917","last_undegraded":"2023-10-18 19:34:21.260917","last_fullsized":"2023-10-18 19:34:21.260917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.226417","last_change":"2023-10-18 19:34:20.846959","last_active":"2023-10-18 19:34:21.226417","last_peered":"2023-10-18 19:34:21.226417","last_clean":"2023-10-18 19:34:21.226417","last_became_active":"2023-10-18 19:34:20.846541","last_became_peered":"2023-10-18 19:34:20.846541","last_unstale":"2023-10-18 19:34:21.226417","last_undegraded":"2023-10-18 19:34:21.226417","last_fullsized":"2023-10-18 19:34:21.226417","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258963","last_change":"2023-10-18 19:34:21.251998","last_active":"2023-10-18 19:34:21.258963","last_peered":"2023-10-18 19:34:21.258963","last_clean":"2023-10-18 19:34:21.258963","last_became_active":"2023-10-18 19:34:21.251641","last_became_peered":"2023-10-18 19:34:21.251641","last_unstale":"2023-10-18 19:34:21.258963","last_undegraded":"2023-10-18 19:34:21.258963","last_fullsized":"2023-10-18 19:34:21.258963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235880","last_change":"2023-10-18 19:34:20.844433","last_active":"2023-10-18 19:34:21.235880","last_peered":"2023-10-18 19:34:21.235880","last_clean":"2023-10-18 19:34:21.235880","last_became_active":"2023-10-18 19:34:20.843767","last_became_peered":"2023-10-18 19:34:20.843767","last_unstale":"2023-10-18 19:34:21.235880","last_undegraded":"2023-10-18 19:34:21.235880","last_fullsized":"2023-10-18 19:34:21.235880","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260971","last_change":"2023-10-18 19:34:21.259590","last_active":"2023-10-18 19:34:21.260971","last_peered":"2023-10-18 19:34:21.260971","last_clean":"2023-10-18 19:34:21.260971","last_became_active":"2023-10-18 19:34:21.257762","last_became_peered":"2023-10-18 19:34:21.257762","last_unstale":"2023-10-18 19:34:21.260971","last_undegraded":"2023-10-18 19:34:21.260971","last_fullsized":"2023-10-18 19:34:21.260971","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251706","last_change":"2023-10-18 19:34:20.845853","last_active":"2023-10-18 19:34:21.251706","last_peered":"2023-10-18 19:34:21.251706","last_clean":"2023-10-18 19:34:21.251706","last_became_active":"2023-10-18 19:34:20.845487","last_became_peered":"2023-10-18 19:34:20.845487","last_unstale":"2023-10-18 19:34:21.251706","last_undegraded":"2023-10-18 19:34:21.251706","last_fullsized":"2023-10-18 19:34:21.251706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261328","last_change":"2023-10-18 19:34:21.255163","last_active":"2023-10-18 19:34:21.261328","last_peered":"2023-10-18 19:34:21.261328","last_clean":"2023-10-18 19:34:21.261328","last_became_active":"2023-10-18 19:34:21.252262","last_became_peered":"2023-10-18 19:34:21.252262","last_unstale":"2023-10-18 19:34:21.261328","last_undegraded":"2023-10-18 19:34:21.261328","last_fullsized":"2023-10-18 19:34:21.261328","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238095","last_change":"2023-10-18 19:34:20.861998","last_active":"2023-10-18 19:34:21.238095","last_peered":"2023-10-18 19:34:21.238095","last_clean":"2023-10-18 19:34:21.238095","last_became_active":"2023-10-18 19:34:20.860333","last_became_peered":"2023-10-18 19:34:20.860333","last_unstale":"2023-10-18 19:34:21.238095","last_undegraded":"2023-10-18 19:34:21.238095","last_fullsized":"2023-10-18 19:34:21.238095","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267358","last_change":"2023-10-18 19:34:21.258083","last_active":"2023-10-18 19:34:21.267358","last_peered":"2023-10-18 19:34:21.267358","last_clean":"2023-10-18 19:34:21.267358","last_became_active":"2023-10-18 19:34:21.257626","last_became_peered":"2023-10-18 19:34:21.257626","last_unstale":"2023-10-18 19:34:21.267358","last_undegraded":"2023-10-18 19:34:21.267358","last_fullsized":"2023-10-18 19:34:21.267358","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227964","last_change":"2023-10-18 19:34:20.855980","last_active":"2023-10-18 19:34:21.227964","last_peered":"2023-10-18 19:34:21.227964","last_clean":"2023-10-18 19:34:21.227964","last_became_active":"2023-10-18 19:34:20.855446","last_became_peered":"2023-10-18 19:34:20.855446","last_unstale":"2023-10-18 19:34:21.227964","last_undegraded":"2023-10-18 19:34:21.227964","last_fullsized":"2023-10-18 19:34:21.227964","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273477","last_change":"2023-10-18 19:34:21.267157","last_active":"2023-10-18 19:34:21.273477","last_peered":"2023-10-18 19:34:21.273477","last_clean":"2023-10-18 19:34:21.273477","last_became_active":"2023-10-18 19:34:21.266854","last_became_peered":"2023-10-18 19:34:21.266854","last_unstale":"2023-10-18 19:34:21.273477","last_undegraded":"2023-10-18 19:34:21.273477","last_fullsized":"2023-10-18 19:34:21.273477","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223905","last_change":"2023-10-18 19:34:20.847879","last_active":"2023-10-18 19:34:21.223905","last_peered":"2023-10-18 19:34:21.223905","last_clean":"2023-10-18 19:34:21.223905","last_became_active":"2023-10-18 19:34:20.847368","last_became_peered":"2023-10-18 19:34:20.847368","last_unstale":"2023-10-18 19:34:21.223905","last_undegraded":"2023-10-18 19:34:21.223905","last_fullsized":"2023-10-18 19:34:21.223905","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274767","last_change":"2023-10-18 19:34:21.271229","last_active":"2023-10-18 19:34:21.274767","last_peered":"2023-10-18 19:34:21.274767","last_clean":"2023-10-18 19:34:21.274767","last_became_active":"2023-10-18 19:34:21.270946","last_became_peered":"2023-10-18 19:34:21.270946","last_unstale":"2023-10-18 19:34:21.274767","last_undegraded":"2023-10-18 19:34:21.274767","last_fullsized":"2023-10-18 19:34:21.274767","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237270","last_change":"2023-10-18 19:34:20.857540","last_active":"2023-10-18 19:34:21.237270","last_peered":"2023-10-18 19:34:21.237270","last_clean":"2023-10-18 19:34:21.237270","last_became_active":"2023-10-18 19:34:20.857056","last_became_peered":"2023-10-18 19:34:20.857056","last_unstale":"2023-10-18 19:34:21.237270","last_undegraded":"2023-10-18 19:34:21.237270","last_fullsized":"2023-10-18 19:34:21.237270","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270725","last_change":"2023-10-18 19:34:21.264597","last_active":"2023-10-18 19:34:21.270725","last_peered":"2023-10-18 19:34:21.270725","last_clean":"2023-10-18 19:34:21.270725","last_became_active":"2023-10-18 19:34:21.264304","last_became_peered":"2023-10-18 19:34:21.264304","last_unstale":"2023-10-18 19:34:21.270725","last_undegraded":"2023-10-18 19:34:21.270725","last_fullsized":"2023-10-18 19:34:21.270725","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235777","last_change":"2023-10-18 19:34:20.830160","last_active":"2023-10-18 19:34:21.235777","last_peered":"2023-10-18 19:34:21.235777","last_clean":"2023-10-18 19:34:21.235777","last_became_active":"2023-10-18 19:34:20.829821","last_became_peered":"2023-10-18 19:34:20.829821","last_unstale":"2023-10-18 19:34:21.235777","last_undegraded":"2023-10-18 19:34:21.235777","last_fullsized":"2023-10-18 19:34:21.235777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263547","last_change":"2023-10-18 19:34:21.250388","last_active":"2023-10-18 19:34:21.263547","last_peered":"2023-10-18 19:34:21.263547","last_clean":"2023-10-18 19:34:21.263547","last_became_active":"2023-10-18 19:34:21.250098","last_became_peered":"2023-10-18 19:34:21.250098","last_unstale":"2023-10-18 19:34:21.263547","last_undegraded":"2023-10-18 19:34:21.263547","last_fullsized":"2023-10-18 19:34:21.263547","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276405","last_change":"2023-10-18 19:34:20.857726","last_active":"2023-10-18 19:34:21.276405","last_peered":"2023-10-18 19:34:21.276405","last_clean":"2023-10-18 19:34:21.276405","last_became_active":"2023-10-18 19:34:20.856983","last_became_peered":"2023-10-18 19:34:20.856983","last_unstale":"2023-10-18 19:34:21.276405","last_undegraded":"2023-10-18 19:34:21.276405","last_fullsized":"2023-10-18 19:34:21.276405","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274573","last_change":"2023-10-18 19:34:21.270485","last_active":"2023-10-18 19:34:21.274573","last_peered":"2023-10-18 19:34:21.274573","last_clean":"2023-10-18 19:34:21.274573","last_became_active":"2023-10-18 19:34:21.270140","last_became_peered":"2023-10-18 19:34:21.270140","last_unstale":"2023-10-18 19:34:21.274573","last_undegraded":"2023-10-18 19:34:21.274573","last_fullsized":"2023-10-18 19:34:21.274573","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.242340","last_change":"2023-10-18 19:34:20.847009","last_active":"2023-10-18 19:34:21.242340","last_peered":"2023-10-18 19:34:21.242340","last_clean":"2023-10-18 19:34:21.242340","last_became_active":"2023-10-18 19:34:20.846481","last_became_peered":"2023-10-18 19:34:20.846481","last_unstale":"2023-10-18 19:34:21.242340","last_undegraded":"2023-10-18 19:34:21.242340","last_fullsized":"2023-10-18 19:34:21.242340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260964","last_change":"2023-10-18 19:34:21.256060","last_active":"2023-10-18 19:34:21.260964","last_peered":"2023-10-18 19:34:21.260964","last_clean":"2023-10-18 19:34:21.260964","last_became_active":"2023-10-18 19:34:21.255703","last_became_peered":"2023-10-18 19:34:21.255703","last_unstale":"2023-10-18 19:34:21.260964","last_undegraded":"2023-10-18 19:34:21.260964","last_fullsized":"2023-10-18 19:34:21.260964","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274523","last_change":"2023-10-18 19:34:20.849799","last_active":"2023-10-18 19:34:21.274523","last_peered":"2023-10-18 19:34:21.274523","last_clean":"2023-10-18 19:34:21.274523","last_became_active":"2023-10-18 19:34:20.849488","last_became_peered":"2023-10-18 19:34:20.849488","last_unstale":"2023-10-18 19:34:21.274523","last_undegraded":"2023-10-18 19:34:21.274523","last_fullsized":"2023-10-18 19:34:21.274523","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261345","last_change":"2023-10-18 19:34:21.260006","last_active":"2023-10-18 19:34:21.261345","last_peered":"2023-10-18 19:34:21.261345","last_clean":"2023-10-18 19:34:21.261345","last_became_active":"2023-10-18 19:34:21.259689","last_became_peered":"2023-10-18 19:34:21.259689","last_unstale":"2023-10-18 19:34:21.261345","last_undegraded":"2023-10-18 19:34:21.261345","last_fullsized":"2023-10-18 19:34:21.261345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236883","last_change":"2023-10-18 19:34:20.858108","last_active":"2023-10-18 19:34:21.236883","last_peered":"2023-10-18 19:34:21.236883","last_clean":"2023-10-18 19:34:21.236883","last_became_active":"2023-10-18 19:34:20.854784","last_became_peered":"2023-10-18 19:34:20.854784","last_unstale":"2023-10-18 19:34:21.236883","last_undegraded":"2023-10-18 19:34:21.236883","last_fullsized":"2023-10-18 19:34:21.236883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267335","last_change":"2023-10-18 19:34:21.257919","last_active":"2023-10-18 19:34:21.267335","last_peered":"2023-10-18 19:34:21.267335","last_clean":"2023-10-18 19:34:21.267335","last_became_active":"2023-10-18 19:34:21.257409","last_became_peered":"2023-10-18 19:34:21.257409","last_unstale":"2023-10-18 19:34:21.267335","last_undegraded":"2023-10-18 19:34:21.267335","last_fullsized":"2023-10-18 19:34:21.267335","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.228386","last_change":"2023-10-18 19:34:20.847577","last_active":"2023-10-18 19:34:21.228386","last_peered":"2023-10-18 19:34:21.228386","last_clean":"2023-10-18 19:34:21.228386","last_became_active":"2023-10-18 19:34:20.842013","last_became_peered":"2023-10-18 19:34:20.842013","last_unstale":"2023-10-18 19:34:21.228386","last_undegraded":"2023-10-18 19:34:21.228386","last_fullsized":"2023-10-18 19:34:21.228386","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258434","last_change":"2023-10-18 19:34:21.251747","last_active":"2023-10-18 19:34:21.258434","last_peered":"2023-10-18 19:34:21.258434","last_clean":"2023-10-18 19:34:21.258434","last_became_active":"2023-10-18 19:34:21.251325","last_became_peered":"2023-10-18 19:34:21.251325","last_unstale":"2023-10-18 19:34:21.258434","last_undegraded":"2023-10-18 19:34:21.258434","last_fullsized":"2023-10-18 19:34:21.258434","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267344","last_change":"2023-10-18 19:34:20.832572","last_active":"2023-10-18 19:34:21.267344","last_peered":"2023-10-18 19:34:21.267344","last_clean":"2023-10-18 19:34:21.267344","last_became_active":"2023-10-18 19:34:20.832216","last_became_peered":"2023-10-18 19:34:20.832216","last_unstale":"2023-10-18 19:34:21.267344","last_undegraded":"2023-10-18 19:34:21.267344","last_fullsized":"2023-10-18 19:34:21.267344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276296","last_change":"2023-10-18 19:34:21.272247","last_active":"2023-10-18 19:34:21.276296","last_peered":"2023-10-18 19:34:21.276296","last_clean":"2023-10-18 19:34:21.276296","last_became_active":"2023-10-18 19:34:21.271930","last_became_peered":"2023-10-18 19:34:21.271930","last_unstale":"2023-10-18 19:34:21.276296","last_undegraded":"2023-10-18 19:34:21.276296","last_fullsized":"2023-10-18 19:34:21.276296","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235502","last_change":"2023-10-18 19:34:20.840841","last_active":"2023-10-18 19:34:21.235502","last_peered":"2023-10-18 19:34:21.235502","last_clean":"2023-10-18 19:34:21.235502","last_became_active":"2023-10-18 19:34:20.840351","last_became_peered":"2023-10-18 19:34:20.840351","last_unstale":"2023-10-18 19:34:21.235502","last_undegraded":"2023-10-18 19:34:21.235502","last_fullsized":"2023-10-18 19:34:21.235502","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262872","last_change":"2023-10-18 19:34:21.258445","last_active":"2023-10-18 19:34:21.262872","last_peered":"2023-10-18 19:34:21.262872","last_clean":"2023-10-18 19:34:21.262872","last_became_active":"2023-10-18 19:34:21.257747","last_became_peered":"2023-10-18 19:34:21.257747","last_unstale":"2023-10-18 19:34:21.262872","last_undegraded":"2023-10-18 19:34:21.262872","last_fullsized":"2023-10-18 19:34:21.262872","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.233329","last_change":"2023-10-18 19:34:20.856638","last_active":"2023-10-18 19:34:21.233329","last_peered":"2023-10-18 19:34:21.233329","last_clean":"2023-10-18 19:34:21.233329","last_became_active":"2023-10-18 19:34:20.856094","last_became_peered":"2023-10-18 19:34:20.856094","last_unstale":"2023-10-18 19:34:21.233329","last_undegraded":"2023-10-18 19:34:21.233329","last_fullsized":"2023-10-18 19:34:21.233329","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254821","last_change":"2023-10-18 19:34:21.249180","last_active":"2023-10-18 19:34:21.254821","last_peered":"2023-10-18 19:34:21.254821","last_clean":"2023-10-18 19:34:21.254821","last_became_active":"2023-10-18 19:34:21.245370","last_became_peered":"2023-10-18 19:34:21.245370","last_unstale":"2023-10-18 19:34:21.254821","last_undegraded":"2023-10-18 19:34:21.254821","last_fullsized":"2023-10-18 19:34:21.254821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.265777","last_change":"2023-10-18 19:34:20.823278","last_active":"2023-10-18 19:34:21.265777","last_peered":"2023-10-18 19:34:21.265777","last_clean":"2023-10-18 19:34:21.265777","last_became_active":"2023-10-18 19:34:20.823003","last_became_peered":"2023-10-18 19:34:20.823003","last_unstale":"2023-10-18 19:34:21.265777","last_undegraded":"2023-10-18 19:34:21.265777","last_fullsized":"2023-10-18 19:34:21.265777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253391","last_change":"2023-10-18 19:34:21.246335","last_active":"2023-10-18 19:34:21.253391","last_peered":"2023-10-18 19:34:21.253391","last_clean":"2023-10-18 19:34:21.253391","last_became_active":"2023-10-18 19:34:21.246040","last_became_peered":"2023-10-18 19:34:21.246040","last_unstale":"2023-10-18 19:34:21.253391","last_undegraded":"2023-10-18 19:34:21.253391","last_fullsized":"2023-10-18 19:34:21.253391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273867","last_change":"2023-10-18 19:34:20.855032","last_active":"2023-10-18 19:34:21.273867","last_peered":"2023-10-18 19:34:21.273867","last_clean":"2023-10-18 19:34:21.273867","last_became_active":"2023-10-18 19:34:20.854673","last_became_peered":"2023-10-18 19:34:20.854673","last_unstale":"2023-10-18 19:34:21.273867","last_undegraded":"2023-10-18 19:34:21.273867","last_fullsized":"2023-10-18 19:34:21.273867","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.259565","last_change":"2023-10-18 19:34:21.254232","last_active":"2023-10-18 19:34:21.259565","last_peered":"2023-10-18 19:34:21.259565","last_clean":"2023-10-18 19:34:21.259565","last_became_active":"2023-10-18 19:34:21.253932","last_became_peered":"2023-10-18 19:34:21.253932","last_unstale":"2023-10-18 19:34:21.259565","last_undegraded":"2023-10-18 19:34:21.259565","last_fullsized":"2023-10-18 19:34:21.259565","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236496","last_change":"2023-10-18 19:34:20.855559","last_active":"2023-10-18 19:34:21.236496","last_peered":"2023-10-18 19:34:21.236496","last_clean":"2023-10-18 19:34:21.236496","last_became_active":"2023-10-18 19:34:20.854845","last_became_peered":"2023-10-18 19:34:20.854845","last_unstale":"2023-10-18 19:34:21.236496","last_undegraded":"2023-10-18 19:34:21.236496","last_fullsized":"2023-10-18 19:34:21.236496","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262693","last_change":"2023-10-18 19:34:21.248190","last_active":"2023-10-18 19:34:21.262693","last_peered":"2023-10-18 19:34:21.262693","last_clean":"2023-10-18 19:34:21.262693","last_became_active":"2023-10-18 19:34:21.247102","last_became_peered":"2023-10-18 19:34:21.247102","last_unstale":"2023-10-18 19:34:21.262693","last_undegraded":"2023-10-18 19:34:21.262693","last_fullsized":"2023-10-18 19:34:21.262693","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236683","last_change":"2023-10-18 19:34:20.857956","last_active":"2023-10-18 19:34:21.236683","last_peered":"2023-10-18 19:34:21.236683","last_clean":"2023-10-18 19:34:21.236683","last_became_active":"2023-10-18 19:34:20.855051","last_became_peered":"2023-10-18 19:34:20.855051","last_unstale":"2023-10-18 19:34:21.236683","last_undegraded":"2023-10-18 19:34:21.236683","last_fullsized":"2023-10-18 19:34:21.236683","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270992","last_change":"2023-10-18 19:34:21.266700","last_active":"2023-10-18 19:34:21.270992","last_peered":"2023-10-18 19:34:21.270992","last_clean":"2023-10-18 19:34:21.270992","last_became_active":"2023-10-18 19:34:21.266409","last_became_peered":"2023-10-18 19:34:21.266409","last_unstale":"2023-10-18 19:34:21.270992","last_undegraded":"2023-10-18 19:34:21.270992","last_fullsized":"2023-10-18 19:34:21.270992","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238606","last_change":"2023-10-18 19:34:20.851465","last_active":"2023-10-18 19:34:21.238606","last_peered":"2023-10-18 19:34:21.238606","last_clean":"2023-10-18 19:34:21.238606","last_became_active":"2023-10-18 19:34:20.851166","last_became_peered":"2023-10-18 19:34:20.851166","last_unstale":"2023-10-18 19:34:21.238606","last_undegraded":"2023-10-18 19:34:21.238606","last_fullsized":"2023-10-18 19:34:21.238606","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253575","last_change":"2023-10-18 19:34:21.245529","last_active":"2023-10-18 19:34:21.253575","last_peered":"2023-10-18 19:34:21.253575","last_clean":"2023-10-18 19:34:21.253575","last_became_active":"2023-10-18 19:34:21.245217","last_became_peered":"2023-10-18 19:34:21.245217","last_unstale":"2023-10-18 19:34:21.253575","last_undegraded":"2023-10-18 19:34:21.253575","last_fullsized":"2023-10-18 19:34:21.253575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236484","last_change":"2023-10-18 19:34:20.837517","last_active":"2023-10-18 19:34:21.236484","last_peered":"2023-10-18 19:34:21.236484","last_clean":"2023-10-18 19:34:21.236484","last_became_active":"2023-10-18 19:34:20.837192","last_became_peered":"2023-10-18 19:34:20.837192","last_unstale":"2023-10-18 19:34:21.236484","last_undegraded":"2023-10-18 19:34:21.236484","last_fullsized":"2023-10-18 19:34:21.236484","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271163","last_change":"2023-10-18 19:34:21.262649","last_active":"2023-10-18 19:34:21.271163","last_peered":"2023-10-18 19:34:21.271163","last_clean":"2023-10-18 19:34:21.271163","last_became_active":"2023-10-18 19:34:21.262175","last_became_peered":"2023-10-18 19:34:21.262175","last_unstale":"2023-10-18 19:34:21.271163","last_undegraded":"2023-10-18 19:34:21.271163","last_fullsized":"2023-10-18 19:34:21.271163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237168","last_change":"2023-10-18 19:34:20.821558","last_active":"2023-10-18 19:34:21.237168","last_peered":"2023-10-18 19:34:21.237168","last_clean":"2023-10-18 19:34:21.237168","last_became_active":"2023-10-18 19:34:20.821225","last_became_peered":"2023-10-18 19:34:20.821225","last_unstale":"2023-10-18 19:34:21.237168","last_undegraded":"2023-10-18 19:34:21.237168","last_fullsized":"2023-10-18 19:34:21.237168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272370","last_change":"2023-10-18 19:34:21.268630","last_active":"2023-10-18 19:34:21.272370","last_peered":"2023-10-18 19:34:21.272370","last_clean":"2023-10-18 19:34:21.272370","last_became_active":"2023-10-18 19:34:21.268347","last_became_peered":"2023-10-18 19:34:21.268347","last_unstale":"2023-10-18 19:34:21.272370","last_undegraded":"2023-10-18 19:34:21.272370","last_fullsized":"2023-10-18 19:34:21.272370","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276681","last_change":"2023-10-18 19:34:20.856427","last_active":"2023-10-18 19:34:21.276681","last_peered":"2023-10-18 19:34:21.276681","last_clean":"2023-10-18 19:34:21.276681","last_became_active":"2023-10-18 19:34:20.855877","last_became_peered":"2023-10-18 19:34:20.855877","last_unstale":"2023-10-18 19:34:21.276681","last_undegraded":"2023-10-18 19:34:21.276681","last_fullsized":"2023-10-18 19:34:21.276681","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267065","last_change":"2023-10-18 19:34:21.259142","last_active":"2023-10-18 19:34:21.267065","last_peered":"2023-10-18 19:34:21.267065","last_clean":"2023-10-18 19:34:21.267065","last_became_active":"2023-10-18 19:34:21.258709","last_became_peered":"2023-10-18 19:34:21.258709","last_unstale":"2023-10-18 19:34:21.267065","last_undegraded":"2023-10-18 19:34:21.267065","last_fullsized":"2023-10-18 19:34:21.267065","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260963","last_change":"2023-10-18 19:34:20.861616","last_active":"2023-10-18 19:34:21.260963","last_peered":"2023-10-18 19:34:21.260963","last_clean":"2023-10-18 19:34:21.260963","last_became_active":"2023-10-18 19:34:20.861363","last_became_peered":"2023-10-18 19:34:20.861363","last_unstale":"2023-10-18 19:34:21.260963","last_undegraded":"2023-10-18 19:34:21.260963","last_fullsized":"2023-10-18 19:34:21.260963","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272280","last_change":"2023-10-18 19:34:21.267981","last_active":"2023-10-18 19:34:21.272280","last_peered":"2023-10-18 19:34:21.272280","last_clean":"2023-10-18 19:34:21.272280","last_became_active":"2023-10-18 19:34:21.267584","last_became_peered":"2023-10-18 19:34:21.267584","last_unstale":"2023-10-18 19:34:21.272280","last_undegraded":"2023-10-18 19:34:21.272280","last_fullsized":"2023-10-18 19:34:21.272280","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261640","last_change":"2023-10-18 19:34:20.855045","last_active":"2023-10-18 19:34:21.261640","last_peered":"2023-10-18 19:34:21.261640","last_clean":"2023-10-18 19:34:21.261640","last_became_active":"2023-10-18 19:34:20.854724","last_became_peered":"2023-10-18 19:34:20.854724","last_unstale":"2023-10-18 19:34:21.261640","last_undegraded":"2023-10-18 19:34:21.261640","last_fullsized":"2023-10-18 19:34:21.261640","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.269720","last_change":"2023-10-18 19:34:21.262741","last_active":"2023-10-18 19:34:21.269720","last_peered":"2023-10-18 19:34:21.269720","last_clean":"2023-10-18 19:34:21.269720","last_became_active":"2023-10-18 19:34:21.262435","last_became_peered":"2023-10-18 19:34:21.262435","last_unstale":"2023-10-18 19:34:21.269720","last_undegraded":"2023-10-18 19:34:21.269720","last_fullsized":"2023-10-18 19:34:21.269720","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236324","last_change":"2023-10-18 19:34:20.850195","last_active":"2023-10-18 19:34:21.236324","last_peered":"2023-10-18 19:34:21.236324","last_clean":"2023-10-18 19:34:21.236324","last_became_active":"2023-10-18 19:34:20.849885","last_became_peered":"2023-10-18 19:34:20.849885","last_unstale":"2023-10-18 19:34:21.236324","last_undegraded":"2023-10-18 19:34:21.236324","last_fullsized":"2023-10-18 19:34:21.236324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254998","last_change":"2023-10-18 19:34:21.248730","last_active":"2023-10-18 19:34:21.254998","last_peered":"2023-10-18 19:34:21.254998","last_clean":"2023-10-18 19:34:21.254998","last_became_active":"2023-10-18 19:34:21.248420","last_became_peered":"2023-10-18 19:34:21.248420","last_unstale":"2023-10-18 19:34:21.254998","last_undegraded":"2023-10-18 19:34:21.254998","last_fullsized":"2023-10-18 19:34:21.254998","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238187","last_change":"2023-10-18 19:34:20.862008","last_active":"2023-10-18 19:34:21.238187","last_peered":"2023-10-18 19:34:21.238187","last_clean":"2023-10-18 19:34:21.238187","last_became_active":"2023-10-18 19:34:20.858973","last_became_peered":"2023-10-18 19:34:20.858973","last_unstale":"2023-10-18 19:34:21.238187","last_undegraded":"2023-10-18 19:34:21.238187","last_fullsized":"2023-10-18 19:34:21.238187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264920","last_change":"2023-10-18 19:34:21.259920","last_active":"2023-10-18 19:34:21.264920","last_peered":"2023-10-18 19:34:21.264920","last_clean":"2023-10-18 19:34:21.264920","last_became_active":"2023-10-18 19:34:21.259474","last_became_peered":"2023-10-18 19:34:21.259474","last_unstale":"2023-10-18 19:34:21.264920","last_undegraded":"2023-10-18 19:34:21.264920","last_fullsized":"2023-10-18 19:34:21.264920","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263166","last_change":"2023-10-18 19:34:20.842664","last_active":"2023-10-18 19:34:21.263166","last_peered":"2023-10-18 19:34:21.263166","last_clean":"2023-10-18 19:34:21.263166","last_became_active":"2023-10-18 19:34:20.842341","last_became_peered":"2023-10-18 19:34:20.842341","last_unstale":"2023-10-18 19:34:21.263166","last_undegraded":"2023-10-18 19:34:21.263166","last_fullsized":"2023-10-18 19:34:21.263166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":37959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048724,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323116,"statfs":{"total":96636764160,"available":95562870784,"internally_reserved":1073741824,"allocated":143360,"data_stored":36943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048728,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323112,"statfs":{"total":96636764160,"available":95562866688,"internally_reserved":1073741824,"allocated":147456,"data_stored":37731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048724,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323116,"statfs":{"total":96636764160,"available":95562870784,"internally_reserved":1073741824,"allocated":143360,"data_stored":36895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]}]}} 2023-10-18T19:34:26.742 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T19:34:26.743 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T19:34:26.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T19:34:26.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T19:34:26.744 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-18T19:34:26.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.973 7f131e5ff700 1 Processor -- start 2023-10-18T19:34:26.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.973 7f131e5ff700 1 -- start start 2023-10-18T19:34:26.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f131e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f131e5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13181b2770 0x7f13181b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:26.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f131e5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1318111850 con 0x7f13181b31f0 2023-10-18T19:34:26.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f131e5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1318111f40 con 0x7f13181b2770 2023-10-18T19:34:26.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f131e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13180f6a30 con 0x7f131810ccc0 2023-10-18T19:34:26.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f13167fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f1315ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13181b2770 0x7f13181b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f13167fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42834/0 (socket says 172.21.15.88:42834) 2023-10-18T19:34:26.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f13167fe700 1 -- 172.21.15.88:0/4075033671 learned_addr learned my addr 172.21.15.88:0/4075033671 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:26.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.974 7f1316fff700 1 --1- 172.21.15.88:0/4075033671 >> v1:172.21.15.88:6789/0 conn(0x7f13181b31f0 0x7f13180f14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52026/0 (socket says 172.21.15.88:52026) 2023-10-18T19:34:26.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13167fe700 1 -- 172.21.15.88:0/4075033671 >> v2:172.21.15.88:3300/0 conn(0x7f13181b2770 msgr2=0x7f13181b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:26.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13167fe700 1 --2- 172.21.15.88:0/4075033671 >> v2:172.21.15.88:3300/0 conn(0x7f13181b2770 0x7f13181b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13167fe700 1 -- 172.21.15.88:0/4075033671 >> v1:172.21.15.88:6789/0 conn(0x7f13181b31f0 legacy=0x7f13180f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13157fc700 1 -- 172.21.15.88:0/4075033671 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577261511 0 0) 0x7f1310001490 con 0x7f13181b31f0 2023-10-18T19:34:26.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13167fe700 1 -- 172.21.15.88:0/4075033671 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131810d6f0 con 0x7f131810ccc0 2023-10-18T19:34:26.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13167fe700 1 --2- 172.21.15.88:0/4075033671 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1308002f70 tx=0x7f13080099d0).ready entity=mon.2 client_cookie=eaec12af35d0b6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:26.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13157fc700 1 -- 172.21.15.88:0/4075033671 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f131810d6f0 con 0x7f131810ccc0 2023-10-18T19:34:26.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13157fc700 1 -- 172.21.15.88:0/4075033671 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130800f510 con 0x7f131810ccc0 2023-10-18T19:34:26.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f13157fc700 1 -- 172.21.15.88:0/4075033671 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f130800f6f0 con 0x7f131810ccc0 2023-10-18T19:34:26.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f131e5ff700 1 -- 172.21.15.88:0/4075033671 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 msgr2=0x7f13180f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:26.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.975 7f131e5ff700 1 --2- 172.21.15.88:0/4075033671 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1308002f70 tx=0x7f13080099d0).stop 2023-10-18T19:34:26.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 -- 172.21.15.88:0/4075033671 shutdown_connections 2023-10-18T19:34:26.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 --2- 172.21.15.88:0/4075033671 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f131810ccc0 0x7f13180f6400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 --2- 172.21.15.88:0/4075033671 >> v2:172.21.15.88:3300/0 conn(0x7f13181b2770 0x7f13181b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:26.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 -- 172.21.15.88:0/4075033671 >> 172.21.15.88:0/4075033671 conn(0x7f1318117390 msgr2=0x7f13180f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:26.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 -- 172.21.15.88:0/4075033671 shutdown_connections 2023-10-18T19:34:26.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:26.976 7f131e5ff700 1 -- 172.21.15.88:0/4075033671 wait complete. 2023-10-18T19:34:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 Processor -- start 2023-10-18T19:34:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 -- start start 2023-10-18T19:34:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13180bc800 0x7f13181c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13180a8270 con 0x7f13180d5470 2023-10-18T19:34:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13180de360 con 0x7f13180bc800 2023-10-18T19:34:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.001 7f131e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13180bcfc0 con 0x7f13180bc3b0 2023-10-18T19:34:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f1315ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f1315ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42850/0 (socket says 172.21.15.88:42850) 2023-10-18T19:34:27.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37222/0 (socket says 172.21.15.88:37222) 2023-10-18T19:34:27.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f1315ffd700 1 -- 172.21.15.88:0/4003554117 learned_addr learned my addr 172.21.15.88:0/4003554117 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:27.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f1316fff700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13180bc800 0x7f13181c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 -- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 msgr2=0x7f13181c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 -- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13180bc800 msgr2=0x7f13181c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13180bc800 0x7f13181c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 -- 172.21.15.88:0/4003554117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180b3220 con 0x7f13180d5470 2023-10-18T19:34:27.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f1315ffd700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:27.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.002 7f13167fe700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f13180d3f70 tx=0x7f13080068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:27.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f13180b3220 con 0x7f13180d5470 2023-10-18T19:34:27.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1308011690 con 0x7f13180d5470 2023-10-18T19:34:27.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13180d5cd0 con 0x7f13180d5470 2023-10-18T19:34:27.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1308011a60 con 0x7f13180d5470 2023-10-18T19:34:27.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13180ddfa0 con 0x7f13180d5470 2023-10-18T19:34:27.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.003 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f1308011c60 con 0x7f13180d5470 2023-10-18T19:34:27.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.004 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1308029060 con 0x7f13180d5470 2023-10-18T19:34:27.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.004 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13180f0530 con 0x7f13180d5470 2023-10-18T19:34:27.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.007 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f130800f300 con 0x7f13180d5470 2023-10-18T19:34:27.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.116 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f13181c4aa0 con 0x7f13180d5470 2023-10-18T19:34:27.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.117 7f13077fe700 1 -- 172.21.15.88:0/4003554117 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+47393 (secure 0 0 0) 0x7f1308011480 con 0x7f13180d5470 2023-10-18T19:34:27.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:27.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 >> v1:172.21.15.88:6800/107321 conn(0x7f12f401c1b0 legacy=0x7f12f401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 msgr2=0x7f13180bbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f13180d3f70 tx=0x7f13080068c0).stop 2023-10-18T19:34:27.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 shutdown_connections 2023-10-18T19:34:27.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13180bc800 0x7f13181c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13180d5470 0x7f13180bbd80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 --2- 172.21.15.88:0/4003554117 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f13180bc3b0 0x7f13181c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 >> 172.21.15.88:0/4003554117 conn(0x7f13180ca4e0 msgr2=0x7f1318120e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:27.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 shutdown_connections 2023-10-18T19:34:27.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.119 7f131e5ff700 1 -- 172.21.15.88:0/4003554117 wait complete. 2023-10-18T19:34:27.138 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6800","nonce":107321}]},"active_addr":"172.21.15.88:6800/107321","active_change":"2023-10-18 19:34:01.937943","available":true,"standbys":[{"gid":4102,"name":"x","available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2023-10-18T19:34:27.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T19:34:27.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T19:34:27.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:27.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.340 7f2fecf9d700 1 Processor -- start 2023-10-18T19:34:27.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.340 7f2fecf9d700 1 -- start start 2023-10-18T19:34:27.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fecf9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 0x7f2fe81b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fecf9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fe81b7570 0x7f2fe81b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fecf9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe810d560 con 0x7f2fe810cb30 2023-10-18T19:34:27.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fecf9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80f8a30 con 0x7f2fe81b7570 2023-10-18T19:34:27.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fecf9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80f1cb0 con 0x7f2fe81b4ae0 2023-10-18T19:34:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fe63fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2fe810cb30 0x7f2fe80f7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52040/0 (socket says 172.21.15.88:52040) 2023-10-18T19:34:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fe63fe700 1 -- 172.21.15.88:0/1396490954 learned_addr learned my addr 172.21.15.88:0/1396490954 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:27.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fe6bff700 1 --2- 172.21.15.88:0/1396490954 >> v2:172.21.15.88:3300/0 conn(0x7f2fe81b7570 0x7f2fe81b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.341 7f2fe5bfd700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 0x7f2fe81b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe53fc700 1 -- 172.21.15.88:0/1396490954 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389505761 0 0) 0x7f2fd8001110 con 0x7f2fe810cb30 2023-10-18T19:34:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe6bff700 1 -- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 msgr2=0x7f2fe81b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe6bff700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 0x7f2fe81b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe6bff700 1 -- 172.21.15.88:0/1396490954 >> v1:172.21.15.88:6789/0 conn(0x7f2fe810cb30 legacy=0x7f2fe80f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe6bff700 1 -- 172.21.15.88:0/1396490954 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe81bb010 con 0x7f2fe81b7570 2023-10-18T19:34:27.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe5bfd700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 0x7f2fe81b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:27.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe6bff700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe81b7570 0x7f2fe81b99d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2fe00032f0 tx=0x7f2fe0009d10).ready entity=mon.0 client_cookie=2d5fc7cda0ee9bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:27.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe53fc700 1 -- 172.21.15.88:0/1396490954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fe81bb010 con 0x7f2fe81b7570 2023-10-18T19:34:27.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe53fc700 1 -- 172.21.15.88:0/1396490954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000b800 con 0x7f2fe81b7570 2023-10-18T19:34:27.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fe53fc700 1 -- 172.21.15.88:0/1396490954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fe000ba30 con 0x7f2fe81b7570 2023-10-18T19:34:27.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fecf9d700 1 -- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe81b7570 msgr2=0x7f2fe81b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.342 7f2fecf9d700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe81b7570 0x7f2fe81b99d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2fe00032f0 tx=0x7f2fe0009d10).stop 2023-10-18T19:34:27.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 -- 172.21.15.88:0/1396490954 shutdown_connections 2023-10-18T19:34:27.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe81b7570 0x7f2fe81b99d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 --2- 172.21.15.88:0/1396490954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81b4ae0 0x7f2fe81b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 -- 172.21.15.88:0/1396490954 >> 172.21.15.88:0/1396490954 conn(0x7f2fe81258d0 msgr2=0x7f2fe8125d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:27.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 -- 172.21.15.88:0/1396490954 shutdown_connections 2023-10-18T19:34:27.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.343 7f2fecf9d700 1 -- 172.21.15.88:0/1396490954 wait complete. 2023-10-18T19:34:27.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.367 7f2fecf9d700 1 Processor -- start 2023-10-18T19:34:27.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.367 7f2fecf9d700 1 -- start start 2023-10-18T19:34:27.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 0x7f2fe81c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 0x7f2fe81c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe810ccd0 con 0x7f2fe80c7930 2023-10-18T19:34:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81b5de0 con 0x7f2fe81c3160 2023-10-18T19:34:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fecf9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81b3150 con 0x7f2fe81c2d10 2023-10-18T19:34:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fe63fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fe5bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 0x7f2fe81c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fe63fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37246/0 (socket says 172.21.15.88:37246) 2023-10-18T19:34:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fe63fe700 1 -- 172.21.15.88:0/1992780614 learned_addr learned my addr 172.21.15.88:0/1992780614 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.368 7f2fe6bff700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 0x7f2fe81c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 -- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 msgr2=0x7f2fe81c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 0x7f2fe81c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 -- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 msgr2=0x7f2fe81c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 0x7f2fe81c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 -- 172.21.15.88:0/1992780614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80b3e60 con 0x7f2fe80c7930 2023-10-18T19:34:27.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe6bff700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 0x7f2fe81c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:27.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe5bfd700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 0x7f2fe81c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:27.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fe63fe700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2fe80c62a0 tx=0x7f2fd800c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:27.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fd80072e0 con 0x7f2fe80c7930 2023-10-18T19:34:27.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8005620 con 0x7f2fe80c7930 2023-10-18T19:34:27.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2fd80059f0 con 0x7f2fe80c7930 2023-10-18T19:34:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80c7290 con 0x7f2fe80c7930 2023-10-18T19:34:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.369 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80c6ef0 con 0x7f2fe80c7930 2023-10-18T19:34:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.370 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2fd8005bf0 con 0x7f2fe80c7930 2023-10-18T19:34:27.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.370 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2fd8028f30 con 0x7f2fe80c7930 2023-10-18T19:34:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.370 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80f0320 con 0x7f2fe80c7930 2023-10-18T19:34:27.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.373 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f2fd80070d0 con 0x7f2fe80c7930 2023-10-18T19:34:27.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.471 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fe80e2d60 con 0x7f2fe80c7930 2023-10-18T19:34:27.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.472 7f2fd77fe700 1 -- 172.21.15.88:0/1992780614 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f2fd8000c30 con 0x7f2fe80c7930 2023-10-18T19:34:27.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:27.474 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.473 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 >> v1:172.21.15.88:6800/107321 conn(0x7f2fc401c1b0 legacy=0x7f2fc401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.473 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 msgr2=0x7f2fe81c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.473 7f2fecf9d700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2fe80c62a0 tx=0x7f2fd800c890).stop 2023-10-18T19:34:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 shutdown_connections 2023-10-18T19:34:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fe81c3160 0x7f2fe81c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fe80c7930 0x7f2fe81c26e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 --2- 172.21.15.88:0/1992780614 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2fe81c2d10 0x7f2fe81c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 >> 172.21.15.88:0/1992780614 conn(0x7f2fe80b5540 msgr2=0x7f2fe80dbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:27.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 shutdown_connections 2023-10-18T19:34:27.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.474 7f2fecf9d700 1 -- 172.21.15.88:0/1992780614 wait complete. 2023-10-18T19:34:27.492 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T19:34:27.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:27.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.690 7f1712dff700 1 Processor -- start 2023-10-18T19:34:27.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.690 7f1712dff700 1 -- start start 2023-10-18T19:34:27.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.690 7f1712dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 0x7f170c0f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.690 7f1712dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 0x7f170c1b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f1712dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0f1ec0 con 0x7f170c0f82e0 2023-10-18T19:34:27.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f1712dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c0f8b90 con 0x7f170c0f7e90 2023-10-18T19:34:27.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f1712dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170c118170 con 0x7f170c1b7b00 2023-10-18T19:34:27.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170a7fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f170c0f82e0 0x7f170c0f1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52050/0 (socket says 172.21.15.88:52050) 2023-10-18T19:34:27.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170a7fd700 1 -- 172.21.15.88:0/1515073805 learned_addr learned my addr 172.21.15.88:0/1515073805 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:27.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 --2- 172.21.15.88:0/1515073805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 0x7f170c1b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170affe700 1 --2- 172.21.15.88:0/1515073805 >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 0x7f170c0f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f1709ffc700 1 -- 172.21.15.88:0/1515073805 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180724447 0 0) 0x7f1700001110 con 0x7f170c0f82e0 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 -- 172.21.15.88:0/1515073805 >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 msgr2=0x7f170c0f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 --2- 172.21.15.88:0/1515073805 >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 0x7f170c0f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 -- 172.21.15.88:0/1515073805 >> v1:172.21.15.88:6789/0 conn(0x7f170c0f82e0 legacy=0x7f170c0f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 -- 172.21.15.88:0/1515073805 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c1bb5a0 con 0x7f170c1b7b00 2023-10-18T19:34:27.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170affe700 1 --2- 172.21.15.88:0/1515073805 >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 0x7f170c0f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:27.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.691 7f170b7ff700 1 --2- 172.21.15.88:0/1515073805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 0x7f170c1b9f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f17040032f0 tx=0x7f1704009c90).ready entity=mon.2 client_cookie=f7e5639e0a4c7616 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:27.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1709ffc700 1 -- 172.21.15.88:0/1515073805 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f170c1bb5a0 con 0x7f170c1b7b00 2023-10-18T19:34:27.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1709ffc700 1 -- 172.21.15.88:0/1515073805 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170400b820 con 0x7f170c1b7b00 2023-10-18T19:34:27.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1709ffc700 1 -- 172.21.15.88:0/1515073805 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f170400ba00 con 0x7f170c1b7b00 2023-10-18T19:34:27.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 -- 172.21.15.88:0/1515073805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 msgr2=0x7f170c1b9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 --2- 172.21.15.88:0/1515073805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 0x7f170c1b9f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f17040032f0 tx=0x7f1704009c90).stop 2023-10-18T19:34:27.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 -- 172.21.15.88:0/1515073805 shutdown_connections 2023-10-18T19:34:27.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 --2- 172.21.15.88:0/1515073805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c1b7b00 0x7f170c1b9f60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 --2- 172.21.15.88:0/1515073805 >> v2:172.21.15.88:3300/0 conn(0x7f170c0f7e90 0x7f170c0f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 -- 172.21.15.88:0/1515073805 >> 172.21.15.88:0/1515073805 conn(0x7f170c125ae0 msgr2=0x7f170c125f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:27.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 -- 172.21.15.88:0/1515073805 shutdown_connections 2023-10-18T19:34:27.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.692 7f1712dff700 1 -- 172.21.15.88:0/1515073805 wait complete. 2023-10-18T19:34:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.716 7f1712dff700 1 Processor -- start 2023-10-18T19:34:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 -- start start 2023-10-18T19:34:27.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 0x7f170c1c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 0x7f170c0d5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 0x7f170c1cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1161b0 con 0x7f170c1c6b00 2023-10-18T19:34:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0f3e50 con 0x7f170c0bd880 2023-10-18T19:34:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f1712dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0f4190 con 0x7f170c0d5660 2023-10-18T19:34:27.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170a7fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 0x7f170c0d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170affe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 0x7f170c1c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170b7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 0x7f170c1cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170a7fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 0x7f170c0d5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37272/0 (socket says 172.21.15.88:37272) 2023-10-18T19:34:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170affe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 0x7f170c1c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44384/0 (socket says 172.21.15.88:44384) 2023-10-18T19:34:27.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.717 7f170a7fd700 1 -- 172.21.15.88:0/3813570282 learned_addr learned my addr 172.21.15.88:0/3813570282 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 -- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 msgr2=0x7f170c1c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 0x7f170c1c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 -- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 msgr2=0x7f170c0d5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 0x7f170c0d5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 -- 172.21.15.88:0/3813570282 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0cce90 con 0x7f170c0d5660 2023-10-18T19:34:27.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f170b7ff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 0x7f170c1cd2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1704006fc0 tx=0x7f1704006c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f170c0cce90 con 0x7f170c0d5660 2023-10-18T19:34:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704011980 con 0x7f170c0d5660 2023-10-18T19:34:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1704021070 con 0x7f170c0d5660 2023-10-18T19:34:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f1712dff700 1 -- 172.21.15.88:0/3813570282 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c0dff60 con 0x7f170c0d5660 2023-10-18T19:34:27.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.718 7f1712dff700 1 -- 172.21.15.88:0/3813570282 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c0bdcd0 con 0x7f170c0d5660 2023-10-18T19:34:27.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.719 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f1704025410 con 0x7f170c0d5660 2023-10-18T19:34:27.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.719 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1704018030 con 0x7f170c0d5660 2023-10-18T19:34:27.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.720 7f1712dff700 1 -- 172.21.15.88:0/3813570282 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c0f0530 con 0x7f170c0d5660 2023-10-18T19:34:27.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.723 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f170400b610 con 0x7f170c0d5660 2023-10-18T19:34:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.820 7f1712dff700 1 -- 172.21.15.88:0/3813570282 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f170c0e2b90 con 0x7f170c0d5660 2023-10-18T19:34:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.820 7f16fbfff700 1 -- 172.21.15.88:0/3813570282 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f17040352a0 con 0x7f170c0d5660 2023-10-18T19:34:27.822 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:27.822 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 >> v1:172.21.15.88:6800/107321 conn(0x7f16e801c1b0 legacy=0x7f16e801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 msgr2=0x7f170c1cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 0x7f170c1cd2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1704006fc0 tx=0x7f1704006c40).stop 2023-10-18T19:34:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 shutdown_connections 2023-10-18T19:34:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f170c0d5660 0x7f170c1cd2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f170c0bd880 0x7f170c1c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 --2- 172.21.15.88:0/3813570282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170c1c6b00 0x7f170c0d5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 >> 172.21.15.88:0/3813570282 conn(0x7f170c0d6840 msgr2=0x7f170c11fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 shutdown_connections 2023-10-18T19:34:27.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:27.822 7f1712dff700 1 -- 172.21.15.88:0/3813570282 wait complete. 2023-10-18T19:34:27.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T19:34:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.039 7f67307ff700 1 Processor -- start 2023-10-18T19:34:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.039 7f67307ff700 1 -- start start 2023-10-18T19:34:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 0x7f67281b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 0x7f67280f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6728112320 con 0x7f67281b2b50 2023-10-18T19:34:28.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280f6e10 con 0x7f672810d0a0 2023-10-18T19:34:28.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f67307ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6728111c30 con 0x7f67281b35d0 2023-10-18T19:34:28.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f672cdfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f6727fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 0x7f67281b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f672d5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 0x7f67280f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f672cdfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44386/0 (socket says 172.21.15.88:44386) 2023-10-18T19:34:28.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f672cdfe700 1 -- 172.21.15.88:0/763093622 learned_addr learned my addr 172.21.15.88:0/763093622 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.040 7f672cdfe700 1 -- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 msgr2=0x7f67280f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672cdfe700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 0x7f67280f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672cdfe700 1 -- 172.21.15.88:0/763093622 >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 msgr2=0x7f67281b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672cdfe700 1 --2- 172.21.15.88:0/763093622 >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 0x7f67281b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672cdfe700 1 -- 172.21.15.88:0/763093622 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672810dad0 con 0x7f672810d0a0 2023-10-18T19:34:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672d5ff700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 0x7f67280f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f6727fff700 1 --2- 172.21.15.88:0/763093622 >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 0x7f67281b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f672cdfe700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f671c002f70 tx=0x7f671c009a50).ready entity=mon.1 client_cookie=1e632d5b08e14fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f67277fe700 1 -- 172.21.15.88:0/763093622 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f672810dad0 con 0x7f672810d0a0 2023-10-18T19:34:28.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f67277fe700 1 -- 172.21.15.88:0/763093622 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c00f510 con 0x7f672810d0a0 2023-10-18T19:34:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f67277fe700 1 -- 172.21.15.88:0/763093622 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671c00f6f0 con 0x7f672810d0a0 2023-10-18T19:34:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f67307ff700 1 -- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 msgr2=0x7f67280f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.041 7f67307ff700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f671c002f70 tx=0x7f671c009a50).stop 2023-10-18T19:34:28.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 -- 172.21.15.88:0/763093622 shutdown_connections 2023-10-18T19:34:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281b35d0 0x7f67280f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 --2- 172.21.15.88:0/763093622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f672810d0a0 0x7f67280f67e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 --2- 172.21.15.88:0/763093622 >> v2:172.21.15.88:3300/0 conn(0x7f67281b2b50 0x7f67281b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 -- 172.21.15.88:0/763093622 >> 172.21.15.88:0/763093622 conn(0x7f6728117770 msgr2=0x7f67280f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 -- 172.21.15.88:0/763093622 shutdown_connections 2023-10-18T19:34:28.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.042 7f67307ff700 1 -- 172.21.15.88:0/763093622 wait complete. 2023-10-18T19:34:28.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.066 7f67307ff700 1 Processor -- start 2023-10-18T19:34:28.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.066 7f67307ff700 1 -- start start 2023-10-18T19:34:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 0x7f67281b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281c5cc0 0x7f67281c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67281c6740 0x7f67281b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67280e6110 con 0x7f67280d2f40 2023-10-18T19:34:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67281b5be0 con 0x7f67281c6740 2023-10-18T19:34:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f67307ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67281b5f20 con 0x7f67281c5cc0 2023-10-18T19:34:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f672cdfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 0x7f67281b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f672cdfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 0x7f67281b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37284/0 (socket says 172.21.15.88:37284) 2023-10-18T19:34:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f672cdfe700 1 -- 172.21.15.88:0/774553492 learned_addr learned my addr 172.21.15.88:0/774553492 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f6727fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281c5cc0 0x7f67281c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.067 7f672d5ff700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67281c6740 0x7f67281b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 -- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281c5cc0 msgr2=0x7f67281c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281c5cc0 0x7f67281c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 -- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67281c6740 msgr2=0x7f67281b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67281c6740 0x7f67281b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 -- 172.21.15.88:0/774553492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280d2b80 con 0x7f67280d2f40 2023-10-18T19:34:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f6727fff700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67281c5cc0 0x7f67281c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f672cdfe700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 0x7f67281b63c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f67280d6350 tx=0x7f671c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67280d2b80 con 0x7f67280d2f40 2023-10-18T19:34:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c011610 con 0x7f67280d2f40 2023-10-18T19:34:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f67307ff700 1 -- 172.21.15.88:0/774553492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67281b69f0 con 0x7f67280d2f40 2023-10-18T19:34:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f671c0119e0 con 0x7f67280d2f40 2023-10-18T19:34:28.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.068 7f67307ff700 1 -- 172.21.15.88:0/774553492 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67281b7ab0 con 0x7f67280d2f40 2023-10-18T19:34:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.069 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f671c011be0 con 0x7f67280d2f40 2023-10-18T19:34:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.069 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f671c00e910 con 0x7f67280d2f40 2023-10-18T19:34:28.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.069 7f67307ff700 1 -- 172.21.15.88:0/774553492 --> v1:172.21.15.88:6801/107950 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67280882a0 con 0x7f67281b8100 2023-10-18T19:34:28.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.070 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== osd.0 v1:172.21.15.88:6801/107950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f6720009910 con 0x7f67281b8100 2023-10-18T19:34:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.077 7f67307ff700 1 -- 172.21.15.88:0/774553492 --> v1:172.21.15.88:6801/107950 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67280f0910 con 0x7f67281b8100 2023-10-18T19:34:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.077 7f6725ffb700 1 -- 172.21.15.88:0/774553492 <== osd.0 v1:172.21.15.88:6801/107950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f67280f0910 con 0x7f67281b8100 2023-10-18T19:34:28.079 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 >> v1:172.21.15.88:6801/107950 conn(0x7f67281b8100 legacy=0x7f67280a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 >> v1:172.21.15.88:6800/107321 conn(0x7f671001c1b0 legacy=0x7f671001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 msgr2=0x7f67281b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 --2- 172.21.15.88:0/774553492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67280d2f40 0x7f67281b63c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f67280d6350 tx=0x7f671c0068c0).stop 2023-10-18T19:34:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f672d5ff700 1 -- 172.21.15.88:0/774553492 reap_dead start 2023-10-18T19:34:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 shutdown_connections 2023-10-18T19:34:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 >> 172.21.15.88:0/774553492 conn(0x7f67280d88c0 msgr2=0x7f6728116640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 shutdown_connections 2023-10-18T19:34:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.078 7f67307ff700 1 -- 172.21.15.88:0/774553492 wait complete. 2023-10-18T19:34:28.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T19:34:28.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.295 7fdd801ff700 1 Processor -- start 2023-10-18T19:34:28.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.295 7fdd801ff700 1 -- start start 2023-10-18T19:34:28.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd801ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd801ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 0x7fdd781b9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd801ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd780ffe30 con 0x7fdd78103bc0 2023-10-18T19:34:28.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd801ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78111ba0 con 0x7fdd78104010 2023-10-18T19:34:28.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd801ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78104460 con 0x7fdd780f6a00 2023-10-18T19:34:28.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd77fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd7cfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 0x7fdd781b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd77fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42898/0 (socket says 172.21.15.88:42898) 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd77fff700 1 -- 172.21.15.88:0/601253084 learned_addr learned my addr 172.21.15.88:0/601253084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd7cfff700 1 -- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 msgr2=0x7fdd78103590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd7cfff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd7cfff700 1 -- 172.21.15.88:0/601253084 >> v1:172.21.15.88:6789/0 conn(0x7fdd78103bc0 legacy=0x7fdd781b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd76ffd700 1 -- 172.21.15.88:0/601253084 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567103607 0 0) 0x7fdd6c001110 con 0x7fdd78103bc0 2023-10-18T19:34:28.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd7cfff700 1 -- 172.21.15.88:0/601253084 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7810c7c0 con 0x7fdd78104010 2023-10-18T19:34:28.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.296 7fdd77fff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd7cfff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 0x7fdd781b9850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdd780a8e00 tx=0x7fdd7000f330).ready entity=mon.1 client_cookie=29da3c6745fed900 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd76ffd700 1 -- 172.21.15.88:0/601253084 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd7810c7c0 con 0x7fdd78104010 2023-10-18T19:34:28.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd76ffd700 1 -- 172.21.15.88:0/601253084 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7000fb30 con 0x7fdd78104010 2023-10-18T19:34:28.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd76ffd700 1 -- 172.21.15.88:0/601253084 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd70013070 con 0x7fdd78104010 2023-10-18T19:34:28.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd801ff700 1 -- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 msgr2=0x7fdd781b9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.297 7fdd801ff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 0x7fdd781b9850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdd780a8e00 tx=0x7fdd7000f330).stop 2023-10-18T19:34:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 -- 172.21.15.88:0/601253084 shutdown_connections 2023-10-18T19:34:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd78104010 0x7fdd781b9850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 --2- 172.21.15.88:0/601253084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd780f6a00 0x7fdd78103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 -- 172.21.15.88:0/601253084 >> 172.21.15.88:0/601253084 conn(0x7fdd78117770 msgr2=0x7fdd780f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 -- 172.21.15.88:0/601253084 shutdown_connections 2023-10-18T19:34:28.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.298 7fdd801ff700 1 -- 172.21.15.88:0/601253084 wait complete. 2023-10-18T19:34:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.322 7fdd801ff700 1 Processor -- start 2023-10-18T19:34:28.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.322 7fdd801ff700 1 -- start start 2023-10-18T19:34:28.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 0x7fdd780b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd781c20c0 0x7fdd781c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd781c2b40 0x7fdd781b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7808a440 con 0x7fdd780d9010 2023-10-18T19:34:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780b2b10 con 0x7fdd781c2b40 2023-10-18T19:34:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd801ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd781b58e0 con 0x7fdd781c20c0 2023-10-18T19:34:28.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd77fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 0x7fdd780b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd7cfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd781c2b40 0x7fdd781b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd777fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd781c20c0 0x7fdd781c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd77fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 0x7fdd780b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37286/0 (socket says 172.21.15.88:37286) 2023-10-18T19:34:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.323 7fdd77fff700 1 -- 172.21.15.88:0/931381249 learned_addr learned my addr 172.21.15.88:0/931381249 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 -- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd781c20c0 msgr2=0x7fdd781c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 --2- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd781c20c0 0x7fdd781c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 -- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd781c2b40 msgr2=0x7fdd781b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 --2- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd781c2b40 0x7fdd781b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 -- 172.21.15.88:0/931381249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780b2150 con 0x7fdd780d9010 2023-10-18T19:34:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd777fe700 1 --2- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd781c20c0 0x7fdd781c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd77fff700 1 --2- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 0x7fdd780b1930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdd780b2ea0 tx=0x7fdd6800ff30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd780b2150 con 0x7fdd780d9010 2023-10-18T19:34:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800dd20 con 0x7fdd780d9010 2023-10-18T19:34:28.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd801ff700 1 -- 172.21.15.88:0/931381249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd780db1e0 con 0x7fdd780d9010 2023-10-18T19:34:28.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd68010630 con 0x7fdd780d9010 2023-10-18T19:34:28.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.324 7fdd801ff700 1 -- 172.21.15.88:0/931381249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd781b4350 con 0x7fdd780d9010 2023-10-18T19:34:28.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.325 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fdd68010830 con 0x7fdd780d9010 2023-10-18T19:34:28.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.325 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fdd6802a370 con 0x7fdd780d9010 2023-10-18T19:34:28.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.325 7fdd801ff700 1 -- 172.21.15.88:0/931381249 --> v1:172.21.15.88:6813/107952 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd780882a0 con 0x7fdd780a7710 2023-10-18T19:34:28.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.326 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== osd.1 v1:172.21.15.88:6813/107952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fdd70006cd0 con 0x7fdd780a7710 2023-10-18T19:34:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.333 7fdd801ff700 1 -- 172.21.15.88:0/931381249 --> v1:172.21.15.88:6813/107952 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd780f0910 con 0x7fdd780a7710 2023-10-18T19:34:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.333 7fdd757fa700 1 -- 172.21.15.88:0/931381249 <== osd.1 v1:172.21.15.88:6813/107952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7fdd780f0910 con 0x7fdd780a7710 2023-10-18T19:34:28.335 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:28.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 >> v1:172.21.15.88:6813/107952 conn(0x7fdd780a7710 legacy=0x7fdd780a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 >> v1:172.21.15.88:6800/107321 conn(0x7fdd5801c1b0 legacy=0x7fdd5801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 msgr2=0x7fdd780b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 --2- 172.21.15.88:0/931381249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd780d9010 0x7fdd780b1930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdd780b2ea0 tx=0x7fdd6800ff30).stop 2023-10-18T19:34:28.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd7cfff700 1 -- 172.21.15.88:0/931381249 reap_dead start 2023-10-18T19:34:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 shutdown_connections 2023-10-18T19:34:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 >> 172.21.15.88:0/931381249 conn(0x7fdd780db770 msgr2=0x7fdd780b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 shutdown_connections 2023-10-18T19:34:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.334 7fdd801ff700 1 -- 172.21.15.88:0/931381249 wait complete. 2023-10-18T19:34:28.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T19:34:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.550 7f6223fff700 1 Processor -- start 2023-10-18T19:34:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.550 7f6223fff700 1 -- start start 2023-10-18T19:34:28.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62241b3140 0x7f62240f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6224111e90 con 0x7f622410cc10 2023-10-18T19:34:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240f6980 con 0x7f62241b3140 2023-10-18T19:34:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6223fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62241117a0 con 0x7f62241b26c0 2023-10-18T19:34:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f6221bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.551 7f621bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42914/0 (socket says 172.21.15.88:42914) 2023-10-18T19:34:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f6221bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37292/0 (socket says 172.21.15.88:37292) 2023-10-18T19:34:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 -- 172.21.15.88:0/3696622664 learned_addr learned my addr 172.21.15.88:0/3696622664 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f62223ff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62241b3140 0x7f62240f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 -- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62241b3140 msgr2=0x7f62240f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62241b3140 0x7f62240f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 -- 172.21.15.88:0/3696622664 >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 msgr2=0x7f62240f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 --2- 172.21.15.88:0/3696622664 >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 -- 172.21.15.88:0/3696622664 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622410d640 con 0x7f62241b26c0 2023-10-18T19:34:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f6221bfe700 1 --2- 172.21.15.88:0/3696622664 >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f621bfff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f620c002f70 tx=0x7f620c0099d0).ready entity=mon.2 client_cookie=4bb5aeac5ae8179f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f62213fd700 1 -- 172.21.15.88:0/3696622664 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f622410d640 con 0x7f62241b26c0 2023-10-18T19:34:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f62213fd700 1 -- 172.21.15.88:0/3696622664 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00f510 con 0x7f62241b26c0 2023-10-18T19:34:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f62213fd700 1 -- 172.21.15.88:0/3696622664 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f620c00f6f0 con 0x7f62241b26c0 2023-10-18T19:34:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f6223fff700 1 -- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 msgr2=0x7f62241b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.552 7f6223fff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f620c002f70 tx=0x7f620c0099d0).stop 2023-10-18T19:34:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 -- 172.21.15.88:0/3696622664 shutdown_connections 2023-10-18T19:34:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62241b3140 0x7f62240f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 --2- 172.21.15.88:0/3696622664 >> v2:172.21.15.88:3300/0 conn(0x7f622410cc10 0x7f62240f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 --2- 172.21.15.88:0/3696622664 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241b26c0 0x7f62241b2b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 -- 172.21.15.88:0/3696622664 >> 172.21.15.88:0/3696622664 conn(0x7f62241172e0 msgr2=0x7f62240f2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 -- 172.21.15.88:0/3696622664 shutdown_connections 2023-10-18T19:34:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.553 7f6223fff700 1 -- 172.21.15.88:0/3696622664 wait complete. 2023-10-18T19:34:28.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.577 7f6223fff700 1 Processor -- start 2023-10-18T19:34:28.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 -- start start 2023-10-18T19:34:28.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62240b9c40 0x7f62241c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 0x7f62240bab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62241c68c0 0x7f62240bb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240e24e0 con 0x7f62241c68c0 2023-10-18T19:34:28.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240b8040 con 0x7f62240b9c40 2023-10-18T19:34:28.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6223fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62240d2cf0 con 0x7f62241c6470 2023-10-18T19:34:28.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f6221bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62240b9c40 0x7f62241c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f621bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 0x7f62240bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.578 7f62223ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62241c68c0 0x7f62240bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 0x7f62240bab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42928/0 (socket says 172.21.15.88:42928) 2023-10-18T19:34:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621bfff700 1 -- 172.21.15.88:0/2094863653 learned_addr learned my addr 172.21.15.88:0/2094863653 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 -- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 msgr2=0x7f62240bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 --2- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 0x7f62240bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 -- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62240b9c40 msgr2=0x7f62241c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 --2- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f62240b9c40 0x7f62241c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 -- 172.21.15.88:0/2094863653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240d3700 con 0x7f62241c68c0 2023-10-18T19:34:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621bfff700 1 --2- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f62241c6470 0x7f62240bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f62223ff700 1 --2- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62241c68c0 0x7f62240bb150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f621c00c000 tx=0x7f621c00ecf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f62240d3700 con 0x7f62241c68c0 2023-10-18T19:34:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c00c7b0 con 0x7f62241c68c0 2023-10-18T19:34:28.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f6223fff700 1 -- 172.21.15.88:0/2094863653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240ba090 con 0x7f62241c68c0 2023-10-18T19:34:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.579 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f621c00f040 con 0x7f62241c68c0 2023-10-18T19:34:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.580 7f6223fff700 1 -- 172.21.15.88:0/2094863653 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240bb780 con 0x7f62241c68c0 2023-10-18T19:34:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.580 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f621c011070 con 0x7f62241c68c0 2023-10-18T19:34:28.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.580 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f621c010040 con 0x7f62241c68c0 2023-10-18T19:34:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.581 7f6223fff700 1 -- 172.21.15.88:0/2094863653 --> v1:172.21.15.88:6809/107953 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62240e6170 con 0x7f62240e5560 2023-10-18T19:34:28.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.582 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== osd.2 v1:172.21.15.88:6809/107953 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f62240e6170 con 0x7f62240e5560 2023-10-18T19:34:28.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.588 7f6223fff700 1 -- 172.21.15.88:0/2094863653 --> v1:172.21.15.88:6809/107953 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62240882a0 con 0x7f62240e5560 2023-10-18T19:34:28.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.588 7f621affd700 1 -- 172.21.15.88:0/2094863653 <== osd.2 v1:172.21.15.88:6809/107953 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f620c006bf0 con 0x7f62240e5560 2023-10-18T19:34:28.590 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:28.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 >> v1:172.21.15.88:6809/107953 conn(0x7f62240e5560 legacy=0x7f62240a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 >> v1:172.21.15.88:6800/107321 conn(0x7f620801c1b0 legacy=0x7f620801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62241c68c0 msgr2=0x7f62240bb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 --2- 172.21.15.88:0/2094863653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62241c68c0 0x7f62240bb150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f621c00c000 tx=0x7f621c00ecf0).stop 2023-10-18T19:34:28.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f62223ff700 1 -- 172.21.15.88:0/2094863653 reap_dead start 2023-10-18T19:34:28.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 shutdown_connections 2023-10-18T19:34:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 >> 172.21.15.88:0/2094863653 conn(0x7f62240bcc50 msgr2=0x7f62241b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 shutdown_connections 2023-10-18T19:34:28.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.589 7f6223fff700 1 -- 172.21.15.88:0/2094863653 wait complete. 2023-10-18T19:34:28.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T19:34:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.807 7f47b6bff700 1 Processor -- start 2023-10-18T19:34:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.807 7f47b6bff700 1 -- start start 2023-10-18T19:34:28.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47b6bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 0x7f47b00f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47b6bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 0x7f47b01ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47b6bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00ab370 con 0x7f47b01b2e00 2023-10-18T19:34:28.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47b6bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00a8e10 con 0x7f47b01b8150 2023-10-18T19:34:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47b6bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01125d0 con 0x7f47b010d350 2023-10-18T19:34:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47aeffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 0x7f47b00f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47af7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 0x7f47b01ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47ae7fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f47b01b2e00 0x7f47b01b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52062/0 (socket says 172.21.15.88:52062) 2023-10-18T19:34:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47ae7fd700 1 -- 172.21.15.88:0/3401651692 learned_addr learned my addr 172.21.15.88:0/3401651692 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47aeffe700 1 -- 172.21.15.88:0/3401651692 >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 msgr2=0x7f47b01ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47aeffe700 1 --2- 172.21.15.88:0/3401651692 >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 0x7f47b01ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47aeffe700 1 -- 172.21.15.88:0/3401651692 >> v1:172.21.15.88:6789/0 conn(0x7f47b01b2e00 legacy=0x7f47b01b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47aeffe700 1 -- 172.21.15.88:0/3401651692 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0111ee0 con 0x7f47b010d350 2023-10-18T19:34:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.808 7f47af7ff700 1 --2- 172.21.15.88:0/3401651692 >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 0x7f47b01ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47aeffe700 1 --2- 172.21.15.88:0/3401651692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 0x7f47b00f6a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f47a0002f70 tx=0x7f47a000b970).ready entity=mon.1 client_cookie=99ae223087d929f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47adffc700 1 -- 172.21.15.88:0/3401651692 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47b0111ee0 con 0x7f47b010d350 2023-10-18T19:34:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47adffc700 1 -- 172.21.15.88:0/3401651692 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000d5c0 con 0x7f47b010d350 2023-10-18T19:34:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47adffc700 1 -- 172.21.15.88:0/3401651692 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a000d990 con 0x7f47b010d350 2023-10-18T19:34:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47b6bff700 1 -- 172.21.15.88:0/3401651692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 msgr2=0x7f47b00f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47b6bff700 1 --2- 172.21.15.88:0/3401651692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 0x7f47b00f6a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f47a0002f70 tx=0x7f47a000b970).stop 2023-10-18T19:34:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.809 7f47b6bff700 1 -- 172.21.15.88:0/3401651692 shutdown_connections 2023-10-18T19:34:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.810 7f47b6bff700 1 --2- 172.21.15.88:0/3401651692 >> v2:172.21.15.88:3300/0 conn(0x7f47b01b8150 0x7f47b01ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.810 7f47b6bff700 1 --2- 172.21.15.88:0/3401651692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b010d350 0x7f47b00f6a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.810 7f47b6bff700 1 -- 172.21.15.88:0/3401651692 >> 172.21.15.88:0/3401651692 conn(0x7f47b0117a20 msgr2=0x7f47b00f33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.810 7f47b6bff700 1 -- 172.21.15.88:0/3401651692 shutdown_connections 2023-10-18T19:34:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.810 7f47b6bff700 1 -- 172.21.15.88:0/3401651692 wait complete. 2023-10-18T19:34:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.834 7f47b6bff700 1 Processor -- start 2023-10-18T19:34:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.834 7f47b6bff700 1 -- start start 2023-10-18T19:34:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47b00b3760 0x7f47b00b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 0x7f47b01c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b01c4bd0 0x7f47b00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00d2800 con 0x7f47b00b3760 2023-10-18T19:34:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00b43b0 con 0x7f47b01c4bd0 2023-10-18T19:34:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47b6bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00de9c0 con 0x7f47b01c4150 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47ae7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 0x7f47b01c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b01c4bd0 0x7f47b00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47ae7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 0x7f47b01c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42936/0 (socket says 172.21.15.88:42936) 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47ae7fd700 1 -- 172.21.15.88:0/3520272841 learned_addr learned my addr 172.21.15.88:0/3520272841 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47aeffe700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47b00b3760 0x7f47b00b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 -- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 msgr2=0x7f47b01c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 0x7f47b01c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 -- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47b00b3760 msgr2=0x7f47b00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47b00b3760 0x7f47b00b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47af7ff700 1 -- 172.21.15.88:0/3520272841 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00df3f0 con 0x7f47b01c4bd0 2023-10-18T19:34:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47ae7fd700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f47b01c4150 0x7f47b01c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.835 7f47aeffe700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47b00b3760 0x7f47b00b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f47af7ff700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b01c4bd0 0x7f47b00b4640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f47b0120420 tx=0x7f47a800eda0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a800f040 con 0x7f47b01c4bd0 2023-10-18T19:34:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800c880 con 0x7f47b01c4bd0 2023-10-18T19:34:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b00e0d90 con 0x7f47b01c4bd0 2023-10-18T19:34:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a800cc50 con 0x7f47b01c4bd0 2023-10-18T19:34:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00b4e50 con 0x7f47b01c4bd0 2023-10-18T19:34:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.836 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f47a8022060 con 0x7f47b01c4bd0 2023-10-18T19:34:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.837 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f47a8010040 con 0x7f47b01c4bd0 2023-10-18T19:34:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.837 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 --> v1:172.21.15.88:6805/107951 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47b00882a0 con 0x7f47b00ad950 2023-10-18T19:34:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.838 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== osd.3 v1:172.21.15.88:6805/107951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f47a40015c0 con 0x7f47b00ad950 2023-10-18T19:34:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 --> v1:172.21.15.88:6805/107951 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47b01c5020 con 0x7f47b00ad950 2023-10-18T19:34:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f479ffff700 1 -- 172.21.15.88:0/3520272841 <== osd.3 v1:172.21.15.88:6805/107951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f47a40017a0 con 0x7f47b00ad950 2023-10-18T19:34:28.847 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:28.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 >> v1:172.21.15.88:6805/107951 conn(0x7f47b00ad950 legacy=0x7f47b00a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 >> v1:172.21.15.88:6800/107321 conn(0x7f478c01c1b0 legacy=0x7f478c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b01c4bd0 msgr2=0x7f47b00b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:28.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.845 7f47b6bff700 1 --2- 172.21.15.88:0/3520272841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47b01c4bd0 0x7f47b00b4640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f47b0120420 tx=0x7f47a800eda0).stop 2023-10-18T19:34:28.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.846 7f47af7ff700 1 -- 172.21.15.88:0/3520272841 reap_dead start 2023-10-18T19:34:28.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.846 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 shutdown_connections 2023-10-18T19:34:28.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.846 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 >> 172.21.15.88:0/3520272841 conn(0x7f47b00bde50 msgr2=0x7f47b00aca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:28.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.846 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 shutdown_connections 2023-10-18T19:34:28.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:28.846 7f47b6bff700 1 -- 172.21.15.88:0/3520272841 wait complete. 2023-10-18T19:34:28.863 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:34:29.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.062 7f2449dff700 1 Processor -- start 2023-10-18T19:34:29.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.062 7f2449dff700 1 -- start start 2023-10-18T19:34:29.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2449dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:29.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2449dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 0x7f24441ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:29.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2449dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440abcd0 con 0x7f24441b2b50 2023-10-18T19:34:29.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2449dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444112320 con 0x7f244410d0a0 2023-10-18T19:34:29.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2449dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24440f6e10 con 0x7f24441b7ea0 2023-10-18T19:34:29.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:29.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44440/0 (socket says 172.21.15.88:44440) 2023-10-18T19:34:29.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 -- 172.21.15.88:0/4010988627 learned_addr learned my addr 172.21.15.88:0/4010988627 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:29.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f24427ff700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 0x7f24441ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 -- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 msgr2=0x7f24441ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 0x7f24441ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 -- 172.21.15.88:0/4010988627 >> v1:172.21.15.88:6789/0 conn(0x7f24441b2b50 legacy=0x7f24441b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2440ffc700 1 -- 172.21.15.88:0/4010988627 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221166679 0 0) 0x7f2438001110 con 0x7f24441b2b50 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f2441ffe700 1 -- 172.21.15.88:0/4010988627 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444111c30 con 0x7f244410d0a0 2023-10-18T19:34:29.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.063 7f24427ff700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 0x7f24441ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2441ffe700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f24441124d0 tx=0x7f2434009ab0).ready entity=mon.1 client_cookie=f9e35ab59326eb6c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2440ffc700 1 -- 172.21.15.88:0/4010988627 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2444111c30 con 0x7f244410d0a0 2023-10-18T19:34:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2440ffc700 1 -- 172.21.15.88:0/4010988627 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400f510 con 0x7f244410d0a0 2023-10-18T19:34:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2440ffc700 1 -- 172.21.15.88:0/4010988627 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f243400f6f0 con 0x7f244410d0a0 2023-10-18T19:34:29.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2449dff700 1 -- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 msgr2=0x7f24440f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.064 7f2449dff700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f24441124d0 tx=0x7f2434009ab0).stop 2023-10-18T19:34:29.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 -- 172.21.15.88:0/4010988627 shutdown_connections 2023-10-18T19:34:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441b7ea0 0x7f24441ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 --2- 172.21.15.88:0/4010988627 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f244410d0a0 0x7f24440f67e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 -- 172.21.15.88:0/4010988627 >> 172.21.15.88:0/4010988627 conn(0x7f2444117770 msgr2=0x7f24440f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:29.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 -- 172.21.15.88:0/4010988627 shutdown_connections 2023-10-18T19:34:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.065 7f2449dff700 1 -- 172.21.15.88:0/4010988627 wait complete. 2023-10-18T19:34:29.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.089 7f2449dff700 1 Processor -- start 2023-10-18T19:34:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.089 7f2449dff700 1 -- start start 2023-10-18T19:34:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 0x7f24441c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 0x7f24440cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441c6910 0x7f24440cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440b6910 con 0x7f24440d0eb0 2023-10-18T19:34:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440d0a10 con 0x7f24441c64c0 2023-10-18T19:34:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2449dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24440d07e0 con 0x7f24441c6910 2023-10-18T19:34:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2441ffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 0x7f24441c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 0x7f24440cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2441ffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 0x7f24441c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37334/0 (socket says 172.21.15.88:37334) 2023-10-18T19:34:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f2441ffe700 1 -- 172.21.15.88:0/1514432979 learned_addr learned my addr 172.21.15.88:0/1514432979 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24427ff700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441c6910 0x7f24440cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 -- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441c6910 msgr2=0x7f24440cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441c6910 0x7f24440cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 -- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 msgr2=0x7f24441c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 0x7f24441c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.090 7f24417fd700 1 -- 172.21.15.88:0/1514432979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440b6b80 con 0x7f24441c64c0 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f24417fd700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 0x7f24440cf5e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f24440b94b0 tx=0x7f243800c870).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f24440b6b80 con 0x7f24441c64c0 2023-10-18T19:34:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438007030 con 0x7f24441c64c0 2023-10-18T19:34:29.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2449dff700 1 -- 172.21.15.88:0/1514432979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440ced20 con 0x7f24441c64c0 2023-10-18T19:34:29.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2438006520 con 0x7f24441c64c0 2023-10-18T19:34:29.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2449dff700 1 -- 172.21.15.88:0/1514432979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440d1300 con 0x7f24441c64c0 2023-10-18T19:34:29.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.091 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f243801a020 con 0x7f24441c64c0 2023-10-18T19:34:29.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.092 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2438029b00 con 0x7f24441c64c0 2023-10-18T19:34:29.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.092 7f2449dff700 1 -- 172.21.15.88:0/1514432979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24440f0910 con 0x7f24441c64c0 2023-10-18T19:34:29.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.095 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f2438007db0 con 0x7f24441c64c0 2023-10-18T19:34:29.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.192 7f2449dff700 1 -- 172.21.15.88:0/1514432979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24440a6050 con 0x7f24441c64c0 2023-10-18T19:34:29.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.192 7f2432ffd700 1 -- 172.21.15.88:0/1514432979 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2438000c30 con 0x7f24441c64c0 2023-10-18T19:34:29.194 INFO:teuthology.orchestra.run.smithi088.stdout:38654705669 2023-10-18T19:34:29.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 -- 172.21.15.88:0/1514432979 >> v1:172.21.15.88:6800/107321 conn(0x7f242001c1b0 legacy=0x7f242001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 -- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 msgr2=0x7f24440cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:29.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 0x7f24440cf5e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f24440b94b0 tx=0x7f243800c870).stop 2023-10-18T19:34:29.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 -- 172.21.15.88:0/1514432979 shutdown_connections 2023-10-18T19:34:29.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f24441c6910 0x7f24440cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24440d0eb0 0x7f24441c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 --2- 172.21.15.88:0/1514432979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24441c64c0 0x7f24440cf5e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:29.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.193 7f2449dff700 1 -- 172.21.15.88:0/1514432979 >> 172.21.15.88:0/1514432979 conn(0x7f24440e0f50 msgr2=0x7f24440d6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:29.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.194 7f2449dff700 1 -- 172.21.15.88:0/1514432979 shutdown_connections 2023-10-18T19:34:29.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:29.194 7f2449dff700 1 -- 172.21.15.88:0/1514432979 wait complete. 2023-10-18T19:34:29.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2023-10-18T19:34:30.212 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:34:30.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.423 7fdf367ff700 1 Processor -- start 2023-10-18T19:34:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.423 7fdf367ff700 1 -- start start 2023-10-18T19:34:30.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf367ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf300f20c0 0x7fdf301ba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf367ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 0x7fdf301bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf367ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300abcd0 con 0x7fdf30115f40 2023-10-18T19:34:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf367ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3010f910 con 0x7fdf300f20c0 2023-10-18T19:34:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf367ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30115580 con 0x7fdf301ba740 2023-10-18T19:34:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf300f20c0 0x7fdf301ba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf300f20c0 0x7fdf301ba110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37346/0 (socket says 172.21.15.88:37346) 2023-10-18T19:34:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2f3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 0x7fdf301bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 -- 172.21.15.88:0/1081090793 learned_addr learned my addr 172.21.15.88:0/1081090793 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2ebfe700 1 --1- 172.21.15.88:0/1081090793 >> v1:172.21.15.88:6789/0 conn(0x7fdf30115f40 0x7fdf300f18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52080/0 (socket says 172.21.15.88:52080) 2023-10-18T19:34:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 -- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 msgr2=0x7fdf301bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 0x7fdf301bcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 -- 172.21.15.88:0/1081090793 >> v1:172.21.15.88:6789/0 conn(0x7fdf30115f40 legacy=0x7fdf300f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2e3fd700 1 -- 172.21.15.88:0/1081090793 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3010fdb0 con 0x7fdf300f20c0 2023-10-18T19:34:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2f3ff700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 0x7fdf301bcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.424 7fdf2dbfc700 1 -- 172.21.15.88:0/1081090793 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488595859 0 0) 0x7fdf20001110 con 0x7fdf30115f40 2023-10-18T19:34:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf2e3fd700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300f20c0 0x7fdf301ba110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fdf24002f70 tx=0x7fdf24009a50).ready entity=mon.0 client_cookie=4e2f97faf488b65a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf2dbfc700 1 -- 172.21.15.88:0/1081090793 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf2400f510 con 0x7fdf300f20c0 2023-10-18T19:34:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf2dbfc700 1 -- 172.21.15.88:0/1081090793 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400f710 con 0x7fdf300f20c0 2023-10-18T19:34:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf2dbfc700 1 -- 172.21.15.88:0/1081090793 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf2400f8f0 con 0x7fdf300f20c0 2023-10-18T19:34:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf367ff700 1 -- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300f20c0 msgr2=0x7fdf301ba110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf367ff700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300f20c0 0x7fdf301ba110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fdf24002f70 tx=0x7fdf24009a50).stop 2023-10-18T19:34:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf367ff700 1 -- 172.21.15.88:0/1081090793 shutdown_connections 2023-10-18T19:34:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.425 7fdf367ff700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301ba740 0x7fdf301bcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.426 7fdf367ff700 1 --2- 172.21.15.88:0/1081090793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300f20c0 0x7fdf301ba110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.426 7fdf367ff700 1 -- 172.21.15.88:0/1081090793 >> 172.21.15.88:0/1081090793 conn(0x7fdf30117770 msgr2=0x7fdf300f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.426 7fdf367ff700 1 -- 172.21.15.88:0/1081090793 shutdown_connections 2023-10-18T19:34:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.426 7fdf367ff700 1 -- 172.21.15.88:0/1081090793 wait complete. 2023-10-18T19:34:30.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.450 7fdf367ff700 1 Processor -- start 2023-10-18T19:34:30.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.450 7fdf367ff700 1 -- start start 2023-10-18T19:34:30.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdf301c6200 0x7fdf301c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301c6c80 0x7fdf300d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300b57f0 con 0x7fdf300cfbb0 2023-10-18T19:34:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300d0140 con 0x7fdf301c6c80 2023-10-18T19:34:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf367ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300b5d40 con 0x7fdf301c6200 2023-10-18T19:34:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf2ebfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf2ebfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37356/0 (socket says 172.21.15.88:37356) 2023-10-18T19:34:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf2e3fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdf301c6200 0x7fdf301c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf2ebfe700 1 -- 172.21.15.88:0/3506345042 learned_addr learned my addr 172.21.15.88:0/3506345042 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.451 7fdf2f3ff700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301c6c80 0x7fdf300d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 -- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdf301c6200 msgr2=0x7fdf301c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdf301c6200 0x7fdf301c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 -- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301c6c80 msgr2=0x7fdf300d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301c6c80 0x7fdf300d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 -- 172.21.15.88:0/3506345042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300d1c70 con 0x7fdf300cfbb0 2023-10-18T19:34:30.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf2ebfe700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdf300d02f0 tx=0x7fdf2000c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf300d1c70 con 0x7fdf300cfbb0 2023-10-18T19:34:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200072e0 con 0x7fdf300cfbb0 2023-10-18T19:34:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300d1060 con 0x7fdf300cfbb0 2023-10-18T19:34:30.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdf20005750 con 0x7fdf300cfbb0 2023-10-18T19:34:30.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.452 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf300d15b0 con 0x7fdf300cfbb0 2023-10-18T19:34:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.453 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fdf2001b070 con 0x7fdf300cfbb0 2023-10-18T19:34:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.453 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fdf20028980 con 0x7fdf300cfbb0 2023-10-18T19:34:30.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.453 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf300f0910 con 0x7fdf300cfbb0 2023-10-18T19:34:30.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.457 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fdf200070d0 con 0x7fdf300cfbb0 2023-10-18T19:34:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.554 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf300a6050 con 0x7fdf300cfbb0 2023-10-18T19:34:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.554 7fdf1ffff700 1 -- 172.21.15.88:0/3506345042 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf20000c30 con 0x7fdf300cfbb0 2023-10-18T19:34:30.556 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.555 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 >> v1:172.21.15.88:6800/107321 conn(0x7fdf0c01c1b0 legacy=0x7fdf0c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.555 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 msgr2=0x7fdf300bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.555 7fdf367ff700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdf300d02f0 tx=0x7fdf2000c890).stop 2023-10-18T19:34:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.555 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 shutdown_connections 2023-10-18T19:34:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf301c6c80 0x7fdf300d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf300cfbb0 0x7fdf300bd930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 --2- 172.21.15.88:0/3506345042 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdf301c6200 0x7fdf301c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 >> 172.21.15.88:0/3506345042 conn(0x7fdf300adf80 msgr2=0x7fdf300d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 shutdown_connections 2023-10-18T19:34:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.556 7fdf367ff700 1 -- 172.21.15.88:0/3506345042 wait complete. 2023-10-18T19:34:30.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2023-10-18T19:34:30.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T19:34:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 Processor -- start 2023-10-18T19:34:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 -- start start 2023-10-18T19:34:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 0x7fec10103590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 0x7fec101b9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100ffe30 con 0x7fec10103bc0 2023-10-18T19:34:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec10111ba0 con 0x7fec10104010 2023-10-18T19:34:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.773 7fec153ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec10104460 con 0x7fec100f6a00 2023-10-18T19:34:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 0x7fec10103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0dfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 0x7fec101b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec07fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec10103bc0 0x7fec101b6030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52092/0 (socket says 172.21.15.88:52092) 2023-10-18T19:34:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec07fff700 1 -- 172.21.15.88:0/735717014 learned_addr learned my addr 172.21.15.88:0/735717014 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 -- 172.21.15.88:0/735717014 >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 msgr2=0x7fec101b9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 --2- 172.21.15.88:0/735717014 >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 0x7fec101b9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0cffd700 1 -- 172.21.15.88:0/735717014 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017300306 0 0) 0x7febf8001110 con 0x7fec10103bc0 2023-10-18T19:34:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 -- 172.21.15.88:0/735717014 >> v1:172.21.15.88:6789/0 conn(0x7fec10103bc0 legacy=0x7fec101b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 -- 172.21.15.88:0/735717014 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1010c7c0 con 0x7fec100f6a00 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0dfff700 1 --2- 172.21.15.88:0/735717014 >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 0x7fec101b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.774 7fec0d7fe700 1 --2- 172.21.15.88:0/735717014 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 0x7fec10103590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fec00002f70 tx=0x7fec0000b970).ready entity=mon.1 client_cookie=b7e2ab44a52c9ac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec0cffd700 1 -- 172.21.15.88:0/735717014 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec1010c7c0 con 0x7fec100f6a00 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec0cffd700 1 -- 172.21.15.88:0/735717014 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000d610 con 0x7fec100f6a00 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec0cffd700 1 -- 172.21.15.88:0/735717014 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec0000d9e0 con 0x7fec100f6a00 2023-10-18T19:34:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 -- 172.21.15.88:0/735717014 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 msgr2=0x7fec10103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 --2- 172.21.15.88:0/735717014 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 0x7fec10103590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fec00002f70 tx=0x7fec0000b970).stop 2023-10-18T19:34:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 -- 172.21.15.88:0/735717014 shutdown_connections 2023-10-18T19:34:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 --2- 172.21.15.88:0/735717014 >> v2:172.21.15.88:3300/0 conn(0x7fec10104010 0x7fec101b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 --2- 172.21.15.88:0/735717014 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100f6a00 0x7fec10103590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 -- 172.21.15.88:0/735717014 >> 172.21.15.88:0/735717014 conn(0x7fec10117770 msgr2=0x7fec100f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 -- 172.21.15.88:0/735717014 shutdown_connections 2023-10-18T19:34:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.775 7fec153ff700 1 -- 172.21.15.88:0/735717014 wait complete. 2023-10-18T19:34:30.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.799 7fec153ff700 1 Processor -- start 2023-10-18T19:34:30.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.799 7fec153ff700 1 -- start start 2023-10-18T19:34:30.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 0x7fec101c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 0x7fec101c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:30.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100f3110 con 0x7fec101c63f0 2023-10-18T19:34:30.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100cd540 con 0x7fec100cee70 2023-10-18T19:34:30.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec153ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec100cd1e0 con 0x7fec100cea20 2023-10-18T19:34:30.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec07fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 0x7fec101c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec0d7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec0dfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 0x7fec101c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec0d7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42954/0 (socket says 172.21.15.88:42954) 2023-10-18T19:34:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec0d7fe700 1 -- 172.21.15.88:0/4014305795 learned_addr learned my addr 172.21.15.88:0/4014305795 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.800 7fec07fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 0x7fec101c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44490/0 (socket says 172.21.15.88:44490) 2023-10-18T19:34:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 -- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 msgr2=0x7fec101c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 -- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 msgr2=0x7fec101c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 0x7fec101c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 -- 172.21.15.88:0/4014305795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100cce20 con 0x7fec101c63f0 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0d7fe700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec0dfff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 0x7fec101c6840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fec100b95a0 tx=0x7fec0800ed70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec100cce20 con 0x7fec101c63f0 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800c880 con 0x7fec101c63f0 2023-10-18T19:34:30.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fec0800f040 con 0x7fec101c63f0 2023-10-18T19:34:30.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec153ff700 1 -- 172.21.15.88:0/4014305795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec101c5f70 con 0x7fec101c63f0 2023-10-18T19:34:30.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.801 7fec153ff700 1 -- 172.21.15.88:0/4014305795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101c7050 con 0x7fec101c63f0 2023-10-18T19:34:30.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.802 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fec08022060 con 0x7fec101c63f0 2023-10-18T19:34:30.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.802 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fec08010040 con 0x7fec101c63f0 2023-10-18T19:34:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.802 7fec153ff700 1 -- 172.21.15.88:0/4014305795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec101c61d0 con 0x7fec101c63f0 2023-10-18T19:34:30.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.805 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fec0800c670 con 0x7fec101c63f0 2023-10-18T19:34:30.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.901 7fec153ff700 1 -- 172.21.15.88:0/4014305795 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec100f0910 con 0x7fec101c63f0 2023-10-18T19:34:30.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.901 7fec067fc700 1 -- 172.21.15.88:0/4014305795 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec10100050 con 0x7fec101c63f0 2023-10-18T19:34:30.903 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 -- 172.21.15.88:0/4014305795 >> v1:172.21.15.88:6800/107321 conn(0x7febf401c1b0 legacy=0x7febf401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 -- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 msgr2=0x7fec101c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 0x7fec101c6840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fec100b95a0 tx=0x7fec0800ed70).stop 2023-10-18T19:34:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 -- 172.21.15.88:0/4014305795 shutdown_connections 2023-10-18T19:34:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec101c63f0 0x7fec101c6840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec100cea20 0x7fec101c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 --2- 172.21.15.88:0/4014305795 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec100cee70 0x7fec101c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 -- 172.21.15.88:0/4014305795 >> 172.21.15.88:0/4014305795 conn(0x7fec100ad4b0 msgr2=0x7fec100aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.902 7fec153ff700 1 -- 172.21.15.88:0/4014305795 shutdown_connections 2023-10-18T19:34:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:30.903 7fec153ff700 1 -- 172.21.15.88:0/4014305795 wait complete. 2023-10-18T19:34:30.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-10-18T19:34:30.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T19:34:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.120 7f9068fff700 1 Processor -- start 2023-10-18T19:34:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.120 7f9068fff700 1 -- start start 2023-10-18T19:34:31.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9068fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 0x7f90640f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9068fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f90640f2340 0x7f90641b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9068fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90640abcd0 con 0x7f906410d0a0 2023-10-18T19:34:31.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9068fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9064112320 con 0x7f90640f2340 2023-10-18T19:34:31.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9068fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90640f2790 con 0x7f90640f18c0 2023-10-18T19:34:31.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90609fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 0x7f90640f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90619ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f90640f2340 0x7f90641b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90611fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f906410d0a0 0x7f90640f67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52102/0 (socket says 172.21.15.88:52102) 2023-10-18T19:34:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90611fe700 1 -- 172.21.15.88:0/282503388 learned_addr learned my addr 172.21.15.88:0/282503388 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:31.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90609fd700 1 -- 172.21.15.88:0/282503388 >> v2:172.21.15.88:3300/0 conn(0x7f90640f2340 msgr2=0x7f90641b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:31.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90609fd700 1 --2- 172.21.15.88:0/282503388 >> v2:172.21.15.88:3300/0 conn(0x7f90640f2340 0x7f90641b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90609fd700 1 -- 172.21.15.88:0/282503388 >> v1:172.21.15.88:6789/0 conn(0x7f906410d0a0 legacy=0x7f90640f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f9053fff700 1 -- 172.21.15.88:0/282503388 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966552858 0 0) 0x7f9054001110 con 0x7f906410d0a0 2023-10-18T19:34:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.121 7f90609fd700 1 -- 172.21.15.88:0/282503388 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064111c30 con 0x7f90640f18c0 2023-10-18T19:34:31.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f90609fd700 1 --2- 172.21.15.88:0/282503388 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 0x7f90640f1d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9058002f70 tx=0x7f905800b970).ready entity=mon.2 client_cookie=8cfc5078de1f8a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9053fff700 1 -- 172.21.15.88:0/282503388 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9064111c30 con 0x7f90640f18c0 2023-10-18T19:34:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9053fff700 1 -- 172.21.15.88:0/282503388 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905800d5c0 con 0x7f90640f18c0 2023-10-18T19:34:31.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9053fff700 1 -- 172.21.15.88:0/282503388 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f905800d990 con 0x7f90640f18c0 2023-10-18T19:34:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 -- 172.21.15.88:0/282503388 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 msgr2=0x7f90640f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 --2- 172.21.15.88:0/282503388 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 0x7f90640f1d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9058002f70 tx=0x7f905800b970).stop 2023-10-18T19:34:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 -- 172.21.15.88:0/282503388 shutdown_connections 2023-10-18T19:34:31.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 --2- 172.21.15.88:0/282503388 >> v2:172.21.15.88:3300/0 conn(0x7f90640f2340 0x7f90641b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 --2- 172.21.15.88:0/282503388 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90640f18c0 0x7f90640f1d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 -- 172.21.15.88:0/282503388 >> 172.21.15.88:0/282503388 conn(0x7f9064117770 msgr2=0x7f90640f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.122 7f9068fff700 1 -- 172.21.15.88:0/282503388 shutdown_connections 2023-10-18T19:34:31.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.123 7f9068fff700 1 -- 172.21.15.88:0/282503388 wait complete. 2023-10-18T19:34:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.147 7f9068fff700 1 Processor -- start 2023-10-18T19:34:31.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.147 7f9068fff700 1 -- start start 2023-10-18T19:34:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90640b14f0 0x7f90641c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 0x7f90640b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90640b1ba0 con 0x7f90641c2880 2023-10-18T19:34:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90640b1940 con 0x7f90640b14f0 2023-10-18T19:34:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f9068fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90640cf4e0 con 0x7f90641c2430 2023-10-18T19:34:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90609fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 0x7f90640b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37392/0 (socket says 172.21.15.88:37392) 2023-10-18T19:34:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 -- 172.21.15.88:0/1695294511 learned_addr learned my addr 172.21.15.88:0/1695294511 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90611fe700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90640b14f0 0x7f90641c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 -- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 msgr2=0x7f90640b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 0x7f90640b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 -- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90640b14f0 msgr2=0x7f90641c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90640b14f0 0x7f90641c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90619ff700 1 -- 172.21.15.88:0/1695294511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640cf120 con 0x7f90641c2880 2023-10-18T19:34:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.148 7f90609fd700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 0x7f90640b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f90619ff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f906410d5b0 tx=0x7f905c0103a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90640cf120 con 0x7f90641c2880 2023-10-18T19:34:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c014040 con 0x7f90641c2880 2023-10-18T19:34:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f9068fff700 1 -- 172.21.15.88:0/1695294511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90640d1860 con 0x7f90641c2880 2023-10-18T19:34:31.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f905c010d10 con 0x7f90641c2880 2023-10-18T19:34:31.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.149 7f9068fff700 1 -- 172.21.15.88:0/1695294511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90640b2df0 con 0x7f90641c2880 2023-10-18T19:34:31.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.150 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f905c00b450 con 0x7f90641c2880 2023-10-18T19:34:31.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.150 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f905c02e340 con 0x7f90641c2880 2023-10-18T19:34:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.150 7f9068fff700 1 -- 172.21.15.88:0/1695294511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90640f0910 con 0x7f90641c2880 2023-10-18T19:34:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.153 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f9064100050 con 0x7f90641c2880 2023-10-18T19:34:31.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.252 7f9068fff700 1 -- 172.21.15.88:0/1695294511 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f90640cf770 con 0x7f90641c2880 2023-10-18T19:34:31.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.253 7f90527fc700 1 -- 172.21.15.88:0/1695294511 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f905c00d0d0 con 0x7f90641c2880 2023-10-18T19:34:31.255 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 >> v1:172.21.15.88:6800/107321 conn(0x7f904001c1b0 legacy=0x7f904001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 msgr2=0x7f90640b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f906410d5b0 tx=0x7f905c0103a0).stop 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 shutdown_connections 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90641c2880 0x7f90640b27c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90640b14f0 0x7f90641c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 --2- 172.21.15.88:0/1695294511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90641c2430 0x7f90640b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 >> 172.21.15.88:0/1695294511 conn(0x7f90640c6780 msgr2=0x7f90641211b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 shutdown_connections 2023-10-18T19:34:31.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.254 7f9068fff700 1 -- 172.21.15.88:0/1695294511 wait complete. 2023-10-18T19:34:31.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2023-10-18T19:34:31.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T19:34:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.473 7fef9d59d700 1 Processor -- start 2023-10-18T19:34:31.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.473 7fef9d59d700 1 -- start start 2023-10-18T19:34:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef98103b80 0x7fef981b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef98111710 con 0x7fef98103b80 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98103fd0 con 0x7fef980f6570 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef9d59d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef98116020 con 0x7fef98103730 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef963fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef96bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef963fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:42972/0 (socket says 172.21.15.88:42972) 2023-10-18T19:34:31.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef96bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44514/0 (socket says 172.21.15.88:44514) 2023-10-18T19:34:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef963fd700 1 -- 172.21.15.88:0/2678467376 learned_addr learned my addr 172.21.15.88:0/2678467376 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.474 7fef973ff700 1 --2- 172.21.15.88:0/2678467376 >> v2:172.21.15.88:3300/0 conn(0x7fef98103b80 0x7fef981b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 -- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 msgr2=0x7fef98103100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 -- 172.21.15.88:0/2678467376 >> v2:172.21.15.88:3300/0 conn(0x7fef98103b80 msgr2=0x7fef981b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 --2- 172.21.15.88:0/2678467376 >> v2:172.21.15.88:3300/0 conn(0x7fef98103b80 0x7fef981b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 -- 172.21.15.88:0/2678467376 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9810c330 con 0x7fef98103730 2023-10-18T19:34:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef96bfe700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef963fd700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fef8c002f70 tx=0x7fef8c0099d0).ready entity=mon.2 client_cookie=8407c1f622814615 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef95bfc700 1 -- 172.21.15.88:0/2678467376 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef9810c330 con 0x7fef98103730 2023-10-18T19:34:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef95bfc700 1 -- 172.21.15.88:0/2678467376 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00f510 con 0x7fef98103730 2023-10-18T19:34:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef95bfc700 1 -- 172.21.15.88:0/2678467376 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef8c00f6f0 con 0x7fef98103730 2023-10-18T19:34:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef9d59d700 1 -- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 msgr2=0x7fef981b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.475 7fef9d59d700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fef8c002f70 tx=0x7fef8c0099d0).stop 2023-10-18T19:34:31.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 -- 172.21.15.88:0/2678467376 shutdown_connections 2023-10-18T19:34:31.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 --2- 172.21.15.88:0/2678467376 >> v2:172.21.15.88:3300/0 conn(0x7fef98103b80 0x7fef981b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980f6570 0x7fef98103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 --2- 172.21.15.88:0/2678467376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef98103730 0x7fef981b5ba0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 -- 172.21.15.88:0/2678467376 >> 172.21.15.88:0/2678467376 conn(0x7fef981172e0 msgr2=0x7fef980f2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 -- 172.21.15.88:0/2678467376 shutdown_connections 2023-10-18T19:34:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.476 7fef9d59d700 1 -- 172.21.15.88:0/2678467376 wait complete. 2023-10-18T19:34:31.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.500 7fef9d59d700 1 Processor -- start 2023-10-18T19:34:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.500 7fef9d59d700 1 -- start start 2023-10-18T19:34:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 0x7fef981c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 0x7fef981c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980f3090 con 0x7fef980bc540 2023-10-18T19:34:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef980b4280 con 0x7fef980d1f50 2023-10-18T19:34:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef9d59d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef981b77b0 con 0x7fef980d23a0 2023-10-18T19:34:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37424/0 (socket says 172.21.15.88:37424) 2023-10-18T19:34:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef963fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 0x7fef981c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 -- 172.21.15.88:0/113581917 learned_addr learned my addr 172.21.15.88:0/113581917 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef973ff700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 0x7fef981c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 -- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 msgr2=0x7fef981c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 0x7fef981c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 -- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 msgr2=0x7fef981c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 0x7fef981c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef96bfe700 1 -- 172.21.15.88:0/113581917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef981b70d0 con 0x7fef980bc540 2023-10-18T19:34:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef963fd700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 0x7fef981c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.501 7fef973ff700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 0x7fef981c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef96bfe700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fef980b40a0 tx=0x7fef8800ed30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef981b70d0 con 0x7fef980bc540 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800c940 con 0x7fef980bc540 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef9d59d700 1 -- 172.21.15.88:0/113581917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef981b73f0 con 0x7fef980bc540 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fef8800f040 con 0x7fef980bc540 2023-10-18T19:34:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.502 7fef9d59d700 1 -- 172.21.15.88:0/113581917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef980bc990 con 0x7fef980bc540 2023-10-18T19:34:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.503 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fef88011070 con 0x7fef980bc540 2023-10-18T19:34:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.503 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fef88010040 con 0x7fef980bc540 2023-10-18T19:34:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.503 7fef9d59d700 1 -- 172.21.15.88:0/113581917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef980f0480 con 0x7fef980bc540 2023-10-18T19:34:31.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.506 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fef8800c540 con 0x7fef980bc540 2023-10-18T19:34:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.603 7fef9d59d700 1 -- 172.21.15.88:0/113581917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef980b44f0 con 0x7fef980bc540 2023-10-18T19:34:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.604 7fef87fff700 1 -- 172.21.15.88:0/113581917 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef88000c30 con 0x7fef980bc540 2023-10-18T19:34:31.606 INFO:teuthology.orchestra.run.smithi088.stdout:38654705670 2023-10-18T19:34:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 >> v1:172.21.15.88:6800/107321 conn(0x7fef7401c1b0 legacy=0x7fef7401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 msgr2=0x7fef980d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fef980b40a0 tx=0x7fef8800ed30).stop 2023-10-18T19:34:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 shutdown_connections 2023-10-18T19:34:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef980d23a0 0x7fef981c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef980bc540 0x7fef980d1920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 --2- 172.21.15.88:0/113581917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef980d1f50 0x7fef981c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 >> 172.21.15.88:0/113581917 conn(0x7fef980e0700 msgr2=0x7fef980f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 shutdown_connections 2023-10-18T19:34:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.605 7fef9d59d700 1 -- 172.21.15.88:0/113581917 wait complete. 2023-10-18T19:34:31.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2023-10-18T19:34:31.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T19:34:31.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:34:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.822 7fa0ddbff700 1 Processor -- start 2023-10-18T19:34:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.822 7fa0ddbff700 1 -- start start 2023-10-18T19:34:31.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0ddbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 0x7fa0d81031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0ddbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 0x7fa0d81b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0ddbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d80ffa50 con 0x7fa0d8103c30 2023-10-18T19:34:31.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0ddbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d81117c0 con 0x7fa0d81037e0 2023-10-18T19:34:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0ddbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8104080 con 0x7fa0d80f6620 2023-10-18T19:34:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0d57fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 0x7fa0d81b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0d5ffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 0x7fa0d81031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0d67ff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa0d8103c30 0x7fa0d81b8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52118/0 (socket says 172.21.15.88:52118) 2023-10-18T19:34:31.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.823 7fa0d67ff700 1 -- 172.21.15.88:0/1220590012 learned_addr learned my addr 172.21.15.88:0/1220590012 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d4ffc700 1 -- 172.21.15.88:0/1220590012 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295599354 0 0) 0x7fa0d0001490 con 0x7fa0d8103c30 2023-10-18T19:34:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d5ffe700 1 -- 172.21.15.88:0/1220590012 >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 msgr2=0x7fa0d81b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d5ffe700 1 --2- 172.21.15.88:0/1220590012 >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 0x7fa0d81b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d5ffe700 1 -- 172.21.15.88:0/1220590012 >> v1:172.21.15.88:6789/0 conn(0x7fa0d8103c30 legacy=0x7fa0d81b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d5ffe700 1 -- 172.21.15.88:0/1220590012 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d810c3e0 con 0x7fa0d80f6620 2023-10-18T19:34:31.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d57fd700 1 --2- 172.21.15.88:0/1220590012 >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 0x7fa0d81b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d5ffe700 1 --2- 172.21.15.88:0/1220590012 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 0x7fa0d81031b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa0c8002f70 tx=0x7fa0c800b970).ready entity=mon.2 client_cookie=e92ec3c1d5b45bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d4ffc700 1 -- 172.21.15.88:0/1220590012 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0d810c3e0 con 0x7fa0d80f6620 2023-10-18T19:34:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d4ffc700 1 -- 172.21.15.88:0/1220590012 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c800d610 con 0x7fa0d80f6620 2023-10-18T19:34:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0d4ffc700 1 -- 172.21.15.88:0/1220590012 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0c800d9e0 con 0x7fa0d80f6620 2023-10-18T19:34:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0ddbff700 1 -- 172.21.15.88:0/1220590012 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 msgr2=0x7fa0d81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.824 7fa0ddbff700 1 --2- 172.21.15.88:0/1220590012 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 0x7fa0d81031b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa0c8002f70 tx=0x7fa0c800b970).stop 2023-10-18T19:34:31.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 -- 172.21.15.88:0/1220590012 shutdown_connections 2023-10-18T19:34:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 --2- 172.21.15.88:0/1220590012 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80f6620 0x7fa0d81031b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 --2- 172.21.15.88:0/1220590012 >> v2:172.21.15.88:3300/0 conn(0x7fa0d81037e0 0x7fa0d81b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 -- 172.21.15.88:0/1220590012 >> 172.21.15.88:0/1220590012 conn(0x7fa0d8117390 msgr2=0x7fa0d80f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 -- 172.21.15.88:0/1220590012 shutdown_connections 2023-10-18T19:34:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.825 7fa0ddbff700 1 -- 172.21.15.88:0/1220590012 wait complete. 2023-10-18T19:34:31.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.849 7fa0ddbff700 1 Processor -- start 2023-10-18T19:34:31.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.849 7fa0ddbff700 1 -- start start 2023-10-18T19:34:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 0x7fa0d80dc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 0x7fa0d81c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 0x7fa0d81c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80d1130 con 0x7fa0d80dd000 2023-10-18T19:34:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80d0df0 con 0x7fa0d80b9ae0 2023-10-18T19:34:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0ddbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80d0bc0 con 0x7fa0d80dd450 2023-10-18T19:34:31.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0d57fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 0x7fa0d81c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0d5ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 0x7fa0d80dc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0d67ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 0x7fa0d81c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0d5ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 0x7fa0d80dc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44528/0 (socket says 172.21.15.88:44528) 2023-10-18T19:34:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.850 7fa0d5ffe700 1 -- 172.21.15.88:0/1566044413 learned_addr learned my addr 172.21.15.88:0/1566044413 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 -- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 msgr2=0x7fa0d80dc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 0x7fa0d80dc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 -- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 msgr2=0x7fa0d81c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 0x7fa0d81c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 -- 172.21.15.88:0/1566044413 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d81c3820 con 0x7fa0d80dd450 2023-10-18T19:34:31.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d57fd700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 0x7fa0d81c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0d67ff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 0x7fa0d81c62a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa0d81b5fb0 tx=0x7fa0d000c930).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0d81c3820 con 0x7fa0d80dd450 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0005bb0 con 0x7fa0d80dd450 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa0d00070d0 con 0x7fa0d80dd450 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d80d26f0 con 0x7fa0d80dd450 2023-10-18T19:34:31.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.851 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d80b9f30 con 0x7fa0d80dd450 2023-10-18T19:34:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.852 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fa0d00072d0 con 0x7fa0d80dd450 2023-10-18T19:34:31.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.852 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fa0d0029270 con 0x7fa0d80dd450 2023-10-18T19:34:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.852 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d80f0530 con 0x7fa0d80dd450 2023-10-18T19:34:31.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.855 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fa0d00059a0 con 0x7fa0d80dd450 2023-10-18T19:34:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.948 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 --> v1:172.21.15.88:6800/107321 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa0d80882a0 con 0x7fa0b401c1b0 2023-10-18T19:34:31.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.957 7fa0c6ffd700 1 -- 172.21.15.88:0/1566044413 <== mgr.4110 v1:172.21.15.88:6800/107321 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306107 (unknown 2965378022 0 2147364613) 0x7fa0c8006b30 con 0x7fa0b401c1b0 2023-10-18T19:34:31.963 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:31.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.960 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 >> v1:172.21.15.88:6800/107321 conn(0x7fa0b401c1b0 legacy=0x7fa0b401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.960 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 msgr2=0x7fa0d81c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.960 7fa0ddbff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 0x7fa0d81c62a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa0d81b5fb0 tx=0x7fa0d000c930).stop 2023-10-18T19:34:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 shutdown_connections 2023-10-18T19:34:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa0d80dd450 0x7fa0d81c62a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa0d80b9ae0 0x7fa0d80dc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 --2- 172.21.15.88:0/1566044413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0d80dd000 0x7fa0d81c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 >> 172.21.15.88:0/1566044413 conn(0x7fa0d80d2d80 msgr2=0x7fa0d80df3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 shutdown_connections 2023-10-18T19:34:31.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:31.961 7fa0ddbff700 1 -- 172.21.15.88:0/1566044413 wait complete. 2023-10-18T19:34:31.968 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:34:31.979 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-18 19:34:31.946967","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194992,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292368,"statfs":{"total":386547056640,"available":382251384832,"internally_reserved":4294967296,"allocated":671744,"data_stored":167536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001697"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272531","last_change":"2023-10-18 19:34:21.266064","last_active":"2023-10-18 19:34:21.272531","last_peered":"2023-10-18 19:34:21.272531","last_clean":"2023-10-18 19:34:21.272531","last_became_active":"2023-10-18 19:34:21.265745","last_became_peered":"2023-10-18 19:34:21.265745","last_unstale":"2023-10-18 19:34:21.272531","last_undegraded":"2023-10-18 19:34:21.272531","last_fullsized":"2023-10-18 19:34:21.272531","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.252075","last_change":"2023-10-18 19:34:20.848544","last_active":"2023-10-18 19:34:24.252075","last_peered":"2023-10-18 19:34:24.252075","last_clean":"2023-10-18 19:34:24.252075","last_became_active":"2023-10-18 19:34:20.848186","last_became_peered":"2023-10-18 19:34:20.848186","last_unstale":"2023-10-18 19:34:24.252075","last_undegraded":"2023-10-18 19:34:24.252075","last_fullsized":"2023-10-18 19:34:24.252075","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254972","last_change":"2023-10-18 19:34:21.249452","last_active":"2023-10-18 19:34:21.254972","last_peered":"2023-10-18 19:34:21.254972","last_clean":"2023-10-18 19:34:21.254972","last_became_active":"2023-10-18 19:34:21.249103","last_became_peered":"2023-10-18 19:34:21.249103","last_unstale":"2023-10-18 19:34:21.254972","last_undegraded":"2023-10-18 19:34:21.254972","last_fullsized":"2023-10-18 19:34:21.254972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227163","last_change":"2023-10-18 19:34:20.835459","last_active":"2023-10-18 19:34:21.227163","last_peered":"2023-10-18 19:34:21.227163","last_clean":"2023-10-18 19:34:21.227163","last_became_active":"2023-10-18 19:34:20.835145","last_became_peered":"2023-10-18 19:34:20.835145","last_unstale":"2023-10-18 19:34:21.227163","last_undegraded":"2023-10-18 19:34:21.227163","last_fullsized":"2023-10-18 19:34:21.227163","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271140","last_change":"2023-10-18 19:34:21.262486","last_active":"2023-10-18 19:34:21.271140","last_peered":"2023-10-18 19:34:21.271140","last_clean":"2023-10-18 19:34:21.271140","last_became_active":"2023-10-18 19:34:21.261956","last_became_peered":"2023-10-18 19:34:21.261956","last_unstale":"2023-10-18 19:34:21.271140","last_undegraded":"2023-10-18 19:34:21.271140","last_fullsized":"2023-10-18 19:34:21.271140","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227255","last_change":"2023-10-18 19:34:20.854649","last_active":"2023-10-18 19:34:21.227255","last_peered":"2023-10-18 19:34:21.227255","last_clean":"2023-10-18 19:34:21.227255","last_became_active":"2023-10-18 19:34:20.854333","last_became_peered":"2023-10-18 19:34:20.854333","last_unstale":"2023-10-18 19:34:21.227255","last_undegraded":"2023-10-18 19:34:21.227255","last_fullsized":"2023-10-18 19:34:21.227255","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.257946","last_change":"2023-10-18 19:34:21.246025","last_active":"2023-10-18 19:34:21.257946","last_peered":"2023-10-18 19:34:21.257946","last_clean":"2023-10-18 19:34:21.257946","last_became_active":"2023-10-18 19:34:21.245735","last_became_peered":"2023-10-18 19:34:21.245735","last_unstale":"2023-10-18 19:34:21.257946","last_undegraded":"2023-10-18 19:34:21.257946","last_fullsized":"2023-10-18 19:34:21.257946","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223152","last_change":"2023-10-18 19:34:20.853312","last_active":"2023-10-18 19:34:21.223152","last_peered":"2023-10-18 19:34:21.223152","last_clean":"2023-10-18 19:34:21.223152","last_became_active":"2023-10-18 19:34:20.852964","last_became_peered":"2023-10-18 19:34:20.852964","last_unstale":"2023-10-18 19:34:21.223152","last_undegraded":"2023-10-18 19:34:21.223152","last_fullsized":"2023-10-18 19:34:21.223152","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271780","last_change":"2023-10-18 19:34:21.265408","last_active":"2023-10-18 19:34:21.271780","last_peered":"2023-10-18 19:34:21.271780","last_clean":"2023-10-18 19:34:21.271780","last_became_active":"2023-10-18 19:34:21.265029","last_became_peered":"2023-10-18 19:34:21.265029","last_unstale":"2023-10-18 19:34:21.271780","last_undegraded":"2023-10-18 19:34:21.271780","last_fullsized":"2023-10-18 19:34:21.271780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.242751","last_change":"2023-10-18 19:34:20.825709","last_active":"2023-10-18 19:34:24.242751","last_peered":"2023-10-18 19:34:24.242751","last_clean":"2023-10-18 19:34:24.242751","last_became_active":"2023-10-18 19:34:20.825364","last_became_peered":"2023-10-18 19:34:20.825364","last_unstale":"2023-10-18 19:34:24.242751","last_undegraded":"2023-10-18 19:34:24.242751","last_fullsized":"2023-10-18 19:34:24.242751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.255066","last_change":"2023-10-18 19:34:21.250032","last_active":"2023-10-18 19:34:21.255066","last_peered":"2023-10-18 19:34:21.255066","last_clean":"2023-10-18 19:34:21.255066","last_became_active":"2023-10-18 19:34:21.245104","last_became_peered":"2023-10-18 19:34:21.245104","last_unstale":"2023-10-18 19:34:21.255066","last_undegraded":"2023-10-18 19:34:21.255066","last_fullsized":"2023-10-18 19:34:21.255066","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237886","last_change":"2023-10-18 19:34:20.862583","last_active":"2023-10-18 19:34:21.237886","last_peered":"2023-10-18 19:34:21.237886","last_clean":"2023-10-18 19:34:21.237886","last_became_active":"2023-10-18 19:34:20.862262","last_became_peered":"2023-10-18 19:34:20.862262","last_unstale":"2023-10-18 19:34:21.237886","last_undegraded":"2023-10-18 19:34:21.237886","last_fullsized":"2023-10-18 19:34:21.237886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271127","last_change":"2023-10-18 19:34:21.265750","last_active":"2023-10-18 19:34:21.271127","last_peered":"2023-10-18 19:34:21.271127","last_clean":"2023-10-18 19:34:21.271127","last_became_active":"2023-10-18 19:34:21.265449","last_became_peered":"2023-10-18 19:34:21.265449","last_unstale":"2023-10-18 19:34:21.271127","last_undegraded":"2023-10-18 19:34:21.271127","last_fullsized":"2023-10-18 19:34:21.271127","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483714","last_change":"2023-10-18 19:34:20.855201","last_active":"2023-10-18 19:34:22.483714","last_peered":"2023-10-18 19:34:22.483714","last_clean":"2023-10-18 19:34:22.483714","last_became_active":"2023-10-18 19:34:20.854344","last_became_peered":"2023-10-18 19:34:20.854344","last_unstale":"2023-10-18 19:34:22.483714","last_undegraded":"2023-10-18 19:34:22.483714","last_fullsized":"2023-10-18 19:34:22.483714","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254841","last_change":"2023-10-18 19:34:21.249688","last_active":"2023-10-18 19:34:21.254841","last_peered":"2023-10-18 19:34:21.254841","last_clean":"2023-10-18 19:34:21.254841","last_became_active":"2023-10-18 19:34:21.246078","last_became_peered":"2023-10-18 19:34:21.246078","last_unstale":"2023-10-18 19:34:21.254841","last_undegraded":"2023-10-18 19:34:21.254841","last_fullsized":"2023-10-18 19:34:21.254841","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279052","last_change":"2023-10-18 19:34:20.857791","last_active":"2023-10-18 19:34:21.279052","last_peered":"2023-10-18 19:34:21.279052","last_clean":"2023-10-18 19:34:21.279052","last_became_active":"2023-10-18 19:34:20.857489","last_became_peered":"2023-10-18 19:34:20.857489","last_unstale":"2023-10-18 19:34:21.279052","last_undegraded":"2023-10-18 19:34:21.279052","last_fullsized":"2023-10-18 19:34:21.279052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253320","last_change":"2023-10-18 19:34:21.245879","last_active":"2023-10-18 19:34:21.253320","last_peered":"2023-10-18 19:34:21.253320","last_clean":"2023-10-18 19:34:21.253320","last_became_active":"2023-10-18 19:34:21.245587","last_became_peered":"2023-10-18 19:34:21.245587","last_unstale":"2023-10-18 19:34:21.253320","last_undegraded":"2023-10-18 19:34:21.253320","last_fullsized":"2023-10-18 19:34:21.253320","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.245894","last_change":"2023-10-18 19:34:20.857559","last_active":"2023-10-18 19:34:24.245894","last_peered":"2023-10-18 19:34:24.245894","last_clean":"2023-10-18 19:34:24.245894","last_became_active":"2023-10-18 19:34:20.857227","last_became_peered":"2023-10-18 19:34:20.857227","last_unstale":"2023-10-18 19:34:24.245894","last_undegraded":"2023-10-18 19:34:24.245894","last_fullsized":"2023-10-18 19:34:24.245894","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262911","last_change":"2023-10-18 19:34:21.258745","last_active":"2023-10-18 19:34:21.262911","last_peered":"2023-10-18 19:34:21.262911","last_clean":"2023-10-18 19:34:21.262911","last_became_active":"2023-10-18 19:34:21.258295","last_became_peered":"2023-10-18 19:34:21.258295","last_unstale":"2023-10-18 19:34:21.262911","last_undegraded":"2023-10-18 19:34:21.262911","last_fullsized":"2023-10-18 19:34:21.262911","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.247369","last_change":"2023-10-18 19:34:20.836255","last_active":"2023-10-18 19:34:24.247369","last_peered":"2023-10-18 19:34:24.247369","last_clean":"2023-10-18 19:34:24.247369","last_became_active":"2023-10-18 19:34:20.835941","last_became_peered":"2023-10-18 19:34:20.835941","last_unstale":"2023-10-18 19:34:24.247369","last_undegraded":"2023-10-18 19:34:24.247369","last_fullsized":"2023-10-18 19:34:24.247369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262394","last_change":"2023-10-18 19:34:21.253538","last_active":"2023-10-18 19:34:21.262394","last_peered":"2023-10-18 19:34:21.262394","last_clean":"2023-10-18 19:34:21.262394","last_became_active":"2023-10-18 19:34:21.253274","last_became_peered":"2023-10-18 19:34:21.253274","last_unstale":"2023-10-18 19:34:21.262394","last_undegraded":"2023-10-18 19:34:21.262394","last_fullsized":"2023-10-18 19:34:21.262394","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235274","last_change":"2023-10-18 19:34:20.857139","last_active":"2023-10-18 19:34:21.235274","last_peered":"2023-10-18 19:34:21.235274","last_clean":"2023-10-18 19:34:21.235274","last_became_active":"2023-10-18 19:34:20.856766","last_became_peered":"2023-10-18 19:34:20.856766","last_unstale":"2023-10-18 19:34:21.235274","last_undegraded":"2023-10-18 19:34:21.235274","last_fullsized":"2023-10-18 19:34:21.235274","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276422","last_change":"2023-10-18 19:34:21.272980","last_active":"2023-10-18 19:34:21.276422","last_peered":"2023-10-18 19:34:21.276422","last_clean":"2023-10-18 19:34:21.276422","last_became_active":"2023-10-18 19:34:21.272618","last_became_peered":"2023-10-18 19:34:21.272618","last_unstale":"2023-10-18 19:34:21.276422","last_undegraded":"2023-10-18 19:34:21.276422","last_fullsized":"2023-10-18 19:34:21.276422","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276732","last_change":"2023-10-18 19:34:20.828547","last_active":"2023-10-18 19:34:21.276732","last_peered":"2023-10-18 19:34:21.276732","last_clean":"2023-10-18 19:34:21.276732","last_became_active":"2023-10-18 19:34:20.828036","last_became_peered":"2023-10-18 19:34:20.828036","last_unstale":"2023-10-18 19:34:21.276732","last_undegraded":"2023-10-18 19:34:21.276732","last_fullsized":"2023-10-18 19:34:21.276732","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271801","last_change":"2023-10-18 19:34:21.265823","last_active":"2023-10-18 19:34:21.271801","last_peered":"2023-10-18 19:34:21.271801","last_clean":"2023-10-18 19:34:21.271801","last_became_active":"2023-10-18 19:34:21.265276","last_became_peered":"2023-10-18 19:34:21.265276","last_unstale":"2023-10-18 19:34:21.271801","last_undegraded":"2023-10-18 19:34:21.271801","last_fullsized":"2023-10-18 19:34:21.271801","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.268602","last_change":"2023-10-18 19:34:20.856792","last_active":"2023-10-18 19:34:21.268602","last_peered":"2023-10-18 19:34:21.268602","last_clean":"2023-10-18 19:34:21.268602","last_became_active":"2023-10-18 19:34:20.856486","last_became_peered":"2023-10-18 19:34:20.856486","last_unstale":"2023-10-18 19:34:21.268602","last_undegraded":"2023-10-18 19:34:21.268602","last_fullsized":"2023-10-18 19:34:21.268602","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270893","last_change":"2023-10-18 19:34:21.265884","last_active":"2023-10-18 19:34:21.270893","last_peered":"2023-10-18 19:34:21.270893","last_clean":"2023-10-18 19:34:21.270893","last_became_active":"2023-10-18 19:34:21.265564","last_became_peered":"2023-10-18 19:34:21.265564","last_unstale":"2023-10-18 19:34:21.270893","last_undegraded":"2023-10-18 19:34:21.270893","last_fullsized":"2023-10-18 19:34:21.270893","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279112","last_change":"2023-10-18 19:34:20.858811","last_active":"2023-10-18 19:34:21.279112","last_peered":"2023-10-18 19:34:21.279112","last_clean":"2023-10-18 19:34:21.279112","last_became_active":"2023-10-18 19:34:20.858481","last_became_peered":"2023-10-18 19:34:20.858481","last_unstale":"2023-10-18 19:34:21.279112","last_undegraded":"2023-10-18 19:34:21.279112","last_fullsized":"2023-10-18 19:34:21.279112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254341","last_change":"2023-10-18 19:34:21.246195","last_active":"2023-10-18 19:34:21.254341","last_peered":"2023-10-18 19:34:21.254341","last_clean":"2023-10-18 19:34:21.254341","last_became_active":"2023-10-18 19:34:21.245896","last_became_peered":"2023-10-18 19:34:21.245896","last_unstale":"2023-10-18 19:34:21.254341","last_undegraded":"2023-10-18 19:34:21.254341","last_fullsized":"2023-10-18 19:34:21.254341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236208","last_change":"2023-10-18 19:34:20.855423","last_active":"2023-10-18 19:34:21.236208","last_peered":"2023-10-18 19:34:21.236208","last_clean":"2023-10-18 19:34:21.236208","last_became_active":"2023-10-18 19:34:20.854593","last_became_peered":"2023-10-18 19:34:20.854593","last_unstale":"2023-10-18 19:34:21.236208","last_undegraded":"2023-10-18 19:34:21.236208","last_fullsized":"2023-10-18 19:34:21.236208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261064","last_change":"2023-10-18 19:34:21.256949","last_active":"2023-10-18 19:34:21.261064","last_peered":"2023-10-18 19:34:21.261064","last_clean":"2023-10-18 19:34:21.261064","last_became_active":"2023-10-18 19:34:21.256623","last_became_peered":"2023-10-18 19:34:21.256623","last_unstale":"2023-10-18 19:34:21.261064","last_undegraded":"2023-10-18 19:34:21.261064","last_fullsized":"2023-10-18 19:34:21.261064","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.247595","last_change":"2023-10-18 19:34:20.846802","last_active":"2023-10-18 19:34:21.247595","last_peered":"2023-10-18 19:34:21.247595","last_clean":"2023-10-18 19:34:21.247595","last_became_active":"2023-10-18 19:34:20.846249","last_became_peered":"2023-10-18 19:34:20.846249","last_unstale":"2023-10-18 19:34:21.247595","last_undegraded":"2023-10-18 19:34:21.247595","last_fullsized":"2023-10-18 19:34:21.247595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260942","last_change":"2023-10-18 19:34:21.258895","last_active":"2023-10-18 19:34:21.260942","last_peered":"2023-10-18 19:34:21.260942","last_clean":"2023-10-18 19:34:21.260942","last_became_active":"2023-10-18 19:34:21.256384","last_became_peered":"2023-10-18 19:34:21.256384","last_unstale":"2023-10-18 19:34:21.260942","last_undegraded":"2023-10-18 19:34:21.260942","last_fullsized":"2023-10-18 19:34:21.260942","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273620","last_change":"2023-10-18 19:34:20.850016","last_active":"2023-10-18 19:34:21.273620","last_peered":"2023-10-18 19:34:21.273620","last_clean":"2023-10-18 19:34:21.273620","last_became_active":"2023-10-18 19:34:20.849501","last_became_peered":"2023-10-18 19:34:20.849501","last_unstale":"2023-10-18 19:34:21.273620","last_undegraded":"2023-10-18 19:34:21.273620","last_fullsized":"2023-10-18 19:34:21.273620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262892","last_change":"2023-10-18 19:34:21.258646","last_active":"2023-10-18 19:34:21.262892","last_peered":"2023-10-18 19:34:21.262892","last_clean":"2023-10-18 19:34:21.262892","last_became_active":"2023-10-18 19:34:21.257999","last_became_peered":"2023-10-18 19:34:21.257999","last_unstale":"2023-10-18 19:34:21.262892","last_undegraded":"2023-10-18 19:34:21.262892","last_fullsized":"2023-10-18 19:34:21.262892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235868","last_change":"2023-10-18 19:34:20.856264","last_active":"2023-10-18 19:34:21.235868","last_peered":"2023-10-18 19:34:21.235868","last_clean":"2023-10-18 19:34:21.235868","last_became_active":"2023-10-18 19:34:20.856072","last_became_peered":"2023-10-18 19:34:20.856072","last_unstale":"2023-10-18 19:34:21.235868","last_undegraded":"2023-10-18 19:34:21.235868","last_fullsized":"2023-10-18 19:34:21.235868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.248119","last_change":"2023-10-18 19:34:21.242536","last_active":"2023-10-18 19:34:21.248119","last_peered":"2023-10-18 19:34:21.248119","last_clean":"2023-10-18 19:34:21.248119","last_became_active":"2023-10-18 19:34:21.242187","last_became_peered":"2023-10-18 19:34:21.242187","last_unstale":"2023-10-18 19:34:21.248119","last_undegraded":"2023-10-18 19:34:21.248119","last_fullsized":"2023-10-18 19:34:21.248119","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244025","last_change":"2023-10-18 19:34:20.844847","last_active":"2023-10-18 19:34:24.244025","last_peered":"2023-10-18 19:34:24.244025","last_clean":"2023-10-18 19:34:24.244025","last_became_active":"2023-10-18 19:34:20.844528","last_became_peered":"2023-10-18 19:34:20.844528","last_unstale":"2023-10-18 19:34:24.244025","last_undegraded":"2023-10-18 19:34:24.244025","last_fullsized":"2023-10-18 19:34:24.244025","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276339","last_change":"2023-10-18 19:34:21.272824","last_active":"2023-10-18 19:34:21.276339","last_peered":"2023-10-18 19:34:21.276339","last_clean":"2023-10-18 19:34:21.276339","last_became_active":"2023-10-18 19:34:21.272631","last_became_peered":"2023-10-18 19:34:21.272631","last_unstale":"2023-10-18 19:34:21.276339","last_undegraded":"2023-10-18 19:34:21.276339","last_fullsized":"2023-10-18 19:34:21.276339","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236296","last_change":"2023-10-18 19:34:20.833452","last_active":"2023-10-18 19:34:21.236296","last_peered":"2023-10-18 19:34:21.236296","last_clean":"2023-10-18 19:34:21.236296","last_became_active":"2023-10-18 19:34:20.832840","last_became_peered":"2023-10-18 19:34:20.832840","last_unstale":"2023-10-18 19:34:21.236296","last_undegraded":"2023-10-18 19:34:21.236296","last_fullsized":"2023-10-18 19:34:21.236296","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261308","last_change":"2023-10-18 19:34:21.255174","last_active":"2023-10-18 19:34:21.261308","last_peered":"2023-10-18 19:34:21.261308","last_clean":"2023-10-18 19:34:21.261308","last_became_active":"2023-10-18 19:34:21.252377","last_became_peered":"2023-10-18 19:34:21.252377","last_unstale":"2023-10-18 19:34:21.261308","last_undegraded":"2023-10-18 19:34:21.261308","last_fullsized":"2023-10-18 19:34:21.261308","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251597","last_change":"2023-10-18 19:34:11.535715","last_active":"2023-10-18 19:34:21.251597","last_peered":"2023-10-18 19:34:21.251597","last_clean":"2023-10-18 19:34:21.251597","last_became_active":"2023-10-18 19:34:11.534518","last_became_peered":"2023-10-18 19:34:11.534518","last_unstale":"2023-10-18 19:34:21.251597","last_undegraded":"2023-10-18 19:34:21.251597","last_fullsized":"2023-10-18 19:34:21.251597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236775","last_change":"2023-10-18 19:34:20.857782","last_active":"2023-10-18 19:34:21.236775","last_peered":"2023-10-18 19:34:21.236775","last_clean":"2023-10-18 19:34:21.236775","last_became_active":"2023-10-18 19:34:20.853192","last_became_peered":"2023-10-18 19:34:20.853192","last_unstale":"2023-10-18 19:34:21.236775","last_undegraded":"2023-10-18 19:34:21.236775","last_fullsized":"2023-10-18 19:34:21.236775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261029","last_change":"2023-10-18 19:34:21.257423","last_active":"2023-10-18 19:34:21.261029","last_peered":"2023-10-18 19:34:21.261029","last_clean":"2023-10-18 19:34:21.261029","last_became_active":"2023-10-18 19:34:21.256448","last_became_peered":"2023-10-18 19:34:21.256448","last_unstale":"2023-10-18 19:34:21.261029","last_undegraded":"2023-10-18 19:34:21.261029","last_fullsized":"2023-10-18 19:34:21.261029","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.231638","last_change":"2023-10-18 19:34:11.532756","last_active":"2023-10-18 19:34:21.231638","last_peered":"2023-10-18 19:34:21.231638","last_clean":"2023-10-18 19:34:21.231638","last_became_active":"2023-10-18 19:34:11.532425","last_became_peered":"2023-10-18 19:34:11.532425","last_unstale":"2023-10-18 19:34:21.231638","last_undegraded":"2023-10-18 19:34:21.231638","last_fullsized":"2023-10-18 19:34:21.231638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262706","last_change":"2023-10-18 19:34:20.852964","last_active":"2023-10-18 19:34:21.262706","last_peered":"2023-10-18 19:34:21.262706","last_clean":"2023-10-18 19:34:21.262706","last_became_active":"2023-10-18 19:34:20.852642","last_became_peered":"2023-10-18 19:34:20.852642","last_unstale":"2023-10-18 19:34:21.262706","last_undegraded":"2023-10-18 19:34:21.262706","last_fullsized":"2023-10-18 19:34:21.262706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235826","last_change":"2023-10-18 19:34:11.534856","last_active":"2023-10-18 19:34:21.235826","last_peered":"2023-10-18 19:34:21.235826","last_clean":"2023-10-18 19:34:21.235826","last_became_active":"2023-10-18 19:34:11.534541","last_became_peered":"2023-10-18 19:34:11.534541","last_unstale":"2023-10-18 19:34:21.235826","last_undegraded":"2023-10-18 19:34:21.235826","last_fullsized":"2023-10-18 19:34:21.235826","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.224350","last_change":"2023-10-18 19:34:20.847678","last_active":"2023-10-18 19:34:22.224350","last_peered":"2023-10-18 19:34:22.224350","last_clean":"2023-10-18 19:34:22.224350","last_became_active":"2023-10-18 19:34:20.847107","last_became_peered":"2023-10-18 19:34:20.847107","last_unstale":"2023-10-18 19:34:22.224350","last_undegraded":"2023-10-18 19:34:22.224350","last_fullsized":"2023-10-18 19:34:22.224350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260656","last_change":"2023-10-18 19:34:21.255564","last_active":"2023-10-18 19:34:21.260656","last_peered":"2023-10-18 19:34:21.260656","last_clean":"2023-10-18 19:34:21.260656","last_became_active":"2023-10-18 19:34:21.255230","last_became_peered":"2023-10-18 19:34:21.255230","last_unstale":"2023-10-18 19:34:21.260656","last_undegraded":"2023-10-18 19:34:21.260656","last_fullsized":"2023-10-18 19:34:21.260656","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236452","last_change":"2023-10-18 19:34:11.535128","last_active":"2023-10-18 19:34:21.236452","last_peered":"2023-10-18 19:34:21.236452","last_clean":"2023-10-18 19:34:21.236452","last_became_active":"2023-10-18 19:34:11.534248","last_became_peered":"2023-10-18 19:34:11.534248","last_unstale":"2023-10-18 19:34:21.236452","last_undegraded":"2023-10-18 19:34:21.236452","last_fullsized":"2023-10-18 19:34:21.236452","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483720","last_change":"2023-10-18 19:34:20.855194","last_active":"2023-10-18 19:34:22.483720","last_peered":"2023-10-18 19:34:22.483720","last_clean":"2023-10-18 19:34:22.483720","last_became_active":"2023-10-18 19:34:20.854897","last_became_peered":"2023-10-18 19:34:20.854897","last_unstale":"2023-10-18 19:34:22.483720","last_undegraded":"2023-10-18 19:34:22.483720","last_fullsized":"2023-10-18 19:34:22.483720","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.275744","last_change":"2023-10-18 19:34:21.270017","last_active":"2023-10-18 19:34:21.275744","last_peered":"2023-10-18 19:34:21.275744","last_clean":"2023-10-18 19:34:21.275744","last_became_active":"2023-10-18 19:34:21.269485","last_became_peered":"2023-10-18 19:34:21.269485","last_unstale":"2023-10-18 19:34:21.275744","last_undegraded":"2023-10-18 19:34:21.275744","last_fullsized":"2023-10-18 19:34:21.275744","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.232447","last_change":"2023-10-18 19:34:11.532872","last_active":"2023-10-18 19:34:21.232447","last_peered":"2023-10-18 19:34:21.232447","last_clean":"2023-10-18 19:34:21.232447","last_became_active":"2023-10-18 19:34:11.531562","last_became_peered":"2023-10-18 19:34:11.531562","last_unstale":"2023-10-18 19:34:21.232447","last_undegraded":"2023-10-18 19:34:21.232447","last_fullsized":"2023-10-18 19:34:21.232447","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.247293","last_change":"2023-10-18 19:34:20.852891","last_active":"2023-10-18 19:34:24.247293","last_peered":"2023-10-18 19:34:24.247293","last_clean":"2023-10-18 19:34:24.247293","last_became_active":"2023-10-18 19:34:20.852426","last_became_peered":"2023-10-18 19:34:20.852426","last_unstale":"2023-10-18 19:34:24.247293","last_undegraded":"2023-10-18 19:34:24.247293","last_fullsized":"2023-10-18 19:34:24.247293","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271146","last_change":"2023-10-18 19:34:21.266390","last_active":"2023-10-18 19:34:21.271146","last_peered":"2023-10-18 19:34:21.271146","last_clean":"2023-10-18 19:34:21.271146","last_became_active":"2023-10-18 19:34:21.266089","last_became_peered":"2023-10-18 19:34:21.266089","last_unstale":"2023-10-18 19:34:21.271146","last_undegraded":"2023-10-18 19:34:21.271146","last_fullsized":"2023-10-18 19:34:21.271146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223059","last_change":"2023-10-18 19:34:11.532565","last_active":"2023-10-18 19:34:21.223059","last_peered":"2023-10-18 19:34:21.223059","last_clean":"2023-10-18 19:34:21.223059","last_became_active":"2023-10-18 19:34:11.532168","last_became_peered":"2023-10-18 19:34:11.532168","last_unstale":"2023-10-18 19:34:21.223059","last_undegraded":"2023-10-18 19:34:21.223059","last_fullsized":"2023-10-18 19:34:21.223059","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227100","last_change":"2023-10-18 19:34:20.852330","last_active":"2023-10-18 19:34:21.227100","last_peered":"2023-10-18 19:34:21.227100","last_clean":"2023-10-18 19:34:21.227100","last_became_active":"2023-10-18 19:34:20.851992","last_became_peered":"2023-10-18 19:34:20.851992","last_unstale":"2023-10-18 19:34:21.227100","last_undegraded":"2023-10-18 19:34:21.227100","last_fullsized":"2023-10-18 19:34:21.227100","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270746","last_change":"2023-10-18 19:34:21.264314","last_active":"2023-10-18 19:34:21.270746","last_peered":"2023-10-18 19:34:21.270746","last_clean":"2023-10-18 19:34:21.270746","last_became_active":"2023-10-18 19:34:21.263937","last_became_peered":"2023-10-18 19:34:21.263937","last_unstale":"2023-10-18 19:34:21.270746","last_undegraded":"2023-10-18 19:34:21.270746","last_fullsized":"2023-10-18 19:34:21.270746","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225659","last_change":"2023-10-18 19:34:11.533453","last_active":"2023-10-18 19:34:21.225659","last_peered":"2023-10-18 19:34:21.225659","last_clean":"2023-10-18 19:34:21.225659","last_became_active":"2023-10-18 19:34:11.532769","last_became_peered":"2023-10-18 19:34:11.532769","last_unstale":"2023-10-18 19:34:21.225659","last_undegraded":"2023-10-18 19:34:21.225659","last_fullsized":"2023-10-18 19:34:21.225659","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.229268","last_change":"2023-10-18 19:34:20.853145","last_active":"2023-10-18 19:34:21.229268","last_peered":"2023-10-18 19:34:21.229268","last_clean":"2023-10-18 19:34:21.229268","last_became_active":"2023-10-18 19:34:20.852683","last_became_peered":"2023-10-18 19:34:20.852683","last_unstale":"2023-10-18 19:34:21.229268","last_undegraded":"2023-10-18 19:34:21.229268","last_fullsized":"2023-10-18 19:34:21.229268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273041","last_change":"2023-10-18 19:34:21.266346","last_active":"2023-10-18 19:34:21.273041","last_peered":"2023-10-18 19:34:21.273041","last_clean":"2023-10-18 19:34:21.273041","last_became_active":"2023-10-18 19:34:21.265950","last_became_peered":"2023-10-18 19:34:21.265950","last_unstale":"2023-10-18 19:34:21.273041","last_undegraded":"2023-10-18 19:34:21.273041","last_fullsized":"2023-10-18 19:34:21.273041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.240589","last_change":"2023-10-18 19:34:11.533454","last_active":"2023-10-18 19:34:21.240589","last_peered":"2023-10-18 19:34:21.240589","last_clean":"2023-10-18 19:34:21.240589","last_became_active":"2023-10-18 19:34:11.533123","last_became_peered":"2023-10-18 19:34:11.533123","last_unstale":"2023-10-18 19:34:21.240589","last_undegraded":"2023-10-18 19:34:21.240589","last_fullsized":"2023-10-18 19:34:21.240589","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235790","last_change":"2023-10-18 19:34:20.844955","last_active":"2023-10-18 19:34:21.235790","last_peered":"2023-10-18 19:34:21.235790","last_clean":"2023-10-18 19:34:21.235790","last_became_active":"2023-10-18 19:34:20.844711","last_became_peered":"2023-10-18 19:34:20.844711","last_unstale":"2023-10-18 19:34:21.235790","last_undegraded":"2023-10-18 19:34:21.235790","last_fullsized":"2023-10-18 19:34:21.235790","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267224","last_change":"2023-10-18 19:34:21.256370","last_active":"2023-10-18 19:34:21.267224","last_peered":"2023-10-18 19:34:21.267224","last_clean":"2023-10-18 19:34:21.267224","last_became_active":"2023-10-18 19:34:21.256084","last_became_peered":"2023-10-18 19:34:21.256084","last_unstale":"2023-10-18 19:34:21.267224","last_undegraded":"2023-10-18 19:34:21.267224","last_fullsized":"2023-10-18 19:34:21.267224","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261044","last_change":"2023-10-18 19:34:21.253778","last_active":"2023-10-18 19:34:21.261044","last_peered":"2023-10-18 19:34:21.261044","last_clean":"2023-10-18 19:34:21.261044","last_became_active":"2023-10-18 19:34:21.251946","last_became_peered":"2023-10-18 19:34:21.251946","last_unstale":"2023-10-18 19:34:21.261044","last_undegraded":"2023-10-18 19:34:21.261044","last_fullsized":"2023-10-18 19:34:21.261044","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.239348","last_change":"2023-10-18 19:34:20.862585","last_active":"2023-10-18 19:34:21.239348","last_peered":"2023-10-18 19:34:21.239348","last_clean":"2023-10-18 19:34:21.239348","last_became_active":"2023-10-18 19:34:20.862326","last_became_peered":"2023-10-18 19:34:20.862326","last_unstale":"2023-10-18 19:34:21.239348","last_undegraded":"2023-10-18 19:34:21.239348","last_fullsized":"2023-10-18 19:34:21.239348","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264051","last_change":"2023-10-18 19:34:21.259196","last_active":"2023-10-18 19:34:21.264051","last_peered":"2023-10-18 19:34:21.264051","last_clean":"2023-10-18 19:34:21.264051","last_became_active":"2023-10-18 19:34:21.258884","last_became_peered":"2023-10-18 19:34:21.258884","last_unstale":"2023-10-18 19:34:21.264051","last_undegraded":"2023-10-18 19:34:21.264051","last_fullsized":"2023-10-18 19:34:21.264051","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262675","last_change":"2023-10-18 19:34:20.863893","last_active":"2023-10-18 19:34:21.262675","last_peered":"2023-10-18 19:34:21.262675","last_clean":"2023-10-18 19:34:21.262675","last_became_active":"2023-10-18 19:34:20.863549","last_became_peered":"2023-10-18 19:34:20.863549","last_unstale":"2023-10-18 19:34:21.262675","last_undegraded":"2023-10-18 19:34:21.262675","last_fullsized":"2023-10-18 19:34:21.262675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262881","last_change":"2023-10-18 19:34:21.261264","last_active":"2023-10-18 19:34:21.262881","last_peered":"2023-10-18 19:34:21.262881","last_clean":"2023-10-18 19:34:21.262881","last_became_active":"2023-10-18 19:34:21.260951","last_became_peered":"2023-10-18 19:34:21.260951","last_unstale":"2023-10-18 19:34:21.262881","last_undegraded":"2023-10-18 19:34:21.262881","last_fullsized":"2023-10-18 19:34:21.262881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261912","last_change":"2023-10-18 19:34:20.853421","last_active":"2023-10-18 19:34:21.261912","last_peered":"2023-10-18 19:34:21.261912","last_clean":"2023-10-18 19:34:21.261912","last_became_active":"2023-10-18 19:34:20.853091","last_became_peered":"2023-10-18 19:34:20.853091","last_unstale":"2023-10-18 19:34:21.261912","last_undegraded":"2023-10-18 19:34:21.261912","last_fullsized":"2023-10-18 19:34:21.261912","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.278815","last_change":"2023-10-18 19:34:21.274214","last_active":"2023-10-18 19:34:21.278815","last_peered":"2023-10-18 19:34:21.278815","last_clean":"2023-10-18 19:34:21.278815","last_became_active":"2023-10-18 19:34:21.273899","last_became_peered":"2023-10-18 19:34:21.273899","last_unstale":"2023-10-18 19:34:21.278815","last_undegraded":"2023-10-18 19:34:21.278815","last_fullsized":"2023-10-18 19:34:21.278815","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271533","last_change":"2023-10-18 19:34:20.860150","last_active":"2023-10-18 19:34:21.271533","last_peered":"2023-10-18 19:34:21.271533","last_clean":"2023-10-18 19:34:21.271533","last_became_active":"2023-10-18 19:34:20.859836","last_became_peered":"2023-10-18 19:34:20.859836","last_unstale":"2023-10-18 19:34:21.271533","last_undegraded":"2023-10-18 19:34:21.271533","last_fullsized":"2023-10-18 19:34:21.271533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267146","last_change":"2023-10-18 19:34:21.260022","last_active":"2023-10-18 19:34:21.267146","last_peered":"2023-10-18 19:34:21.267146","last_clean":"2023-10-18 19:34:21.267146","last_became_active":"2023-10-18 19:34:21.259630","last_became_peered":"2023-10-18 19:34:21.259630","last_unstale":"2023-10-18 19:34:21.267146","last_undegraded":"2023-10-18 19:34:21.267146","last_fullsized":"2023-10-18 19:34:21.267146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223404","last_change":"2023-10-18 19:34:20.832124","last_active":"2023-10-18 19:34:21.223404","last_peered":"2023-10-18 19:34:21.223404","last_clean":"2023-10-18 19:34:21.223404","last_became_active":"2023-10-18 19:34:20.831830","last_became_peered":"2023-10-18 19:34:20.831830","last_unstale":"2023-10-18 19:34:21.223404","last_undegraded":"2023-10-18 19:34:21.223404","last_fullsized":"2023-10-18 19:34:21.223404","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271045","last_change":"2023-10-18 19:34:21.263372","last_active":"2023-10-18 19:34:21.271045","last_peered":"2023-10-18 19:34:21.271045","last_clean":"2023-10-18 19:34:21.271045","last_became_active":"2023-10-18 19:34:21.256876","last_became_peered":"2023-10-18 19:34:21.256876","last_unstale":"2023-10-18 19:34:21.271045","last_undegraded":"2023-10-18 19:34:21.271045","last_fullsized":"2023-10-18 19:34:21.271045","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245344","last_change":"2023-10-18 19:34:20.846546","last_active":"2023-10-18 19:34:21.245344","last_peered":"2023-10-18 19:34:21.245344","last_clean":"2023-10-18 19:34:21.245344","last_became_active":"2023-10-18 19:34:20.846229","last_became_peered":"2023-10-18 19:34:20.846229","last_unstale":"2023-10-18 19:34:21.245344","last_undegraded":"2023-10-18 19:34:21.245344","last_fullsized":"2023-10-18 19:34:21.245344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254951","last_change":"2023-10-18 19:34:21.248032","last_active":"2023-10-18 19:34:21.254951","last_peered":"2023-10-18 19:34:21.254951","last_clean":"2023-10-18 19:34:21.254951","last_became_active":"2023-10-18 19:34:21.247196","last_became_peered":"2023-10-18 19:34:21.247196","last_unstale":"2023-10-18 19:34:21.254951","last_undegraded":"2023-10-18 19:34:21.254951","last_fullsized":"2023-10-18 19:34:21.254951","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227234","last_change":"2023-10-18 19:34:20.847408","last_active":"2023-10-18 19:34:21.227234","last_peered":"2023-10-18 19:34:21.227234","last_clean":"2023-10-18 19:34:21.227234","last_became_active":"2023-10-18 19:34:20.847100","last_became_peered":"2023-10-18 19:34:20.847100","last_unstale":"2023-10-18 19:34:21.227234","last_undegraded":"2023-10-18 19:34:21.227234","last_fullsized":"2023-10-18 19:34:21.227234","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260917","last_change":"2023-10-18 19:34:21.256724","last_active":"2023-10-18 19:34:21.260917","last_peered":"2023-10-18 19:34:21.260917","last_clean":"2023-10-18 19:34:21.260917","last_became_active":"2023-10-18 19:34:21.256252","last_became_peered":"2023-10-18 19:34:21.256252","last_unstale":"2023-10-18 19:34:21.260917","last_undegraded":"2023-10-18 19:34:21.260917","last_fullsized":"2023-10-18 19:34:21.260917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.226417","last_change":"2023-10-18 19:34:20.846959","last_active":"2023-10-18 19:34:21.226417","last_peered":"2023-10-18 19:34:21.226417","last_clean":"2023-10-18 19:34:21.226417","last_became_active":"2023-10-18 19:34:20.846541","last_became_peered":"2023-10-18 19:34:20.846541","last_unstale":"2023-10-18 19:34:21.226417","last_undegraded":"2023-10-18 19:34:21.226417","last_fullsized":"2023-10-18 19:34:21.226417","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258963","last_change":"2023-10-18 19:34:21.251998","last_active":"2023-10-18 19:34:21.258963","last_peered":"2023-10-18 19:34:21.258963","last_clean":"2023-10-18 19:34:21.258963","last_became_active":"2023-10-18 19:34:21.251641","last_became_peered":"2023-10-18 19:34:21.251641","last_unstale":"2023-10-18 19:34:21.258963","last_undegraded":"2023-10-18 19:34:21.258963","last_fullsized":"2023-10-18 19:34:21.258963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235880","last_change":"2023-10-18 19:34:20.844433","last_active":"2023-10-18 19:34:21.235880","last_peered":"2023-10-18 19:34:21.235880","last_clean":"2023-10-18 19:34:21.235880","last_became_active":"2023-10-18 19:34:20.843767","last_became_peered":"2023-10-18 19:34:20.843767","last_unstale":"2023-10-18 19:34:21.235880","last_undegraded":"2023-10-18 19:34:21.235880","last_fullsized":"2023-10-18 19:34:21.235880","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260971","last_change":"2023-10-18 19:34:21.259590","last_active":"2023-10-18 19:34:21.260971","last_peered":"2023-10-18 19:34:21.260971","last_clean":"2023-10-18 19:34:21.260971","last_became_active":"2023-10-18 19:34:21.257762","last_became_peered":"2023-10-18 19:34:21.257762","last_unstale":"2023-10-18 19:34:21.260971","last_undegraded":"2023-10-18 19:34:21.260971","last_fullsized":"2023-10-18 19:34:21.260971","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.485197","last_change":"2023-10-18 19:34:20.845853","last_active":"2023-10-18 19:34:22.485197","last_peered":"2023-10-18 19:34:22.485197","last_clean":"2023-10-18 19:34:22.485197","last_became_active":"2023-10-18 19:34:20.845487","last_became_peered":"2023-10-18 19:34:20.845487","last_unstale":"2023-10-18 19:34:22.485197","last_undegraded":"2023-10-18 19:34:22.485197","last_fullsized":"2023-10-18 19:34:22.485197","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261328","last_change":"2023-10-18 19:34:21.255163","last_active":"2023-10-18 19:34:21.261328","last_peered":"2023-10-18 19:34:21.261328","last_clean":"2023-10-18 19:34:21.261328","last_became_active":"2023-10-18 19:34:21.252262","last_became_peered":"2023-10-18 19:34:21.252262","last_unstale":"2023-10-18 19:34:21.261328","last_undegraded":"2023-10-18 19:34:21.261328","last_fullsized":"2023-10-18 19:34:21.261328","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.227689","last_change":"2023-10-18 19:34:20.861998","last_active":"2023-10-18 19:34:22.227689","last_peered":"2023-10-18 19:34:22.227689","last_clean":"2023-10-18 19:34:22.227689","last_became_active":"2023-10-18 19:34:20.860333","last_became_peered":"2023-10-18 19:34:20.860333","last_unstale":"2023-10-18 19:34:22.227689","last_undegraded":"2023-10-18 19:34:22.227689","last_fullsized":"2023-10-18 19:34:22.227689","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267358","last_change":"2023-10-18 19:34:21.258083","last_active":"2023-10-18 19:34:21.267358","last_peered":"2023-10-18 19:34:21.267358","last_clean":"2023-10-18 19:34:21.267358","last_became_active":"2023-10-18 19:34:21.257626","last_became_peered":"2023-10-18 19:34:21.257626","last_unstale":"2023-10-18 19:34:21.267358","last_undegraded":"2023-10-18 19:34:21.267358","last_fullsized":"2023-10-18 19:34:21.267358","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244745","last_change":"2023-10-18 19:34:20.855980","last_active":"2023-10-18 19:34:24.244745","last_peered":"2023-10-18 19:34:24.244745","last_clean":"2023-10-18 19:34:24.244745","last_became_active":"2023-10-18 19:34:20.855446","last_became_peered":"2023-10-18 19:34:20.855446","last_unstale":"2023-10-18 19:34:24.244745","last_undegraded":"2023-10-18 19:34:24.244745","last_fullsized":"2023-10-18 19:34:24.244745","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273477","last_change":"2023-10-18 19:34:21.267157","last_active":"2023-10-18 19:34:21.273477","last_peered":"2023-10-18 19:34:21.273477","last_clean":"2023-10-18 19:34:21.273477","last_became_active":"2023-10-18 19:34:21.266854","last_became_peered":"2023-10-18 19:34:21.266854","last_unstale":"2023-10-18 19:34:21.273477","last_undegraded":"2023-10-18 19:34:21.273477","last_fullsized":"2023-10-18 19:34:21.273477","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.246574","last_change":"2023-10-18 19:34:20.847879","last_active":"2023-10-18 19:34:24.246574","last_peered":"2023-10-18 19:34:24.246574","last_clean":"2023-10-18 19:34:24.246574","last_became_active":"2023-10-18 19:34:20.847368","last_became_peered":"2023-10-18 19:34:20.847368","last_unstale":"2023-10-18 19:34:24.246574","last_undegraded":"2023-10-18 19:34:24.246574","last_fullsized":"2023-10-18 19:34:24.246574","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274767","last_change":"2023-10-18 19:34:21.271229","last_active":"2023-10-18 19:34:21.274767","last_peered":"2023-10-18 19:34:21.274767","last_clean":"2023-10-18 19:34:21.274767","last_became_active":"2023-10-18 19:34:21.270946","last_became_peered":"2023-10-18 19:34:21.270946","last_unstale":"2023-10-18 19:34:21.274767","last_undegraded":"2023-10-18 19:34:21.274767","last_fullsized":"2023-10-18 19:34:21.274767","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237270","last_change":"2023-10-18 19:34:20.857540","last_active":"2023-10-18 19:34:21.237270","last_peered":"2023-10-18 19:34:21.237270","last_clean":"2023-10-18 19:34:21.237270","last_became_active":"2023-10-18 19:34:20.857056","last_became_peered":"2023-10-18 19:34:20.857056","last_unstale":"2023-10-18 19:34:21.237270","last_undegraded":"2023-10-18 19:34:21.237270","last_fullsized":"2023-10-18 19:34:21.237270","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270725","last_change":"2023-10-18 19:34:21.264597","last_active":"2023-10-18 19:34:21.270725","last_peered":"2023-10-18 19:34:21.270725","last_clean":"2023-10-18 19:34:21.270725","last_became_active":"2023-10-18 19:34:21.264304","last_became_peered":"2023-10-18 19:34:21.264304","last_unstale":"2023-10-18 19:34:21.270725","last_undegraded":"2023-10-18 19:34:21.270725","last_fullsized":"2023-10-18 19:34:21.270725","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483718","last_change":"2023-10-18 19:34:20.830160","last_active":"2023-10-18 19:34:22.483718","last_peered":"2023-10-18 19:34:22.483718","last_clean":"2023-10-18 19:34:22.483718","last_became_active":"2023-10-18 19:34:20.829821","last_became_peered":"2023-10-18 19:34:20.829821","last_unstale":"2023-10-18 19:34:22.483718","last_undegraded":"2023-10-18 19:34:22.483718","last_fullsized":"2023-10-18 19:34:22.483718","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263547","last_change":"2023-10-18 19:34:21.250388","last_active":"2023-10-18 19:34:21.263547","last_peered":"2023-10-18 19:34:21.263547","last_clean":"2023-10-18 19:34:21.263547","last_became_active":"2023-10-18 19:34:21.250098","last_became_peered":"2023-10-18 19:34:21.250098","last_unstale":"2023-10-18 19:34:21.263547","last_undegraded":"2023-10-18 19:34:21.263547","last_fullsized":"2023-10-18 19:34:21.263547","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.246407","last_change":"2023-10-18 19:34:20.857726","last_active":"2023-10-18 19:34:24.246407","last_peered":"2023-10-18 19:34:24.246407","last_clean":"2023-10-18 19:34:24.246407","last_became_active":"2023-10-18 19:34:20.856983","last_became_peered":"2023-10-18 19:34:20.856983","last_unstale":"2023-10-18 19:34:24.246407","last_undegraded":"2023-10-18 19:34:24.246407","last_fullsized":"2023-10-18 19:34:24.246407","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274573","last_change":"2023-10-18 19:34:21.270485","last_active":"2023-10-18 19:34:21.274573","last_peered":"2023-10-18 19:34:21.274573","last_clean":"2023-10-18 19:34:21.274573","last_became_active":"2023-10-18 19:34:21.270140","last_became_peered":"2023-10-18 19:34:21.270140","last_unstale":"2023-10-18 19:34:21.274573","last_undegraded":"2023-10-18 19:34:21.274573","last_fullsized":"2023-10-18 19:34:21.274573","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.242340","last_change":"2023-10-18 19:34:20.847009","last_active":"2023-10-18 19:34:21.242340","last_peered":"2023-10-18 19:34:21.242340","last_clean":"2023-10-18 19:34:21.242340","last_became_active":"2023-10-18 19:34:20.846481","last_became_peered":"2023-10-18 19:34:20.846481","last_unstale":"2023-10-18 19:34:21.242340","last_undegraded":"2023-10-18 19:34:21.242340","last_fullsized":"2023-10-18 19:34:21.242340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260964","last_change":"2023-10-18 19:34:21.256060","last_active":"2023-10-18 19:34:21.260964","last_peered":"2023-10-18 19:34:21.260964","last_clean":"2023-10-18 19:34:21.260964","last_became_active":"2023-10-18 19:34:21.255703","last_became_peered":"2023-10-18 19:34:21.255703","last_unstale":"2023-10-18 19:34:21.260964","last_undegraded":"2023-10-18 19:34:21.260964","last_fullsized":"2023-10-18 19:34:21.260964","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274523","last_change":"2023-10-18 19:34:20.849799","last_active":"2023-10-18 19:34:21.274523","last_peered":"2023-10-18 19:34:21.274523","last_clean":"2023-10-18 19:34:21.274523","last_became_active":"2023-10-18 19:34:20.849488","last_became_peered":"2023-10-18 19:34:20.849488","last_unstale":"2023-10-18 19:34:21.274523","last_undegraded":"2023-10-18 19:34:21.274523","last_fullsized":"2023-10-18 19:34:21.274523","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261345","last_change":"2023-10-18 19:34:21.260006","last_active":"2023-10-18 19:34:21.261345","last_peered":"2023-10-18 19:34:21.261345","last_clean":"2023-10-18 19:34:21.261345","last_became_active":"2023-10-18 19:34:21.259689","last_became_peered":"2023-10-18 19:34:21.259689","last_unstale":"2023-10-18 19:34:21.261345","last_undegraded":"2023-10-18 19:34:21.261345","last_fullsized":"2023-10-18 19:34:21.261345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236883","last_change":"2023-10-18 19:34:20.858108","last_active":"2023-10-18 19:34:21.236883","last_peered":"2023-10-18 19:34:21.236883","last_clean":"2023-10-18 19:34:21.236883","last_became_active":"2023-10-18 19:34:20.854784","last_became_peered":"2023-10-18 19:34:20.854784","last_unstale":"2023-10-18 19:34:21.236883","last_undegraded":"2023-10-18 19:34:21.236883","last_fullsized":"2023-10-18 19:34:21.236883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267335","last_change":"2023-10-18 19:34:21.257919","last_active":"2023-10-18 19:34:21.267335","last_peered":"2023-10-18 19:34:21.267335","last_clean":"2023-10-18 19:34:21.267335","last_became_active":"2023-10-18 19:34:21.257409","last_became_peered":"2023-10-18 19:34:21.257409","last_unstale":"2023-10-18 19:34:21.267335","last_undegraded":"2023-10-18 19:34:21.267335","last_fullsized":"2023-10-18 19:34:21.267335","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.228386","last_change":"2023-10-18 19:34:20.847577","last_active":"2023-10-18 19:34:21.228386","last_peered":"2023-10-18 19:34:21.228386","last_clean":"2023-10-18 19:34:21.228386","last_became_active":"2023-10-18 19:34:20.842013","last_became_peered":"2023-10-18 19:34:20.842013","last_unstale":"2023-10-18 19:34:21.228386","last_undegraded":"2023-10-18 19:34:21.228386","last_fullsized":"2023-10-18 19:34:21.228386","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258434","last_change":"2023-10-18 19:34:21.251747","last_active":"2023-10-18 19:34:21.258434","last_peered":"2023-10-18 19:34:21.258434","last_clean":"2023-10-18 19:34:21.258434","last_became_active":"2023-10-18 19:34:21.251325","last_became_peered":"2023-10-18 19:34:21.251325","last_unstale":"2023-10-18 19:34:21.258434","last_undegraded":"2023-10-18 19:34:21.258434","last_fullsized":"2023-10-18 19:34:21.258434","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.242972","last_change":"2023-10-18 19:34:20.832572","last_active":"2023-10-18 19:34:24.242972","last_peered":"2023-10-18 19:34:24.242972","last_clean":"2023-10-18 19:34:24.242972","last_became_active":"2023-10-18 19:34:20.832216","last_became_peered":"2023-10-18 19:34:20.832216","last_unstale":"2023-10-18 19:34:24.242972","last_undegraded":"2023-10-18 19:34:24.242972","last_fullsized":"2023-10-18 19:34:24.242972","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276296","last_change":"2023-10-18 19:34:21.272247","last_active":"2023-10-18 19:34:21.276296","last_peered":"2023-10-18 19:34:21.276296","last_clean":"2023-10-18 19:34:21.276296","last_became_active":"2023-10-18 19:34:21.271930","last_became_peered":"2023-10-18 19:34:21.271930","last_unstale":"2023-10-18 19:34:21.276296","last_undegraded":"2023-10-18 19:34:21.276296","last_fullsized":"2023-10-18 19:34:21.276296","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235502","last_change":"2023-10-18 19:34:20.840841","last_active":"2023-10-18 19:34:21.235502","last_peered":"2023-10-18 19:34:21.235502","last_clean":"2023-10-18 19:34:21.235502","last_became_active":"2023-10-18 19:34:20.840351","last_became_peered":"2023-10-18 19:34:20.840351","last_unstale":"2023-10-18 19:34:21.235502","last_undegraded":"2023-10-18 19:34:21.235502","last_fullsized":"2023-10-18 19:34:21.235502","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262872","last_change":"2023-10-18 19:34:21.258445","last_active":"2023-10-18 19:34:21.262872","last_peered":"2023-10-18 19:34:21.262872","last_clean":"2023-10-18 19:34:21.262872","last_became_active":"2023-10-18 19:34:21.257747","last_became_peered":"2023-10-18 19:34:21.257747","last_unstale":"2023-10-18 19:34:21.262872","last_undegraded":"2023-10-18 19:34:21.262872","last_fullsized":"2023-10-18 19:34:21.262872","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.233329","last_change":"2023-10-18 19:34:20.856638","last_active":"2023-10-18 19:34:21.233329","last_peered":"2023-10-18 19:34:21.233329","last_clean":"2023-10-18 19:34:21.233329","last_became_active":"2023-10-18 19:34:20.856094","last_became_peered":"2023-10-18 19:34:20.856094","last_unstale":"2023-10-18 19:34:21.233329","last_undegraded":"2023-10-18 19:34:21.233329","last_fullsized":"2023-10-18 19:34:21.233329","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254821","last_change":"2023-10-18 19:34:21.249180","last_active":"2023-10-18 19:34:21.254821","last_peered":"2023-10-18 19:34:21.254821","last_clean":"2023-10-18 19:34:21.254821","last_became_active":"2023-10-18 19:34:21.245370","last_became_peered":"2023-10-18 19:34:21.245370","last_unstale":"2023-10-18 19:34:21.254821","last_undegraded":"2023-10-18 19:34:21.254821","last_fullsized":"2023-10-18 19:34:21.254821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.265777","last_change":"2023-10-18 19:34:20.823278","last_active":"2023-10-18 19:34:21.265777","last_peered":"2023-10-18 19:34:21.265777","last_clean":"2023-10-18 19:34:21.265777","last_became_active":"2023-10-18 19:34:20.823003","last_became_peered":"2023-10-18 19:34:20.823003","last_unstale":"2023-10-18 19:34:21.265777","last_undegraded":"2023-10-18 19:34:21.265777","last_fullsized":"2023-10-18 19:34:21.265777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253391","last_change":"2023-10-18 19:34:21.246335","last_active":"2023-10-18 19:34:21.253391","last_peered":"2023-10-18 19:34:21.253391","last_clean":"2023-10-18 19:34:21.253391","last_became_active":"2023-10-18 19:34:21.246040","last_became_peered":"2023-10-18 19:34:21.246040","last_unstale":"2023-10-18 19:34:21.253391","last_undegraded":"2023-10-18 19:34:21.253391","last_fullsized":"2023-10-18 19:34:21.253391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.245088","last_change":"2023-10-18 19:34:20.855032","last_active":"2023-10-18 19:34:24.245088","last_peered":"2023-10-18 19:34:24.245088","last_clean":"2023-10-18 19:34:24.245088","last_became_active":"2023-10-18 19:34:20.854673","last_became_peered":"2023-10-18 19:34:20.854673","last_unstale":"2023-10-18 19:34:24.245088","last_undegraded":"2023-10-18 19:34:24.245088","last_fullsized":"2023-10-18 19:34:24.245088","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.259565","last_change":"2023-10-18 19:34:21.254232","last_active":"2023-10-18 19:34:21.259565","last_peered":"2023-10-18 19:34:21.259565","last_clean":"2023-10-18 19:34:21.259565","last_became_active":"2023-10-18 19:34:21.253932","last_became_peered":"2023-10-18 19:34:21.253932","last_unstale":"2023-10-18 19:34:21.259565","last_undegraded":"2023-10-18 19:34:21.259565","last_fullsized":"2023-10-18 19:34:21.259565","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236496","last_change":"2023-10-18 19:34:20.855559","last_active":"2023-10-18 19:34:21.236496","last_peered":"2023-10-18 19:34:21.236496","last_clean":"2023-10-18 19:34:21.236496","last_became_active":"2023-10-18 19:34:20.854845","last_became_peered":"2023-10-18 19:34:20.854845","last_unstale":"2023-10-18 19:34:21.236496","last_undegraded":"2023-10-18 19:34:21.236496","last_fullsized":"2023-10-18 19:34:21.236496","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262693","last_change":"2023-10-18 19:34:21.248190","last_active":"2023-10-18 19:34:21.262693","last_peered":"2023-10-18 19:34:21.262693","last_clean":"2023-10-18 19:34:21.262693","last_became_active":"2023-10-18 19:34:21.247102","last_became_peered":"2023-10-18 19:34:21.247102","last_unstale":"2023-10-18 19:34:21.262693","last_undegraded":"2023-10-18 19:34:21.262693","last_fullsized":"2023-10-18 19:34:21.262693","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244862","last_change":"2023-10-18 19:34:20.857956","last_active":"2023-10-18 19:34:24.244862","last_peered":"2023-10-18 19:34:24.244862","last_clean":"2023-10-18 19:34:24.244862","last_became_active":"2023-10-18 19:34:20.855051","last_became_peered":"2023-10-18 19:34:20.855051","last_unstale":"2023-10-18 19:34:24.244862","last_undegraded":"2023-10-18 19:34:24.244862","last_fullsized":"2023-10-18 19:34:24.244862","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270992","last_change":"2023-10-18 19:34:21.266700","last_active":"2023-10-18 19:34:21.270992","last_peered":"2023-10-18 19:34:21.270992","last_clean":"2023-10-18 19:34:21.270992","last_became_active":"2023-10-18 19:34:21.266409","last_became_peered":"2023-10-18 19:34:21.266409","last_unstale":"2023-10-18 19:34:21.270992","last_undegraded":"2023-10-18 19:34:21.270992","last_fullsized":"2023-10-18 19:34:21.270992","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238606","last_change":"2023-10-18 19:34:20.851465","last_active":"2023-10-18 19:34:21.238606","last_peered":"2023-10-18 19:34:21.238606","last_clean":"2023-10-18 19:34:21.238606","last_became_active":"2023-10-18 19:34:20.851166","last_became_peered":"2023-10-18 19:34:20.851166","last_unstale":"2023-10-18 19:34:21.238606","last_undegraded":"2023-10-18 19:34:21.238606","last_fullsized":"2023-10-18 19:34:21.238606","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253575","last_change":"2023-10-18 19:34:21.245529","last_active":"2023-10-18 19:34:21.253575","last_peered":"2023-10-18 19:34:21.253575","last_clean":"2023-10-18 19:34:21.253575","last_became_active":"2023-10-18 19:34:21.245217","last_became_peered":"2023-10-18 19:34:21.245217","last_unstale":"2023-10-18 19:34:21.253575","last_undegraded":"2023-10-18 19:34:21.253575","last_fullsized":"2023-10-18 19:34:21.253575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.226961","last_change":"2023-10-18 19:34:20.837517","last_active":"2023-10-18 19:34:22.226961","last_peered":"2023-10-18 19:34:22.226961","last_clean":"2023-10-18 19:34:22.226961","last_became_active":"2023-10-18 19:34:20.837192","last_became_peered":"2023-10-18 19:34:20.837192","last_unstale":"2023-10-18 19:34:22.226961","last_undegraded":"2023-10-18 19:34:22.226961","last_fullsized":"2023-10-18 19:34:22.226961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271163","last_change":"2023-10-18 19:34:21.262649","last_active":"2023-10-18 19:34:21.271163","last_peered":"2023-10-18 19:34:21.271163","last_clean":"2023-10-18 19:34:21.271163","last_became_active":"2023-10-18 19:34:21.262175","last_became_peered":"2023-10-18 19:34:21.262175","last_unstale":"2023-10-18 19:34:21.271163","last_undegraded":"2023-10-18 19:34:21.271163","last_fullsized":"2023-10-18 19:34:21.271163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237168","last_change":"2023-10-18 19:34:20.821558","last_active":"2023-10-18 19:34:21.237168","last_peered":"2023-10-18 19:34:21.237168","last_clean":"2023-10-18 19:34:21.237168","last_became_active":"2023-10-18 19:34:20.821225","last_became_peered":"2023-10-18 19:34:20.821225","last_unstale":"2023-10-18 19:34:21.237168","last_undegraded":"2023-10-18 19:34:21.237168","last_fullsized":"2023-10-18 19:34:21.237168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272370","last_change":"2023-10-18 19:34:21.268630","last_active":"2023-10-18 19:34:21.272370","last_peered":"2023-10-18 19:34:21.272370","last_clean":"2023-10-18 19:34:21.272370","last_became_active":"2023-10-18 19:34:21.268347","last_became_peered":"2023-10-18 19:34:21.268347","last_unstale":"2023-10-18 19:34:21.272370","last_undegraded":"2023-10-18 19:34:21.272370","last_fullsized":"2023-10-18 19:34:21.272370","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276681","last_change":"2023-10-18 19:34:20.856427","last_active":"2023-10-18 19:34:21.276681","last_peered":"2023-10-18 19:34:21.276681","last_clean":"2023-10-18 19:34:21.276681","last_became_active":"2023-10-18 19:34:20.855877","last_became_peered":"2023-10-18 19:34:20.855877","last_unstale":"2023-10-18 19:34:21.276681","last_undegraded":"2023-10-18 19:34:21.276681","last_fullsized":"2023-10-18 19:34:21.276681","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267065","last_change":"2023-10-18 19:34:21.259142","last_active":"2023-10-18 19:34:21.267065","last_peered":"2023-10-18 19:34:21.267065","last_clean":"2023-10-18 19:34:21.267065","last_became_active":"2023-10-18 19:34:21.258709","last_became_peered":"2023-10-18 19:34:21.258709","last_unstale":"2023-10-18 19:34:21.267065","last_undegraded":"2023-10-18 19:34:21.267065","last_fullsized":"2023-10-18 19:34:21.267065","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260963","last_change":"2023-10-18 19:34:20.861616","last_active":"2023-10-18 19:34:21.260963","last_peered":"2023-10-18 19:34:21.260963","last_clean":"2023-10-18 19:34:21.260963","last_became_active":"2023-10-18 19:34:20.861363","last_became_peered":"2023-10-18 19:34:20.861363","last_unstale":"2023-10-18 19:34:21.260963","last_undegraded":"2023-10-18 19:34:21.260963","last_fullsized":"2023-10-18 19:34:21.260963","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272280","last_change":"2023-10-18 19:34:21.267981","last_active":"2023-10-18 19:34:21.272280","last_peered":"2023-10-18 19:34:21.272280","last_clean":"2023-10-18 19:34:21.272280","last_became_active":"2023-10-18 19:34:21.267584","last_became_peered":"2023-10-18 19:34:21.267584","last_unstale":"2023-10-18 19:34:21.272280","last_undegraded":"2023-10-18 19:34:21.272280","last_fullsized":"2023-10-18 19:34:21.272280","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261640","last_change":"2023-10-18 19:34:20.855045","last_active":"2023-10-18 19:34:21.261640","last_peered":"2023-10-18 19:34:21.261640","last_clean":"2023-10-18 19:34:21.261640","last_became_active":"2023-10-18 19:34:20.854724","last_became_peered":"2023-10-18 19:34:20.854724","last_unstale":"2023-10-18 19:34:21.261640","last_undegraded":"2023-10-18 19:34:21.261640","last_fullsized":"2023-10-18 19:34:21.261640","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.269720","last_change":"2023-10-18 19:34:21.262741","last_active":"2023-10-18 19:34:21.269720","last_peered":"2023-10-18 19:34:21.269720","last_clean":"2023-10-18 19:34:21.269720","last_became_active":"2023-10-18 19:34:21.262435","last_became_peered":"2023-10-18 19:34:21.262435","last_unstale":"2023-10-18 19:34:21.269720","last_undegraded":"2023-10-18 19:34:21.269720","last_fullsized":"2023-10-18 19:34:21.269720","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236324","last_change":"2023-10-18 19:34:20.850195","last_active":"2023-10-18 19:34:21.236324","last_peered":"2023-10-18 19:34:21.236324","last_clean":"2023-10-18 19:34:21.236324","last_became_active":"2023-10-18 19:34:20.849885","last_became_peered":"2023-10-18 19:34:20.849885","last_unstale":"2023-10-18 19:34:21.236324","last_undegraded":"2023-10-18 19:34:21.236324","last_fullsized":"2023-10-18 19:34:21.236324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254998","last_change":"2023-10-18 19:34:21.248730","last_active":"2023-10-18 19:34:21.254998","last_peered":"2023-10-18 19:34:21.254998","last_clean":"2023-10-18 19:34:21.254998","last_became_active":"2023-10-18 19:34:21.248420","last_became_peered":"2023-10-18 19:34:21.248420","last_unstale":"2023-10-18 19:34:21.254998","last_undegraded":"2023-10-18 19:34:21.254998","last_fullsized":"2023-10-18 19:34:21.254998","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238187","last_change":"2023-10-18 19:34:20.862008","last_active":"2023-10-18 19:34:21.238187","last_peered":"2023-10-18 19:34:21.238187","last_clean":"2023-10-18 19:34:21.238187","last_became_active":"2023-10-18 19:34:20.858973","last_became_peered":"2023-10-18 19:34:20.858973","last_unstale":"2023-10-18 19:34:21.238187","last_undegraded":"2023-10-18 19:34:21.238187","last_fullsized":"2023-10-18 19:34:21.238187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264920","last_change":"2023-10-18 19:34:21.259920","last_active":"2023-10-18 19:34:21.264920","last_peered":"2023-10-18 19:34:21.264920","last_clean":"2023-10-18 19:34:21.264920","last_became_active":"2023-10-18 19:34:21.259474","last_became_peered":"2023-10-18 19:34:21.259474","last_unstale":"2023-10-18 19:34:21.264920","last_undegraded":"2023-10-18 19:34:21.264920","last_fullsized":"2023-10-18 19:34:21.264920","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263166","last_change":"2023-10-18 19:34:20.842664","last_active":"2023-10-18 19:34:21.263166","last_peered":"2023-10-18 19:34:21.263166","last_clean":"2023-10-18 19:34:21.263166","last_became_active":"2023-10-18 19:34:20.842341","last_became_peered":"2023-10-18 19:34:20.842341","last_unstale":"2023-10-18 19:34:21.263166","last_undegraded":"2023-10-18 19:34:21.263166","last_fullsized":"2023-10-18 19:34:21.263166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":42919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":42259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]}]}} 2023-10-18T19:34:31.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:34:32.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.217 7f11b4d9d700 1 Processor -- start 2023-10-18T19:34:32.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.217 7f11b4d9d700 1 -- start start 2023-10-18T19:34:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11b4d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11b00f6410 0x7f11b01b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11b4d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01b2050 0x7f11b0102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11b4d9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00ff840 con 0x7f11b01b24a0 2023-10-18T19:34:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11b4d9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b0116250 con 0x7f11b00f6410 2023-10-18T19:34:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11b4d9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01115b0 con 0x7f11b01b2050 2023-10-18T19:34:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11ae3fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11b00f6410 0x7f11b01b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11adbfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01b2050 0x7f11b0102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11ae3fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11b00f6410 0x7f11b01b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37452/0 (socket says 172.21.15.88:37452) 2023-10-18T19:34:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.218 7f11ae3fe700 1 -- 172.21.15.88:0/607524959 learned_addr learned my addr 172.21.15.88:0/607524959 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ae3fe700 1 -- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01b2050 msgr2=0x7f11b0102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:32.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ae3fe700 1 --2- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01b2050 0x7f11b0102fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ae3fe700 1 -- 172.21.15.88:0/607524959 >> v1:172.21.15.88:6789/0 conn(0x7f11b01b24a0 legacy=0x7f11b01035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ae3fe700 1 -- 172.21.15.88:0/607524959 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0103dd0 con 0x7f11b00f6410 2023-10-18T19:34:32.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ae3fe700 1 --2- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00f6410 0x7f11b01b1a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f11a0002f70 tx=0x7f11a0009a50).ready entity=mon.0 client_cookie=2c9a60ee643ac17e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:32.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ad3fc700 1 -- 172.21.15.88:0/607524959 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11b0103dd0 con 0x7f11b00f6410 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ad3fc700 1 -- 172.21.15.88:0/607524959 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a000f510 con 0x7f11b00f6410 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11ad3fc700 1 -- 172.21.15.88:0/607524959 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a000f6f0 con 0x7f11b00f6410 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11b4d9d700 1 -- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00f6410 msgr2=0x7f11b01b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.219 7f11b4d9d700 1 --2- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00f6410 0x7f11b01b1a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f11a0002f70 tx=0x7f11a0009a50).stop 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 -- 172.21.15.88:0/607524959 shutdown_connections 2023-10-18T19:34:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 --2- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00f6410 0x7f11b01b1a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 --2- 172.21.15.88:0/607524959 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01b2050 0x7f11b0102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 -- 172.21.15.88:0/607524959 >> 172.21.15.88:0/607524959 conn(0x7f11b0117180 msgr2=0x7f11b00f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 -- 172.21.15.88:0/607524959 shutdown_connections 2023-10-18T19:34:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.220 7f11b4d9d700 1 -- 172.21.15.88:0/607524959 wait complete. 2023-10-18T19:34:32.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.245 7f11b4d9d700 1 Processor -- start 2023-10-18T19:34:32.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.245 7f11b4d9d700 1 -- start start 2023-10-18T19:34:32.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 0x7f11b00c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 0x7f11b01c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11b01b0a60 0x7f11b01b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7060 con 0x7f11b00c5dc0 2023-10-18T19:34:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01c3c00 con 0x7f11b01b0a60 2023-10-18T19:34:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11b4d9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7bb0 con 0x7f11b01c3180 2023-10-18T19:34:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11ae3fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 0x7f11b00c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11ae3fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 0x7f11b00c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37454/0 (socket says 172.21.15.88:37454) 2023-10-18T19:34:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11ae3fe700 1 -- 172.21.15.88:0/1783841936 learned_addr learned my addr 172.21.15.88:0/1783841936 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11adbfd700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 0x7f11b01c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11aebff700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11b01b0a60 0x7f11b01b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11adbfd700 1 -- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11b01b0a60 msgr2=0x7f11b01b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11adbfd700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11b01b0a60 0x7f11b01b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11adbfd700 1 -- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 msgr2=0x7f11b00c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.246 7f11adbfd700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 0x7f11b00c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f11adbfd700 1 -- 172.21.15.88:0/1783841936 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b01b9200 con 0x7f11b01c3180 2023-10-18T19:34:32.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f11adbfd700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 0x7f11b01c35d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f11a400c000 tx=0x7f11a400ebf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:32.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11b01b9200 con 0x7f11b01c3180 2023-10-18T19:34:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a400c830 con 0x7f11b01c3180 2023-10-18T19:34:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b01b8e40 con 0x7f11b01c3180 2023-10-18T19:34:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f11a400f040 con 0x7f11b01c3180 2023-10-18T19:34:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.247 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b01b14e0 con 0x7f11b01c3180 2023-10-18T19:34:32.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.248 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f11a4011070 con 0x7f11b01c3180 2023-10-18T19:34:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.249 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f11a4010040 con 0x7f11b01c3180 2023-10-18T19:34:32.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.249 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b00f0320 con 0x7f11b01c3180 2023-10-18T19:34:32.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.253 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f11a400c620 con 0x7f11b01c3180 2023-10-18T19:34:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.346 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 --> v1:172.21.15.88:6800/107321 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f11b00882a0 con 0x7f118c01c1b0 2023-10-18T19:34:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.354 7f119f7fe700 1 -- 172.21.15.88:0/1783841936 <== mgr.4110 v1:172.21.15.88:6800/107321 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306107 (unknown 2965378022 0 2147364613) 0x7f11a0006bf0 con 0x7f118c01c1b0 2023-10-18T19:34:32.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 >> v1:172.21.15.88:6800/107321 conn(0x7f118c01c1b0 legacy=0x7f118c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 msgr2=0x7f11b01c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 0x7f11b01c35d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f11a400c000 tx=0x7f11a400ebf0).stop 2023-10-18T19:34:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 shutdown_connections 2023-10-18T19:34:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11b01b0a60 0x7f11b01b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.357 7f11b4d9d700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11b00c5dc0 0x7f11b00c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.358 7f11b4d9d700 1 --2- 172.21.15.88:0/1783841936 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f11b01c3180 0x7f11b01c35d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.358 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 >> 172.21.15.88:0/1783841936 conn(0x7f11b00d0a50 msgr2=0x7f11b00dc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.358 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 shutdown_connections 2023-10-18T19:34:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.358 7f11b4d9d700 1 -- 172.21.15.88:0/1783841936 wait complete. 2023-10-18T19:34:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:34:32.375 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-18 19:34:31.946967","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194992,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292368,"statfs":{"total":386547056640,"available":382251384832,"internally_reserved":4294967296,"allocated":671744,"data_stored":167536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001697"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272531","last_change":"2023-10-18 19:34:21.266064","last_active":"2023-10-18 19:34:21.272531","last_peered":"2023-10-18 19:34:21.272531","last_clean":"2023-10-18 19:34:21.272531","last_became_active":"2023-10-18 19:34:21.265745","last_became_peered":"2023-10-18 19:34:21.265745","last_unstale":"2023-10-18 19:34:21.272531","last_undegraded":"2023-10-18 19:34:21.272531","last_fullsized":"2023-10-18 19:34:21.272531","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.252075","last_change":"2023-10-18 19:34:20.848544","last_active":"2023-10-18 19:34:24.252075","last_peered":"2023-10-18 19:34:24.252075","last_clean":"2023-10-18 19:34:24.252075","last_became_active":"2023-10-18 19:34:20.848186","last_became_peered":"2023-10-18 19:34:20.848186","last_unstale":"2023-10-18 19:34:24.252075","last_undegraded":"2023-10-18 19:34:24.252075","last_fullsized":"2023-10-18 19:34:24.252075","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254972","last_change":"2023-10-18 19:34:21.249452","last_active":"2023-10-18 19:34:21.254972","last_peered":"2023-10-18 19:34:21.254972","last_clean":"2023-10-18 19:34:21.254972","last_became_active":"2023-10-18 19:34:21.249103","last_became_peered":"2023-10-18 19:34:21.249103","last_unstale":"2023-10-18 19:34:21.254972","last_undegraded":"2023-10-18 19:34:21.254972","last_fullsized":"2023-10-18 19:34:21.254972","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227163","last_change":"2023-10-18 19:34:20.835459","last_active":"2023-10-18 19:34:21.227163","last_peered":"2023-10-18 19:34:21.227163","last_clean":"2023-10-18 19:34:21.227163","last_became_active":"2023-10-18 19:34:20.835145","last_became_peered":"2023-10-18 19:34:20.835145","last_unstale":"2023-10-18 19:34:21.227163","last_undegraded":"2023-10-18 19:34:21.227163","last_fullsized":"2023-10-18 19:34:21.227163","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271140","last_change":"2023-10-18 19:34:21.262486","last_active":"2023-10-18 19:34:21.271140","last_peered":"2023-10-18 19:34:21.271140","last_clean":"2023-10-18 19:34:21.271140","last_became_active":"2023-10-18 19:34:21.261956","last_became_peered":"2023-10-18 19:34:21.261956","last_unstale":"2023-10-18 19:34:21.271140","last_undegraded":"2023-10-18 19:34:21.271140","last_fullsized":"2023-10-18 19:34:21.271140","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227255","last_change":"2023-10-18 19:34:20.854649","last_active":"2023-10-18 19:34:21.227255","last_peered":"2023-10-18 19:34:21.227255","last_clean":"2023-10-18 19:34:21.227255","last_became_active":"2023-10-18 19:34:20.854333","last_became_peered":"2023-10-18 19:34:20.854333","last_unstale":"2023-10-18 19:34:21.227255","last_undegraded":"2023-10-18 19:34:21.227255","last_fullsized":"2023-10-18 19:34:21.227255","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.257946","last_change":"2023-10-18 19:34:21.246025","last_active":"2023-10-18 19:34:21.257946","last_peered":"2023-10-18 19:34:21.257946","last_clean":"2023-10-18 19:34:21.257946","last_became_active":"2023-10-18 19:34:21.245735","last_became_peered":"2023-10-18 19:34:21.245735","last_unstale":"2023-10-18 19:34:21.257946","last_undegraded":"2023-10-18 19:34:21.257946","last_fullsized":"2023-10-18 19:34:21.257946","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223152","last_change":"2023-10-18 19:34:20.853312","last_active":"2023-10-18 19:34:21.223152","last_peered":"2023-10-18 19:34:21.223152","last_clean":"2023-10-18 19:34:21.223152","last_became_active":"2023-10-18 19:34:20.852964","last_became_peered":"2023-10-18 19:34:20.852964","last_unstale":"2023-10-18 19:34:21.223152","last_undegraded":"2023-10-18 19:34:21.223152","last_fullsized":"2023-10-18 19:34:21.223152","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271780","last_change":"2023-10-18 19:34:21.265408","last_active":"2023-10-18 19:34:21.271780","last_peered":"2023-10-18 19:34:21.271780","last_clean":"2023-10-18 19:34:21.271780","last_became_active":"2023-10-18 19:34:21.265029","last_became_peered":"2023-10-18 19:34:21.265029","last_unstale":"2023-10-18 19:34:21.271780","last_undegraded":"2023-10-18 19:34:21.271780","last_fullsized":"2023-10-18 19:34:21.271780","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.242751","last_change":"2023-10-18 19:34:20.825709","last_active":"2023-10-18 19:34:24.242751","last_peered":"2023-10-18 19:34:24.242751","last_clean":"2023-10-18 19:34:24.242751","last_became_active":"2023-10-18 19:34:20.825364","last_became_peered":"2023-10-18 19:34:20.825364","last_unstale":"2023-10-18 19:34:24.242751","last_undegraded":"2023-10-18 19:34:24.242751","last_fullsized":"2023-10-18 19:34:24.242751","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.255066","last_change":"2023-10-18 19:34:21.250032","last_active":"2023-10-18 19:34:21.255066","last_peered":"2023-10-18 19:34:21.255066","last_clean":"2023-10-18 19:34:21.255066","last_became_active":"2023-10-18 19:34:21.245104","last_became_peered":"2023-10-18 19:34:21.245104","last_unstale":"2023-10-18 19:34:21.255066","last_undegraded":"2023-10-18 19:34:21.255066","last_fullsized":"2023-10-18 19:34:21.255066","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237886","last_change":"2023-10-18 19:34:20.862583","last_active":"2023-10-18 19:34:21.237886","last_peered":"2023-10-18 19:34:21.237886","last_clean":"2023-10-18 19:34:21.237886","last_became_active":"2023-10-18 19:34:20.862262","last_became_peered":"2023-10-18 19:34:20.862262","last_unstale":"2023-10-18 19:34:21.237886","last_undegraded":"2023-10-18 19:34:21.237886","last_fullsized":"2023-10-18 19:34:21.237886","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271127","last_change":"2023-10-18 19:34:21.265750","last_active":"2023-10-18 19:34:21.271127","last_peered":"2023-10-18 19:34:21.271127","last_clean":"2023-10-18 19:34:21.271127","last_became_active":"2023-10-18 19:34:21.265449","last_became_peered":"2023-10-18 19:34:21.265449","last_unstale":"2023-10-18 19:34:21.271127","last_undegraded":"2023-10-18 19:34:21.271127","last_fullsized":"2023-10-18 19:34:21.271127","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483714","last_change":"2023-10-18 19:34:20.855201","last_active":"2023-10-18 19:34:22.483714","last_peered":"2023-10-18 19:34:22.483714","last_clean":"2023-10-18 19:34:22.483714","last_became_active":"2023-10-18 19:34:20.854344","last_became_peered":"2023-10-18 19:34:20.854344","last_unstale":"2023-10-18 19:34:22.483714","last_undegraded":"2023-10-18 19:34:22.483714","last_fullsized":"2023-10-18 19:34:22.483714","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254841","last_change":"2023-10-18 19:34:21.249688","last_active":"2023-10-18 19:34:21.254841","last_peered":"2023-10-18 19:34:21.254841","last_clean":"2023-10-18 19:34:21.254841","last_became_active":"2023-10-18 19:34:21.246078","last_became_peered":"2023-10-18 19:34:21.246078","last_unstale":"2023-10-18 19:34:21.254841","last_undegraded":"2023-10-18 19:34:21.254841","last_fullsized":"2023-10-18 19:34:21.254841","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279052","last_change":"2023-10-18 19:34:20.857791","last_active":"2023-10-18 19:34:21.279052","last_peered":"2023-10-18 19:34:21.279052","last_clean":"2023-10-18 19:34:21.279052","last_became_active":"2023-10-18 19:34:20.857489","last_became_peered":"2023-10-18 19:34:20.857489","last_unstale":"2023-10-18 19:34:21.279052","last_undegraded":"2023-10-18 19:34:21.279052","last_fullsized":"2023-10-18 19:34:21.279052","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253320","last_change":"2023-10-18 19:34:21.245879","last_active":"2023-10-18 19:34:21.253320","last_peered":"2023-10-18 19:34:21.253320","last_clean":"2023-10-18 19:34:21.253320","last_became_active":"2023-10-18 19:34:21.245587","last_became_peered":"2023-10-18 19:34:21.245587","last_unstale":"2023-10-18 19:34:21.253320","last_undegraded":"2023-10-18 19:34:21.253320","last_fullsized":"2023-10-18 19:34:21.253320","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.245894","last_change":"2023-10-18 19:34:20.857559","last_active":"2023-10-18 19:34:24.245894","last_peered":"2023-10-18 19:34:24.245894","last_clean":"2023-10-18 19:34:24.245894","last_became_active":"2023-10-18 19:34:20.857227","last_became_peered":"2023-10-18 19:34:20.857227","last_unstale":"2023-10-18 19:34:24.245894","last_undegraded":"2023-10-18 19:34:24.245894","last_fullsized":"2023-10-18 19:34:24.245894","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262911","last_change":"2023-10-18 19:34:21.258745","last_active":"2023-10-18 19:34:21.262911","last_peered":"2023-10-18 19:34:21.262911","last_clean":"2023-10-18 19:34:21.262911","last_became_active":"2023-10-18 19:34:21.258295","last_became_peered":"2023-10-18 19:34:21.258295","last_unstale":"2023-10-18 19:34:21.262911","last_undegraded":"2023-10-18 19:34:21.262911","last_fullsized":"2023-10-18 19:34:21.262911","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.247369","last_change":"2023-10-18 19:34:20.836255","last_active":"2023-10-18 19:34:24.247369","last_peered":"2023-10-18 19:34:24.247369","last_clean":"2023-10-18 19:34:24.247369","last_became_active":"2023-10-18 19:34:20.835941","last_became_peered":"2023-10-18 19:34:20.835941","last_unstale":"2023-10-18 19:34:24.247369","last_undegraded":"2023-10-18 19:34:24.247369","last_fullsized":"2023-10-18 19:34:24.247369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262394","last_change":"2023-10-18 19:34:21.253538","last_active":"2023-10-18 19:34:21.262394","last_peered":"2023-10-18 19:34:21.262394","last_clean":"2023-10-18 19:34:21.262394","last_became_active":"2023-10-18 19:34:21.253274","last_became_peered":"2023-10-18 19:34:21.253274","last_unstale":"2023-10-18 19:34:21.262394","last_undegraded":"2023-10-18 19:34:21.262394","last_fullsized":"2023-10-18 19:34:21.262394","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235274","last_change":"2023-10-18 19:34:20.857139","last_active":"2023-10-18 19:34:21.235274","last_peered":"2023-10-18 19:34:21.235274","last_clean":"2023-10-18 19:34:21.235274","last_became_active":"2023-10-18 19:34:20.856766","last_became_peered":"2023-10-18 19:34:20.856766","last_unstale":"2023-10-18 19:34:21.235274","last_undegraded":"2023-10-18 19:34:21.235274","last_fullsized":"2023-10-18 19:34:21.235274","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276422","last_change":"2023-10-18 19:34:21.272980","last_active":"2023-10-18 19:34:21.276422","last_peered":"2023-10-18 19:34:21.276422","last_clean":"2023-10-18 19:34:21.276422","last_became_active":"2023-10-18 19:34:21.272618","last_became_peered":"2023-10-18 19:34:21.272618","last_unstale":"2023-10-18 19:34:21.276422","last_undegraded":"2023-10-18 19:34:21.276422","last_fullsized":"2023-10-18 19:34:21.276422","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276732","last_change":"2023-10-18 19:34:20.828547","last_active":"2023-10-18 19:34:21.276732","last_peered":"2023-10-18 19:34:21.276732","last_clean":"2023-10-18 19:34:21.276732","last_became_active":"2023-10-18 19:34:20.828036","last_became_peered":"2023-10-18 19:34:20.828036","last_unstale":"2023-10-18 19:34:21.276732","last_undegraded":"2023-10-18 19:34:21.276732","last_fullsized":"2023-10-18 19:34:21.276732","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271801","last_change":"2023-10-18 19:34:21.265823","last_active":"2023-10-18 19:34:21.271801","last_peered":"2023-10-18 19:34:21.271801","last_clean":"2023-10-18 19:34:21.271801","last_became_active":"2023-10-18 19:34:21.265276","last_became_peered":"2023-10-18 19:34:21.265276","last_unstale":"2023-10-18 19:34:21.271801","last_undegraded":"2023-10-18 19:34:21.271801","last_fullsized":"2023-10-18 19:34:21.271801","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.268602","last_change":"2023-10-18 19:34:20.856792","last_active":"2023-10-18 19:34:21.268602","last_peered":"2023-10-18 19:34:21.268602","last_clean":"2023-10-18 19:34:21.268602","last_became_active":"2023-10-18 19:34:20.856486","last_became_peered":"2023-10-18 19:34:20.856486","last_unstale":"2023-10-18 19:34:21.268602","last_undegraded":"2023-10-18 19:34:21.268602","last_fullsized":"2023-10-18 19:34:21.268602","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270893","last_change":"2023-10-18 19:34:21.265884","last_active":"2023-10-18 19:34:21.270893","last_peered":"2023-10-18 19:34:21.270893","last_clean":"2023-10-18 19:34:21.270893","last_became_active":"2023-10-18 19:34:21.265564","last_became_peered":"2023-10-18 19:34:21.265564","last_unstale":"2023-10-18 19:34:21.270893","last_undegraded":"2023-10-18 19:34:21.270893","last_fullsized":"2023-10-18 19:34:21.270893","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.279112","last_change":"2023-10-18 19:34:20.858811","last_active":"2023-10-18 19:34:21.279112","last_peered":"2023-10-18 19:34:21.279112","last_clean":"2023-10-18 19:34:21.279112","last_became_active":"2023-10-18 19:34:20.858481","last_became_peered":"2023-10-18 19:34:20.858481","last_unstale":"2023-10-18 19:34:21.279112","last_undegraded":"2023-10-18 19:34:21.279112","last_fullsized":"2023-10-18 19:34:21.279112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254341","last_change":"2023-10-18 19:34:21.246195","last_active":"2023-10-18 19:34:21.254341","last_peered":"2023-10-18 19:34:21.254341","last_clean":"2023-10-18 19:34:21.254341","last_became_active":"2023-10-18 19:34:21.245896","last_became_peered":"2023-10-18 19:34:21.245896","last_unstale":"2023-10-18 19:34:21.254341","last_undegraded":"2023-10-18 19:34:21.254341","last_fullsized":"2023-10-18 19:34:21.254341","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236208","last_change":"2023-10-18 19:34:20.855423","last_active":"2023-10-18 19:34:21.236208","last_peered":"2023-10-18 19:34:21.236208","last_clean":"2023-10-18 19:34:21.236208","last_became_active":"2023-10-18 19:34:20.854593","last_became_peered":"2023-10-18 19:34:20.854593","last_unstale":"2023-10-18 19:34:21.236208","last_undegraded":"2023-10-18 19:34:21.236208","last_fullsized":"2023-10-18 19:34:21.236208","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261064","last_change":"2023-10-18 19:34:21.256949","last_active":"2023-10-18 19:34:21.261064","last_peered":"2023-10-18 19:34:21.261064","last_clean":"2023-10-18 19:34:21.261064","last_became_active":"2023-10-18 19:34:21.256623","last_became_peered":"2023-10-18 19:34:21.256623","last_unstale":"2023-10-18 19:34:21.261064","last_undegraded":"2023-10-18 19:34:21.261064","last_fullsized":"2023-10-18 19:34:21.261064","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.247595","last_change":"2023-10-18 19:34:20.846802","last_active":"2023-10-18 19:34:21.247595","last_peered":"2023-10-18 19:34:21.247595","last_clean":"2023-10-18 19:34:21.247595","last_became_active":"2023-10-18 19:34:20.846249","last_became_peered":"2023-10-18 19:34:20.846249","last_unstale":"2023-10-18 19:34:21.247595","last_undegraded":"2023-10-18 19:34:21.247595","last_fullsized":"2023-10-18 19:34:21.247595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260942","last_change":"2023-10-18 19:34:21.258895","last_active":"2023-10-18 19:34:21.260942","last_peered":"2023-10-18 19:34:21.260942","last_clean":"2023-10-18 19:34:21.260942","last_became_active":"2023-10-18 19:34:21.256384","last_became_peered":"2023-10-18 19:34:21.256384","last_unstale":"2023-10-18 19:34:21.260942","last_undegraded":"2023-10-18 19:34:21.260942","last_fullsized":"2023-10-18 19:34:21.260942","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273620","last_change":"2023-10-18 19:34:20.850016","last_active":"2023-10-18 19:34:21.273620","last_peered":"2023-10-18 19:34:21.273620","last_clean":"2023-10-18 19:34:21.273620","last_became_active":"2023-10-18 19:34:20.849501","last_became_peered":"2023-10-18 19:34:20.849501","last_unstale":"2023-10-18 19:34:21.273620","last_undegraded":"2023-10-18 19:34:21.273620","last_fullsized":"2023-10-18 19:34:21.273620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262892","last_change":"2023-10-18 19:34:21.258646","last_active":"2023-10-18 19:34:21.262892","last_peered":"2023-10-18 19:34:21.262892","last_clean":"2023-10-18 19:34:21.262892","last_became_active":"2023-10-18 19:34:21.257999","last_became_peered":"2023-10-18 19:34:21.257999","last_unstale":"2023-10-18 19:34:21.262892","last_undegraded":"2023-10-18 19:34:21.262892","last_fullsized":"2023-10-18 19:34:21.262892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235868","last_change":"2023-10-18 19:34:20.856264","last_active":"2023-10-18 19:34:21.235868","last_peered":"2023-10-18 19:34:21.235868","last_clean":"2023-10-18 19:34:21.235868","last_became_active":"2023-10-18 19:34:20.856072","last_became_peered":"2023-10-18 19:34:20.856072","last_unstale":"2023-10-18 19:34:21.235868","last_undegraded":"2023-10-18 19:34:21.235868","last_fullsized":"2023-10-18 19:34:21.235868","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.248119","last_change":"2023-10-18 19:34:21.242536","last_active":"2023-10-18 19:34:21.248119","last_peered":"2023-10-18 19:34:21.248119","last_clean":"2023-10-18 19:34:21.248119","last_became_active":"2023-10-18 19:34:21.242187","last_became_peered":"2023-10-18 19:34:21.242187","last_unstale":"2023-10-18 19:34:21.248119","last_undegraded":"2023-10-18 19:34:21.248119","last_fullsized":"2023-10-18 19:34:21.248119","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244025","last_change":"2023-10-18 19:34:20.844847","last_active":"2023-10-18 19:34:24.244025","last_peered":"2023-10-18 19:34:24.244025","last_clean":"2023-10-18 19:34:24.244025","last_became_active":"2023-10-18 19:34:20.844528","last_became_peered":"2023-10-18 19:34:20.844528","last_unstale":"2023-10-18 19:34:24.244025","last_undegraded":"2023-10-18 19:34:24.244025","last_fullsized":"2023-10-18 19:34:24.244025","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276339","last_change":"2023-10-18 19:34:21.272824","last_active":"2023-10-18 19:34:21.276339","last_peered":"2023-10-18 19:34:21.276339","last_clean":"2023-10-18 19:34:21.276339","last_became_active":"2023-10-18 19:34:21.272631","last_became_peered":"2023-10-18 19:34:21.272631","last_unstale":"2023-10-18 19:34:21.276339","last_undegraded":"2023-10-18 19:34:21.276339","last_fullsized":"2023-10-18 19:34:21.276339","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236296","last_change":"2023-10-18 19:34:20.833452","last_active":"2023-10-18 19:34:21.236296","last_peered":"2023-10-18 19:34:21.236296","last_clean":"2023-10-18 19:34:21.236296","last_became_active":"2023-10-18 19:34:20.832840","last_became_peered":"2023-10-18 19:34:20.832840","last_unstale":"2023-10-18 19:34:21.236296","last_undegraded":"2023-10-18 19:34:21.236296","last_fullsized":"2023-10-18 19:34:21.236296","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261308","last_change":"2023-10-18 19:34:21.255174","last_active":"2023-10-18 19:34:21.261308","last_peered":"2023-10-18 19:34:21.261308","last_clean":"2023-10-18 19:34:21.261308","last_became_active":"2023-10-18 19:34:21.252377","last_became_peered":"2023-10-18 19:34:21.252377","last_unstale":"2023-10-18 19:34:21.261308","last_undegraded":"2023-10-18 19:34:21.261308","last_fullsized":"2023-10-18 19:34:21.261308","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.251597","last_change":"2023-10-18 19:34:11.535715","last_active":"2023-10-18 19:34:21.251597","last_peered":"2023-10-18 19:34:21.251597","last_clean":"2023-10-18 19:34:21.251597","last_became_active":"2023-10-18 19:34:11.534518","last_became_peered":"2023-10-18 19:34:11.534518","last_unstale":"2023-10-18 19:34:21.251597","last_undegraded":"2023-10-18 19:34:21.251597","last_fullsized":"2023-10-18 19:34:21.251597","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236775","last_change":"2023-10-18 19:34:20.857782","last_active":"2023-10-18 19:34:21.236775","last_peered":"2023-10-18 19:34:21.236775","last_clean":"2023-10-18 19:34:21.236775","last_became_active":"2023-10-18 19:34:20.853192","last_became_peered":"2023-10-18 19:34:20.853192","last_unstale":"2023-10-18 19:34:21.236775","last_undegraded":"2023-10-18 19:34:21.236775","last_fullsized":"2023-10-18 19:34:21.236775","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261029","last_change":"2023-10-18 19:34:21.257423","last_active":"2023-10-18 19:34:21.261029","last_peered":"2023-10-18 19:34:21.261029","last_clean":"2023-10-18 19:34:21.261029","last_became_active":"2023-10-18 19:34:21.256448","last_became_peered":"2023-10-18 19:34:21.256448","last_unstale":"2023-10-18 19:34:21.261029","last_undegraded":"2023-10-18 19:34:21.261029","last_fullsized":"2023-10-18 19:34:21.261029","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.231638","last_change":"2023-10-18 19:34:11.532756","last_active":"2023-10-18 19:34:21.231638","last_peered":"2023-10-18 19:34:21.231638","last_clean":"2023-10-18 19:34:21.231638","last_became_active":"2023-10-18 19:34:11.532425","last_became_peered":"2023-10-18 19:34:11.532425","last_unstale":"2023-10-18 19:34:21.231638","last_undegraded":"2023-10-18 19:34:21.231638","last_fullsized":"2023-10-18 19:34:21.231638","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262706","last_change":"2023-10-18 19:34:20.852964","last_active":"2023-10-18 19:34:21.262706","last_peered":"2023-10-18 19:34:21.262706","last_clean":"2023-10-18 19:34:21.262706","last_became_active":"2023-10-18 19:34:20.852642","last_became_peered":"2023-10-18 19:34:20.852642","last_unstale":"2023-10-18 19:34:21.262706","last_undegraded":"2023-10-18 19:34:21.262706","last_fullsized":"2023-10-18 19:34:21.262706","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235826","last_change":"2023-10-18 19:34:11.534856","last_active":"2023-10-18 19:34:21.235826","last_peered":"2023-10-18 19:34:21.235826","last_clean":"2023-10-18 19:34:21.235826","last_became_active":"2023-10-18 19:34:11.534541","last_became_peered":"2023-10-18 19:34:11.534541","last_unstale":"2023-10-18 19:34:21.235826","last_undegraded":"2023-10-18 19:34:21.235826","last_fullsized":"2023-10-18 19:34:21.235826","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.224350","last_change":"2023-10-18 19:34:20.847678","last_active":"2023-10-18 19:34:22.224350","last_peered":"2023-10-18 19:34:22.224350","last_clean":"2023-10-18 19:34:22.224350","last_became_active":"2023-10-18 19:34:20.847107","last_became_peered":"2023-10-18 19:34:20.847107","last_unstale":"2023-10-18 19:34:22.224350","last_undegraded":"2023-10-18 19:34:22.224350","last_fullsized":"2023-10-18 19:34:22.224350","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260656","last_change":"2023-10-18 19:34:21.255564","last_active":"2023-10-18 19:34:21.260656","last_peered":"2023-10-18 19:34:21.260656","last_clean":"2023-10-18 19:34:21.260656","last_became_active":"2023-10-18 19:34:21.255230","last_became_peered":"2023-10-18 19:34:21.255230","last_unstale":"2023-10-18 19:34:21.260656","last_undegraded":"2023-10-18 19:34:21.260656","last_fullsized":"2023-10-18 19:34:21.260656","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236452","last_change":"2023-10-18 19:34:11.535128","last_active":"2023-10-18 19:34:21.236452","last_peered":"2023-10-18 19:34:21.236452","last_clean":"2023-10-18 19:34:21.236452","last_became_active":"2023-10-18 19:34:11.534248","last_became_peered":"2023-10-18 19:34:11.534248","last_unstale":"2023-10-18 19:34:21.236452","last_undegraded":"2023-10-18 19:34:21.236452","last_fullsized":"2023-10-18 19:34:21.236452","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483720","last_change":"2023-10-18 19:34:20.855194","last_active":"2023-10-18 19:34:22.483720","last_peered":"2023-10-18 19:34:22.483720","last_clean":"2023-10-18 19:34:22.483720","last_became_active":"2023-10-18 19:34:20.854897","last_became_peered":"2023-10-18 19:34:20.854897","last_unstale":"2023-10-18 19:34:22.483720","last_undegraded":"2023-10-18 19:34:22.483720","last_fullsized":"2023-10-18 19:34:22.483720","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.275744","last_change":"2023-10-18 19:34:21.270017","last_active":"2023-10-18 19:34:21.275744","last_peered":"2023-10-18 19:34:21.275744","last_clean":"2023-10-18 19:34:21.275744","last_became_active":"2023-10-18 19:34:21.269485","last_became_peered":"2023-10-18 19:34:21.269485","last_unstale":"2023-10-18 19:34:21.275744","last_undegraded":"2023-10-18 19:34:21.275744","last_fullsized":"2023-10-18 19:34:21.275744","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.232447","last_change":"2023-10-18 19:34:11.532872","last_active":"2023-10-18 19:34:21.232447","last_peered":"2023-10-18 19:34:21.232447","last_clean":"2023-10-18 19:34:21.232447","last_became_active":"2023-10-18 19:34:11.531562","last_became_peered":"2023-10-18 19:34:11.531562","last_unstale":"2023-10-18 19:34:21.232447","last_undegraded":"2023-10-18 19:34:21.232447","last_fullsized":"2023-10-18 19:34:21.232447","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.247293","last_change":"2023-10-18 19:34:20.852891","last_active":"2023-10-18 19:34:24.247293","last_peered":"2023-10-18 19:34:24.247293","last_clean":"2023-10-18 19:34:24.247293","last_became_active":"2023-10-18 19:34:20.852426","last_became_peered":"2023-10-18 19:34:20.852426","last_unstale":"2023-10-18 19:34:24.247293","last_undegraded":"2023-10-18 19:34:24.247293","last_fullsized":"2023-10-18 19:34:24.247293","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271146","last_change":"2023-10-18 19:34:21.266390","last_active":"2023-10-18 19:34:21.271146","last_peered":"2023-10-18 19:34:21.271146","last_clean":"2023-10-18 19:34:21.271146","last_became_active":"2023-10-18 19:34:21.266089","last_became_peered":"2023-10-18 19:34:21.266089","last_unstale":"2023-10-18 19:34:21.271146","last_undegraded":"2023-10-18 19:34:21.271146","last_fullsized":"2023-10-18 19:34:21.271146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223059","last_change":"2023-10-18 19:34:11.532565","last_active":"2023-10-18 19:34:21.223059","last_peered":"2023-10-18 19:34:21.223059","last_clean":"2023-10-18 19:34:21.223059","last_became_active":"2023-10-18 19:34:11.532168","last_became_peered":"2023-10-18 19:34:11.532168","last_unstale":"2023-10-18 19:34:21.223059","last_undegraded":"2023-10-18 19:34:21.223059","last_fullsized":"2023-10-18 19:34:21.223059","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227100","last_change":"2023-10-18 19:34:20.852330","last_active":"2023-10-18 19:34:21.227100","last_peered":"2023-10-18 19:34:21.227100","last_clean":"2023-10-18 19:34:21.227100","last_became_active":"2023-10-18 19:34:20.851992","last_became_peered":"2023-10-18 19:34:20.851992","last_unstale":"2023-10-18 19:34:21.227100","last_undegraded":"2023-10-18 19:34:21.227100","last_fullsized":"2023-10-18 19:34:21.227100","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270746","last_change":"2023-10-18 19:34:21.264314","last_active":"2023-10-18 19:34:21.270746","last_peered":"2023-10-18 19:34:21.270746","last_clean":"2023-10-18 19:34:21.270746","last_became_active":"2023-10-18 19:34:21.263937","last_became_peered":"2023-10-18 19:34:21.263937","last_unstale":"2023-10-18 19:34:21.270746","last_undegraded":"2023-10-18 19:34:21.270746","last_fullsized":"2023-10-18 19:34:21.270746","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.225659","last_change":"2023-10-18 19:34:11.533453","last_active":"2023-10-18 19:34:21.225659","last_peered":"2023-10-18 19:34:21.225659","last_clean":"2023-10-18 19:34:21.225659","last_became_active":"2023-10-18 19:34:11.532769","last_became_peered":"2023-10-18 19:34:11.532769","last_unstale":"2023-10-18 19:34:21.225659","last_undegraded":"2023-10-18 19:34:21.225659","last_fullsized":"2023-10-18 19:34:21.225659","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.229268","last_change":"2023-10-18 19:34:20.853145","last_active":"2023-10-18 19:34:21.229268","last_peered":"2023-10-18 19:34:21.229268","last_clean":"2023-10-18 19:34:21.229268","last_became_active":"2023-10-18 19:34:20.852683","last_became_peered":"2023-10-18 19:34:20.852683","last_unstale":"2023-10-18 19:34:21.229268","last_undegraded":"2023-10-18 19:34:21.229268","last_fullsized":"2023-10-18 19:34:21.229268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273041","last_change":"2023-10-18 19:34:21.266346","last_active":"2023-10-18 19:34:21.273041","last_peered":"2023-10-18 19:34:21.273041","last_clean":"2023-10-18 19:34:21.273041","last_became_active":"2023-10-18 19:34:21.265950","last_became_peered":"2023-10-18 19:34:21.265950","last_unstale":"2023-10-18 19:34:21.273041","last_undegraded":"2023-10-18 19:34:21.273041","last_fullsized":"2023-10-18 19:34:21.273041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.240589","last_change":"2023-10-18 19:34:11.533454","last_active":"2023-10-18 19:34:21.240589","last_peered":"2023-10-18 19:34:21.240589","last_clean":"2023-10-18 19:34:21.240589","last_became_active":"2023-10-18 19:34:11.533123","last_became_peered":"2023-10-18 19:34:11.533123","last_unstale":"2023-10-18 19:34:21.240589","last_undegraded":"2023-10-18 19:34:21.240589","last_fullsized":"2023-10-18 19:34:21.240589","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:10.512706","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:10.512706","last_clean_scrub_stamp":"2023-10-18 19:34:10.512706","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235790","last_change":"2023-10-18 19:34:20.844955","last_active":"2023-10-18 19:34:21.235790","last_peered":"2023-10-18 19:34:21.235790","last_clean":"2023-10-18 19:34:21.235790","last_became_active":"2023-10-18 19:34:20.844711","last_became_peered":"2023-10-18 19:34:20.844711","last_unstale":"2023-10-18 19:34:21.235790","last_undegraded":"2023-10-18 19:34:21.235790","last_fullsized":"2023-10-18 19:34:21.235790","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267224","last_change":"2023-10-18 19:34:21.256370","last_active":"2023-10-18 19:34:21.267224","last_peered":"2023-10-18 19:34:21.267224","last_clean":"2023-10-18 19:34:21.267224","last_became_active":"2023-10-18 19:34:21.256084","last_became_peered":"2023-10-18 19:34:21.256084","last_unstale":"2023-10-18 19:34:21.267224","last_undegraded":"2023-10-18 19:34:21.267224","last_fullsized":"2023-10-18 19:34:21.267224","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261044","last_change":"2023-10-18 19:34:21.253778","last_active":"2023-10-18 19:34:21.261044","last_peered":"2023-10-18 19:34:21.261044","last_clean":"2023-10-18 19:34:21.261044","last_became_active":"2023-10-18 19:34:21.251946","last_became_peered":"2023-10-18 19:34:21.251946","last_unstale":"2023-10-18 19:34:21.261044","last_undegraded":"2023-10-18 19:34:21.261044","last_fullsized":"2023-10-18 19:34:21.261044","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.239348","last_change":"2023-10-18 19:34:20.862585","last_active":"2023-10-18 19:34:21.239348","last_peered":"2023-10-18 19:34:21.239348","last_clean":"2023-10-18 19:34:21.239348","last_became_active":"2023-10-18 19:34:20.862326","last_became_peered":"2023-10-18 19:34:20.862326","last_unstale":"2023-10-18 19:34:21.239348","last_undegraded":"2023-10-18 19:34:21.239348","last_fullsized":"2023-10-18 19:34:21.239348","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264051","last_change":"2023-10-18 19:34:21.259196","last_active":"2023-10-18 19:34:21.264051","last_peered":"2023-10-18 19:34:21.264051","last_clean":"2023-10-18 19:34:21.264051","last_became_active":"2023-10-18 19:34:21.258884","last_became_peered":"2023-10-18 19:34:21.258884","last_unstale":"2023-10-18 19:34:21.264051","last_undegraded":"2023-10-18 19:34:21.264051","last_fullsized":"2023-10-18 19:34:21.264051","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262675","last_change":"2023-10-18 19:34:20.863893","last_active":"2023-10-18 19:34:21.262675","last_peered":"2023-10-18 19:34:21.262675","last_clean":"2023-10-18 19:34:21.262675","last_became_active":"2023-10-18 19:34:20.863549","last_became_peered":"2023-10-18 19:34:20.863549","last_unstale":"2023-10-18 19:34:21.262675","last_undegraded":"2023-10-18 19:34:21.262675","last_fullsized":"2023-10-18 19:34:21.262675","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262881","last_change":"2023-10-18 19:34:21.261264","last_active":"2023-10-18 19:34:21.262881","last_peered":"2023-10-18 19:34:21.262881","last_clean":"2023-10-18 19:34:21.262881","last_became_active":"2023-10-18 19:34:21.260951","last_became_peered":"2023-10-18 19:34:21.260951","last_unstale":"2023-10-18 19:34:21.262881","last_undegraded":"2023-10-18 19:34:21.262881","last_fullsized":"2023-10-18 19:34:21.262881","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261912","last_change":"2023-10-18 19:34:20.853421","last_active":"2023-10-18 19:34:21.261912","last_peered":"2023-10-18 19:34:21.261912","last_clean":"2023-10-18 19:34:21.261912","last_became_active":"2023-10-18 19:34:20.853091","last_became_peered":"2023-10-18 19:34:20.853091","last_unstale":"2023-10-18 19:34:21.261912","last_undegraded":"2023-10-18 19:34:21.261912","last_fullsized":"2023-10-18 19:34:21.261912","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.278815","last_change":"2023-10-18 19:34:21.274214","last_active":"2023-10-18 19:34:21.278815","last_peered":"2023-10-18 19:34:21.278815","last_clean":"2023-10-18 19:34:21.278815","last_became_active":"2023-10-18 19:34:21.273899","last_became_peered":"2023-10-18 19:34:21.273899","last_unstale":"2023-10-18 19:34:21.278815","last_undegraded":"2023-10-18 19:34:21.278815","last_fullsized":"2023-10-18 19:34:21.278815","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271533","last_change":"2023-10-18 19:34:20.860150","last_active":"2023-10-18 19:34:21.271533","last_peered":"2023-10-18 19:34:21.271533","last_clean":"2023-10-18 19:34:21.271533","last_became_active":"2023-10-18 19:34:20.859836","last_became_peered":"2023-10-18 19:34:20.859836","last_unstale":"2023-10-18 19:34:21.271533","last_undegraded":"2023-10-18 19:34:21.271533","last_fullsized":"2023-10-18 19:34:21.271533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267146","last_change":"2023-10-18 19:34:21.260022","last_active":"2023-10-18 19:34:21.267146","last_peered":"2023-10-18 19:34:21.267146","last_clean":"2023-10-18 19:34:21.267146","last_became_active":"2023-10-18 19:34:21.259630","last_became_peered":"2023-10-18 19:34:21.259630","last_unstale":"2023-10-18 19:34:21.267146","last_undegraded":"2023-10-18 19:34:21.267146","last_fullsized":"2023-10-18 19:34:21.267146","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.223404","last_change":"2023-10-18 19:34:20.832124","last_active":"2023-10-18 19:34:21.223404","last_peered":"2023-10-18 19:34:21.223404","last_clean":"2023-10-18 19:34:21.223404","last_became_active":"2023-10-18 19:34:20.831830","last_became_peered":"2023-10-18 19:34:20.831830","last_unstale":"2023-10-18 19:34:21.223404","last_undegraded":"2023-10-18 19:34:21.223404","last_fullsized":"2023-10-18 19:34:21.223404","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271045","last_change":"2023-10-18 19:34:21.263372","last_active":"2023-10-18 19:34:21.271045","last_peered":"2023-10-18 19:34:21.271045","last_clean":"2023-10-18 19:34:21.271045","last_became_active":"2023-10-18 19:34:21.256876","last_became_peered":"2023-10-18 19:34:21.256876","last_unstale":"2023-10-18 19:34:21.271045","last_undegraded":"2023-10-18 19:34:21.271045","last_fullsized":"2023-10-18 19:34:21.271045","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.245344","last_change":"2023-10-18 19:34:20.846546","last_active":"2023-10-18 19:34:21.245344","last_peered":"2023-10-18 19:34:21.245344","last_clean":"2023-10-18 19:34:21.245344","last_became_active":"2023-10-18 19:34:20.846229","last_became_peered":"2023-10-18 19:34:20.846229","last_unstale":"2023-10-18 19:34:21.245344","last_undegraded":"2023-10-18 19:34:21.245344","last_fullsized":"2023-10-18 19:34:21.245344","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254951","last_change":"2023-10-18 19:34:21.248032","last_active":"2023-10-18 19:34:21.254951","last_peered":"2023-10-18 19:34:21.254951","last_clean":"2023-10-18 19:34:21.254951","last_became_active":"2023-10-18 19:34:21.247196","last_became_peered":"2023-10-18 19:34:21.247196","last_unstale":"2023-10-18 19:34:21.254951","last_undegraded":"2023-10-18 19:34:21.254951","last_fullsized":"2023-10-18 19:34:21.254951","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.227234","last_change":"2023-10-18 19:34:20.847408","last_active":"2023-10-18 19:34:21.227234","last_peered":"2023-10-18 19:34:21.227234","last_clean":"2023-10-18 19:34:21.227234","last_became_active":"2023-10-18 19:34:20.847100","last_became_peered":"2023-10-18 19:34:20.847100","last_unstale":"2023-10-18 19:34:21.227234","last_undegraded":"2023-10-18 19:34:21.227234","last_fullsized":"2023-10-18 19:34:21.227234","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260917","last_change":"2023-10-18 19:34:21.256724","last_active":"2023-10-18 19:34:21.260917","last_peered":"2023-10-18 19:34:21.260917","last_clean":"2023-10-18 19:34:21.260917","last_became_active":"2023-10-18 19:34:21.256252","last_became_peered":"2023-10-18 19:34:21.256252","last_unstale":"2023-10-18 19:34:21.260917","last_undegraded":"2023-10-18 19:34:21.260917","last_fullsized":"2023-10-18 19:34:21.260917","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.226417","last_change":"2023-10-18 19:34:20.846959","last_active":"2023-10-18 19:34:21.226417","last_peered":"2023-10-18 19:34:21.226417","last_clean":"2023-10-18 19:34:21.226417","last_became_active":"2023-10-18 19:34:20.846541","last_became_peered":"2023-10-18 19:34:20.846541","last_unstale":"2023-10-18 19:34:21.226417","last_undegraded":"2023-10-18 19:34:21.226417","last_fullsized":"2023-10-18 19:34:21.226417","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258963","last_change":"2023-10-18 19:34:21.251998","last_active":"2023-10-18 19:34:21.258963","last_peered":"2023-10-18 19:34:21.258963","last_clean":"2023-10-18 19:34:21.258963","last_became_active":"2023-10-18 19:34:21.251641","last_became_peered":"2023-10-18 19:34:21.251641","last_unstale":"2023-10-18 19:34:21.258963","last_undegraded":"2023-10-18 19:34:21.258963","last_fullsized":"2023-10-18 19:34:21.258963","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235880","last_change":"2023-10-18 19:34:20.844433","last_active":"2023-10-18 19:34:21.235880","last_peered":"2023-10-18 19:34:21.235880","last_clean":"2023-10-18 19:34:21.235880","last_became_active":"2023-10-18 19:34:20.843767","last_became_peered":"2023-10-18 19:34:20.843767","last_unstale":"2023-10-18 19:34:21.235880","last_undegraded":"2023-10-18 19:34:21.235880","last_fullsized":"2023-10-18 19:34:21.235880","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260971","last_change":"2023-10-18 19:34:21.259590","last_active":"2023-10-18 19:34:21.260971","last_peered":"2023-10-18 19:34:21.260971","last_clean":"2023-10-18 19:34:21.260971","last_became_active":"2023-10-18 19:34:21.257762","last_became_peered":"2023-10-18 19:34:21.257762","last_unstale":"2023-10-18 19:34:21.260971","last_undegraded":"2023-10-18 19:34:21.260971","last_fullsized":"2023-10-18 19:34:21.260971","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.485197","last_change":"2023-10-18 19:34:20.845853","last_active":"2023-10-18 19:34:22.485197","last_peered":"2023-10-18 19:34:22.485197","last_clean":"2023-10-18 19:34:22.485197","last_became_active":"2023-10-18 19:34:20.845487","last_became_peered":"2023-10-18 19:34:20.845487","last_unstale":"2023-10-18 19:34:22.485197","last_undegraded":"2023-10-18 19:34:22.485197","last_fullsized":"2023-10-18 19:34:22.485197","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261328","last_change":"2023-10-18 19:34:21.255163","last_active":"2023-10-18 19:34:21.261328","last_peered":"2023-10-18 19:34:21.261328","last_clean":"2023-10-18 19:34:21.261328","last_became_active":"2023-10-18 19:34:21.252262","last_became_peered":"2023-10-18 19:34:21.252262","last_unstale":"2023-10-18 19:34:21.261328","last_undegraded":"2023-10-18 19:34:21.261328","last_fullsized":"2023-10-18 19:34:21.261328","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.227689","last_change":"2023-10-18 19:34:20.861998","last_active":"2023-10-18 19:34:22.227689","last_peered":"2023-10-18 19:34:22.227689","last_clean":"2023-10-18 19:34:22.227689","last_became_active":"2023-10-18 19:34:20.860333","last_became_peered":"2023-10-18 19:34:20.860333","last_unstale":"2023-10-18 19:34:22.227689","last_undegraded":"2023-10-18 19:34:22.227689","last_fullsized":"2023-10-18 19:34:22.227689","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267358","last_change":"2023-10-18 19:34:21.258083","last_active":"2023-10-18 19:34:21.267358","last_peered":"2023-10-18 19:34:21.267358","last_clean":"2023-10-18 19:34:21.267358","last_became_active":"2023-10-18 19:34:21.257626","last_became_peered":"2023-10-18 19:34:21.257626","last_unstale":"2023-10-18 19:34:21.267358","last_undegraded":"2023-10-18 19:34:21.267358","last_fullsized":"2023-10-18 19:34:21.267358","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244745","last_change":"2023-10-18 19:34:20.855980","last_active":"2023-10-18 19:34:24.244745","last_peered":"2023-10-18 19:34:24.244745","last_clean":"2023-10-18 19:34:24.244745","last_became_active":"2023-10-18 19:34:20.855446","last_became_peered":"2023-10-18 19:34:20.855446","last_unstale":"2023-10-18 19:34:24.244745","last_undegraded":"2023-10-18 19:34:24.244745","last_fullsized":"2023-10-18 19:34:24.244745","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.273477","last_change":"2023-10-18 19:34:21.267157","last_active":"2023-10-18 19:34:21.273477","last_peered":"2023-10-18 19:34:21.273477","last_clean":"2023-10-18 19:34:21.273477","last_became_active":"2023-10-18 19:34:21.266854","last_became_peered":"2023-10-18 19:34:21.266854","last_unstale":"2023-10-18 19:34:21.273477","last_undegraded":"2023-10-18 19:34:21.273477","last_fullsized":"2023-10-18 19:34:21.273477","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.246574","last_change":"2023-10-18 19:34:20.847879","last_active":"2023-10-18 19:34:24.246574","last_peered":"2023-10-18 19:34:24.246574","last_clean":"2023-10-18 19:34:24.246574","last_became_active":"2023-10-18 19:34:20.847368","last_became_peered":"2023-10-18 19:34:20.847368","last_unstale":"2023-10-18 19:34:24.246574","last_undegraded":"2023-10-18 19:34:24.246574","last_fullsized":"2023-10-18 19:34:24.246574","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274767","last_change":"2023-10-18 19:34:21.271229","last_active":"2023-10-18 19:34:21.274767","last_peered":"2023-10-18 19:34:21.274767","last_clean":"2023-10-18 19:34:21.274767","last_became_active":"2023-10-18 19:34:21.270946","last_became_peered":"2023-10-18 19:34:21.270946","last_unstale":"2023-10-18 19:34:21.274767","last_undegraded":"2023-10-18 19:34:21.274767","last_fullsized":"2023-10-18 19:34:21.274767","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237270","last_change":"2023-10-18 19:34:20.857540","last_active":"2023-10-18 19:34:21.237270","last_peered":"2023-10-18 19:34:21.237270","last_clean":"2023-10-18 19:34:21.237270","last_became_active":"2023-10-18 19:34:20.857056","last_became_peered":"2023-10-18 19:34:20.857056","last_unstale":"2023-10-18 19:34:21.237270","last_undegraded":"2023-10-18 19:34:21.237270","last_fullsized":"2023-10-18 19:34:21.237270","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270725","last_change":"2023-10-18 19:34:21.264597","last_active":"2023-10-18 19:34:21.270725","last_peered":"2023-10-18 19:34:21.270725","last_clean":"2023-10-18 19:34:21.270725","last_became_active":"2023-10-18 19:34:21.264304","last_became_peered":"2023-10-18 19:34:21.264304","last_unstale":"2023-10-18 19:34:21.270725","last_undegraded":"2023-10-18 19:34:21.270725","last_fullsized":"2023-10-18 19:34:21.270725","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.483718","last_change":"2023-10-18 19:34:20.830160","last_active":"2023-10-18 19:34:22.483718","last_peered":"2023-10-18 19:34:22.483718","last_clean":"2023-10-18 19:34:22.483718","last_became_active":"2023-10-18 19:34:20.829821","last_became_peered":"2023-10-18 19:34:20.829821","last_unstale":"2023-10-18 19:34:22.483718","last_undegraded":"2023-10-18 19:34:22.483718","last_fullsized":"2023-10-18 19:34:22.483718","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263547","last_change":"2023-10-18 19:34:21.250388","last_active":"2023-10-18 19:34:21.263547","last_peered":"2023-10-18 19:34:21.263547","last_clean":"2023-10-18 19:34:21.263547","last_became_active":"2023-10-18 19:34:21.250098","last_became_peered":"2023-10-18 19:34:21.250098","last_unstale":"2023-10-18 19:34:21.263547","last_undegraded":"2023-10-18 19:34:21.263547","last_fullsized":"2023-10-18 19:34:21.263547","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.246407","last_change":"2023-10-18 19:34:20.857726","last_active":"2023-10-18 19:34:24.246407","last_peered":"2023-10-18 19:34:24.246407","last_clean":"2023-10-18 19:34:24.246407","last_became_active":"2023-10-18 19:34:20.856983","last_became_peered":"2023-10-18 19:34:20.856983","last_unstale":"2023-10-18 19:34:24.246407","last_undegraded":"2023-10-18 19:34:24.246407","last_fullsized":"2023-10-18 19:34:24.246407","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274573","last_change":"2023-10-18 19:34:21.270485","last_active":"2023-10-18 19:34:21.274573","last_peered":"2023-10-18 19:34:21.274573","last_clean":"2023-10-18 19:34:21.274573","last_became_active":"2023-10-18 19:34:21.270140","last_became_peered":"2023-10-18 19:34:21.270140","last_unstale":"2023-10-18 19:34:21.274573","last_undegraded":"2023-10-18 19:34:21.274573","last_fullsized":"2023-10-18 19:34:21.274573","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.242340","last_change":"2023-10-18 19:34:20.847009","last_active":"2023-10-18 19:34:21.242340","last_peered":"2023-10-18 19:34:21.242340","last_clean":"2023-10-18 19:34:21.242340","last_became_active":"2023-10-18 19:34:20.846481","last_became_peered":"2023-10-18 19:34:20.846481","last_unstale":"2023-10-18 19:34:21.242340","last_undegraded":"2023-10-18 19:34:21.242340","last_fullsized":"2023-10-18 19:34:21.242340","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260964","last_change":"2023-10-18 19:34:21.256060","last_active":"2023-10-18 19:34:21.260964","last_peered":"2023-10-18 19:34:21.260964","last_clean":"2023-10-18 19:34:21.260964","last_became_active":"2023-10-18 19:34:21.255703","last_became_peered":"2023-10-18 19:34:21.255703","last_unstale":"2023-10-18 19:34:21.260964","last_undegraded":"2023-10-18 19:34:21.260964","last_fullsized":"2023-10-18 19:34:21.260964","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.274523","last_change":"2023-10-18 19:34:20.849799","last_active":"2023-10-18 19:34:21.274523","last_peered":"2023-10-18 19:34:21.274523","last_clean":"2023-10-18 19:34:21.274523","last_became_active":"2023-10-18 19:34:20.849488","last_became_peered":"2023-10-18 19:34:20.849488","last_unstale":"2023-10-18 19:34:21.274523","last_undegraded":"2023-10-18 19:34:21.274523","last_fullsized":"2023-10-18 19:34:21.274523","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261345","last_change":"2023-10-18 19:34:21.260006","last_active":"2023-10-18 19:34:21.261345","last_peered":"2023-10-18 19:34:21.261345","last_clean":"2023-10-18 19:34:21.261345","last_became_active":"2023-10-18 19:34:21.259689","last_became_peered":"2023-10-18 19:34:21.259689","last_unstale":"2023-10-18 19:34:21.261345","last_undegraded":"2023-10-18 19:34:21.261345","last_fullsized":"2023-10-18 19:34:21.261345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236883","last_change":"2023-10-18 19:34:20.858108","last_active":"2023-10-18 19:34:21.236883","last_peered":"2023-10-18 19:34:21.236883","last_clean":"2023-10-18 19:34:21.236883","last_became_active":"2023-10-18 19:34:20.854784","last_became_peered":"2023-10-18 19:34:20.854784","last_unstale":"2023-10-18 19:34:21.236883","last_undegraded":"2023-10-18 19:34:21.236883","last_fullsized":"2023-10-18 19:34:21.236883","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267335","last_change":"2023-10-18 19:34:21.257919","last_active":"2023-10-18 19:34:21.267335","last_peered":"2023-10-18 19:34:21.267335","last_clean":"2023-10-18 19:34:21.267335","last_became_active":"2023-10-18 19:34:21.257409","last_became_peered":"2023-10-18 19:34:21.257409","last_unstale":"2023-10-18 19:34:21.267335","last_undegraded":"2023-10-18 19:34:21.267335","last_fullsized":"2023-10-18 19:34:21.267335","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.228386","last_change":"2023-10-18 19:34:20.847577","last_active":"2023-10-18 19:34:21.228386","last_peered":"2023-10-18 19:34:21.228386","last_clean":"2023-10-18 19:34:21.228386","last_became_active":"2023-10-18 19:34:20.842013","last_became_peered":"2023-10-18 19:34:20.842013","last_unstale":"2023-10-18 19:34:21.228386","last_undegraded":"2023-10-18 19:34:21.228386","last_fullsized":"2023-10-18 19:34:21.228386","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.258434","last_change":"2023-10-18 19:34:21.251747","last_active":"2023-10-18 19:34:21.258434","last_peered":"2023-10-18 19:34:21.258434","last_clean":"2023-10-18 19:34:21.258434","last_became_active":"2023-10-18 19:34:21.251325","last_became_peered":"2023-10-18 19:34:21.251325","last_unstale":"2023-10-18 19:34:21.258434","last_undegraded":"2023-10-18 19:34:21.258434","last_fullsized":"2023-10-18 19:34:21.258434","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.242972","last_change":"2023-10-18 19:34:20.832572","last_active":"2023-10-18 19:34:24.242972","last_peered":"2023-10-18 19:34:24.242972","last_clean":"2023-10-18 19:34:24.242972","last_became_active":"2023-10-18 19:34:20.832216","last_became_peered":"2023-10-18 19:34:20.832216","last_unstale":"2023-10-18 19:34:24.242972","last_undegraded":"2023-10-18 19:34:24.242972","last_fullsized":"2023-10-18 19:34:24.242972","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276296","last_change":"2023-10-18 19:34:21.272247","last_active":"2023-10-18 19:34:21.276296","last_peered":"2023-10-18 19:34:21.276296","last_clean":"2023-10-18 19:34:21.276296","last_became_active":"2023-10-18 19:34:21.271930","last_became_peered":"2023-10-18 19:34:21.271930","last_unstale":"2023-10-18 19:34:21.276296","last_undegraded":"2023-10-18 19:34:21.276296","last_fullsized":"2023-10-18 19:34:21.276296","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.235502","last_change":"2023-10-18 19:34:20.840841","last_active":"2023-10-18 19:34:21.235502","last_peered":"2023-10-18 19:34:21.235502","last_clean":"2023-10-18 19:34:21.235502","last_became_active":"2023-10-18 19:34:20.840351","last_became_peered":"2023-10-18 19:34:20.840351","last_unstale":"2023-10-18 19:34:21.235502","last_undegraded":"2023-10-18 19:34:21.235502","last_fullsized":"2023-10-18 19:34:21.235502","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262872","last_change":"2023-10-18 19:34:21.258445","last_active":"2023-10-18 19:34:21.262872","last_peered":"2023-10-18 19:34:21.262872","last_clean":"2023-10-18 19:34:21.262872","last_became_active":"2023-10-18 19:34:21.257747","last_became_peered":"2023-10-18 19:34:21.257747","last_unstale":"2023-10-18 19:34:21.262872","last_undegraded":"2023-10-18 19:34:21.262872","last_fullsized":"2023-10-18 19:34:21.262872","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.233329","last_change":"2023-10-18 19:34:20.856638","last_active":"2023-10-18 19:34:21.233329","last_peered":"2023-10-18 19:34:21.233329","last_clean":"2023-10-18 19:34:21.233329","last_became_active":"2023-10-18 19:34:20.856094","last_became_peered":"2023-10-18 19:34:20.856094","last_unstale":"2023-10-18 19:34:21.233329","last_undegraded":"2023-10-18 19:34:21.233329","last_fullsized":"2023-10-18 19:34:21.233329","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254821","last_change":"2023-10-18 19:34:21.249180","last_active":"2023-10-18 19:34:21.254821","last_peered":"2023-10-18 19:34:21.254821","last_clean":"2023-10-18 19:34:21.254821","last_became_active":"2023-10-18 19:34:21.245370","last_became_peered":"2023-10-18 19:34:21.245370","last_unstale":"2023-10-18 19:34:21.254821","last_undegraded":"2023-10-18 19:34:21.254821","last_fullsized":"2023-10-18 19:34:21.254821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.265777","last_change":"2023-10-18 19:34:20.823278","last_active":"2023-10-18 19:34:21.265777","last_peered":"2023-10-18 19:34:21.265777","last_clean":"2023-10-18 19:34:21.265777","last_became_active":"2023-10-18 19:34:20.823003","last_became_peered":"2023-10-18 19:34:20.823003","last_unstale":"2023-10-18 19:34:21.265777","last_undegraded":"2023-10-18 19:34:21.265777","last_fullsized":"2023-10-18 19:34:21.265777","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253391","last_change":"2023-10-18 19:34:21.246335","last_active":"2023-10-18 19:34:21.253391","last_peered":"2023-10-18 19:34:21.253391","last_clean":"2023-10-18 19:34:21.253391","last_became_active":"2023-10-18 19:34:21.246040","last_became_peered":"2023-10-18 19:34:21.246040","last_unstale":"2023-10-18 19:34:21.253391","last_undegraded":"2023-10-18 19:34:21.253391","last_fullsized":"2023-10-18 19:34:21.253391","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.245088","last_change":"2023-10-18 19:34:20.855032","last_active":"2023-10-18 19:34:24.245088","last_peered":"2023-10-18 19:34:24.245088","last_clean":"2023-10-18 19:34:24.245088","last_became_active":"2023-10-18 19:34:20.854673","last_became_peered":"2023-10-18 19:34:20.854673","last_unstale":"2023-10-18 19:34:24.245088","last_undegraded":"2023-10-18 19:34:24.245088","last_fullsized":"2023-10-18 19:34:24.245088","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.259565","last_change":"2023-10-18 19:34:21.254232","last_active":"2023-10-18 19:34:21.259565","last_peered":"2023-10-18 19:34:21.259565","last_clean":"2023-10-18 19:34:21.259565","last_became_active":"2023-10-18 19:34:21.253932","last_became_peered":"2023-10-18 19:34:21.253932","last_unstale":"2023-10-18 19:34:21.259565","last_undegraded":"2023-10-18 19:34:21.259565","last_fullsized":"2023-10-18 19:34:21.259565","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236496","last_change":"2023-10-18 19:34:20.855559","last_active":"2023-10-18 19:34:21.236496","last_peered":"2023-10-18 19:34:21.236496","last_clean":"2023-10-18 19:34:21.236496","last_became_active":"2023-10-18 19:34:20.854845","last_became_peered":"2023-10-18 19:34:20.854845","last_unstale":"2023-10-18 19:34:21.236496","last_undegraded":"2023-10-18 19:34:21.236496","last_fullsized":"2023-10-18 19:34:21.236496","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.262693","last_change":"2023-10-18 19:34:21.248190","last_active":"2023-10-18 19:34:21.262693","last_peered":"2023-10-18 19:34:21.262693","last_clean":"2023-10-18 19:34:21.262693","last_became_active":"2023-10-18 19:34:21.247102","last_became_peered":"2023-10-18 19:34:21.247102","last_unstale":"2023-10-18 19:34:21.262693","last_undegraded":"2023-10-18 19:34:21.262693","last_fullsized":"2023-10-18 19:34:21.262693","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:24.244862","last_change":"2023-10-18 19:34:20.857956","last_active":"2023-10-18 19:34:24.244862","last_peered":"2023-10-18 19:34:24.244862","last_clean":"2023-10-18 19:34:24.244862","last_became_active":"2023-10-18 19:34:20.855051","last_became_peered":"2023-10-18 19:34:20.855051","last_unstale":"2023-10-18 19:34:24.244862","last_undegraded":"2023-10-18 19:34:24.244862","last_fullsized":"2023-10-18 19:34:24.244862","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.270992","last_change":"2023-10-18 19:34:21.266700","last_active":"2023-10-18 19:34:21.270992","last_peered":"2023-10-18 19:34:21.270992","last_clean":"2023-10-18 19:34:21.270992","last_became_active":"2023-10-18 19:34:21.266409","last_became_peered":"2023-10-18 19:34:21.266409","last_unstale":"2023-10-18 19:34:21.270992","last_undegraded":"2023-10-18 19:34:21.270992","last_fullsized":"2023-10-18 19:34:21.270992","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238606","last_change":"2023-10-18 19:34:20.851465","last_active":"2023-10-18 19:34:21.238606","last_peered":"2023-10-18 19:34:21.238606","last_clean":"2023-10-18 19:34:21.238606","last_became_active":"2023-10-18 19:34:20.851166","last_became_peered":"2023-10-18 19:34:20.851166","last_unstale":"2023-10-18 19:34:21.238606","last_undegraded":"2023-10-18 19:34:21.238606","last_fullsized":"2023-10-18 19:34:21.238606","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.253575","last_change":"2023-10-18 19:34:21.245529","last_active":"2023-10-18 19:34:21.253575","last_peered":"2023-10-18 19:34:21.253575","last_clean":"2023-10-18 19:34:21.253575","last_became_active":"2023-10-18 19:34:21.245217","last_became_peered":"2023-10-18 19:34:21.245217","last_unstale":"2023-10-18 19:34:21.253575","last_undegraded":"2023-10-18 19:34:21.253575","last_fullsized":"2023-10-18 19:34:21.253575","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2023-10-18 19:34:22.226961","last_change":"2023-10-18 19:34:20.837517","last_active":"2023-10-18 19:34:22.226961","last_peered":"2023-10-18 19:34:22.226961","last_clean":"2023-10-18 19:34:22.226961","last_became_active":"2023-10-18 19:34:20.837192","last_became_peered":"2023-10-18 19:34:20.837192","last_unstale":"2023-10-18 19:34:22.226961","last_undegraded":"2023-10-18 19:34:22.226961","last_fullsized":"2023-10-18 19:34:22.226961","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.271163","last_change":"2023-10-18 19:34:21.262649","last_active":"2023-10-18 19:34:21.271163","last_peered":"2023-10-18 19:34:21.271163","last_clean":"2023-10-18 19:34:21.271163","last_became_active":"2023-10-18 19:34:21.262175","last_became_peered":"2023-10-18 19:34:21.262175","last_unstale":"2023-10-18 19:34:21.271163","last_undegraded":"2023-10-18 19:34:21.271163","last_fullsized":"2023-10-18 19:34:21.271163","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.237168","last_change":"2023-10-18 19:34:20.821558","last_active":"2023-10-18 19:34:21.237168","last_peered":"2023-10-18 19:34:21.237168","last_clean":"2023-10-18 19:34:21.237168","last_became_active":"2023-10-18 19:34:20.821225","last_became_peered":"2023-10-18 19:34:20.821225","last_unstale":"2023-10-18 19:34:21.237168","last_undegraded":"2023-10-18 19:34:21.237168","last_fullsized":"2023-10-18 19:34:21.237168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272370","last_change":"2023-10-18 19:34:21.268630","last_active":"2023-10-18 19:34:21.272370","last_peered":"2023-10-18 19:34:21.272370","last_clean":"2023-10-18 19:34:21.272370","last_became_active":"2023-10-18 19:34:21.268347","last_became_peered":"2023-10-18 19:34:21.268347","last_unstale":"2023-10-18 19:34:21.272370","last_undegraded":"2023-10-18 19:34:21.272370","last_fullsized":"2023-10-18 19:34:21.272370","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.276681","last_change":"2023-10-18 19:34:20.856427","last_active":"2023-10-18 19:34:21.276681","last_peered":"2023-10-18 19:34:21.276681","last_clean":"2023-10-18 19:34:21.276681","last_became_active":"2023-10-18 19:34:20.855877","last_became_peered":"2023-10-18 19:34:20.855877","last_unstale":"2023-10-18 19:34:21.276681","last_undegraded":"2023-10-18 19:34:21.276681","last_fullsized":"2023-10-18 19:34:21.276681","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.267065","last_change":"2023-10-18 19:34:21.259142","last_active":"2023-10-18 19:34:21.267065","last_peered":"2023-10-18 19:34:21.267065","last_clean":"2023-10-18 19:34:21.267065","last_became_active":"2023-10-18 19:34:21.258709","last_became_peered":"2023-10-18 19:34:21.258709","last_unstale":"2023-10-18 19:34:21.267065","last_undegraded":"2023-10-18 19:34:21.267065","last_fullsized":"2023-10-18 19:34:21.267065","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.260963","last_change":"2023-10-18 19:34:20.861616","last_active":"2023-10-18 19:34:21.260963","last_peered":"2023-10-18 19:34:21.260963","last_clean":"2023-10-18 19:34:21.260963","last_became_active":"2023-10-18 19:34:20.861363","last_became_peered":"2023-10-18 19:34:20.861363","last_unstale":"2023-10-18 19:34:21.260963","last_undegraded":"2023-10-18 19:34:21.260963","last_fullsized":"2023-10-18 19:34:21.260963","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.272280","last_change":"2023-10-18 19:34:21.267981","last_active":"2023-10-18 19:34:21.272280","last_peered":"2023-10-18 19:34:21.272280","last_clean":"2023-10-18 19:34:21.272280","last_became_active":"2023-10-18 19:34:21.267584","last_became_peered":"2023-10-18 19:34:21.267584","last_unstale":"2023-10-18 19:34:21.272280","last_undegraded":"2023-10-18 19:34:21.272280","last_fullsized":"2023-10-18 19:34:21.272280","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.261640","last_change":"2023-10-18 19:34:20.855045","last_active":"2023-10-18 19:34:21.261640","last_peered":"2023-10-18 19:34:21.261640","last_clean":"2023-10-18 19:34:21.261640","last_became_active":"2023-10-18 19:34:20.854724","last_became_peered":"2023-10-18 19:34:20.854724","last_unstale":"2023-10-18 19:34:21.261640","last_undegraded":"2023-10-18 19:34:21.261640","last_fullsized":"2023-10-18 19:34:21.261640","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.269720","last_change":"2023-10-18 19:34:21.262741","last_active":"2023-10-18 19:34:21.269720","last_peered":"2023-10-18 19:34:21.269720","last_clean":"2023-10-18 19:34:21.269720","last_became_active":"2023-10-18 19:34:21.262435","last_became_peered":"2023-10-18 19:34:21.262435","last_unstale":"2023-10-18 19:34:21.269720","last_undegraded":"2023-10-18 19:34:21.269720","last_fullsized":"2023-10-18 19:34:21.269720","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.236324","last_change":"2023-10-18 19:34:20.850195","last_active":"2023-10-18 19:34:21.236324","last_peered":"2023-10-18 19:34:21.236324","last_clean":"2023-10-18 19:34:21.236324","last_became_active":"2023-10-18 19:34:20.849885","last_became_peered":"2023-10-18 19:34:20.849885","last_unstale":"2023-10-18 19:34:21.236324","last_undegraded":"2023-10-18 19:34:21.236324","last_fullsized":"2023-10-18 19:34:21.236324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.254998","last_change":"2023-10-18 19:34:21.248730","last_active":"2023-10-18 19:34:21.254998","last_peered":"2023-10-18 19:34:21.254998","last_clean":"2023-10-18 19:34:21.254998","last_became_active":"2023-10-18 19:34:21.248420","last_became_peered":"2023-10-18 19:34:21.248420","last_unstale":"2023-10-18 19:34:21.254998","last_undegraded":"2023-10-18 19:34:21.254998","last_fullsized":"2023-10-18 19:34:21.254998","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.238187","last_change":"2023-10-18 19:34:20.862008","last_active":"2023-10-18 19:34:21.238187","last_peered":"2023-10-18 19:34:21.238187","last_clean":"2023-10-18 19:34:21.238187","last_became_active":"2023-10-18 19:34:20.858973","last_became_peered":"2023-10-18 19:34:20.858973","last_unstale":"2023-10-18 19:34:21.238187","last_undegraded":"2023-10-18 19:34:21.238187","last_fullsized":"2023-10-18 19:34:21.238187","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.264920","last_change":"2023-10-18 19:34:21.259920","last_active":"2023-10-18 19:34:21.264920","last_peered":"2023-10-18 19:34:21.264920","last_clean":"2023-10-18 19:34:21.264920","last_became_active":"2023-10-18 19:34:21.259474","last_became_peered":"2023-10-18 19:34:21.259474","last_unstale":"2023-10-18 19:34:21.264920","last_undegraded":"2023-10-18 19:34:21.264920","last_fullsized":"2023-10-18 19:34:21.264920","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:20.796218","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:20.796218","last_clean_scrub_stamp":"2023-10-18 19:34:20.796218","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2023-10-18 19:34:21.263166","last_change":"2023-10-18 19:34:20.842664","last_active":"2023-10-18 19:34:21.263166","last_peered":"2023-10-18 19:34:21.263166","last_clean":"2023-10-18 19:34:21.263166","last_became_active":"2023-10-18 19:34:20.842341","last_became_peered":"2023-10-18 19:34:20.842341","last_unstale":"2023-10-18 19:34:21.263166","last_undegraded":"2023-10-18 19:34:21.263166","last_fullsized":"2023-10-18 19:34:21.263166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18 19:34:19.786275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18 19:34:19.786275","last_clean_scrub_stamp":"2023-10-18 19:34:19.786275","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":42919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":42259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]}]}} 2023-10-18T19:34:32.382 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T19:34:32.382 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T19:34:32.383 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T19:34:32.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:34:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.612 7f33cc7ff700 1 Processor -- start 2023-10-18T19:34:32.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.612 7f33cc7ff700 1 -- start start 2023-10-18T19:34:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 0x7f33c40f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c41b2790 0x7f33c41b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c40f8b90 con 0x7f33c40f7e90 2023-10-18T19:34:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4118170 con 0x7f33c41b2790 2023-10-18T19:34:32.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33cc7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33c410ce90 con 0x7f33c40f82e0 2023-10-18T19:34:32.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33c3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33c8dfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 0x7f33c40f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33c95ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c41b2790 0x7f33c41b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33c3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43018/0 (socket says 172.21.15.88:43018) 2023-10-18T19:34:32.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.613 7f33c3fff700 1 -- 172.21.15.88:0/3299739151 learned_addr learned my addr 172.21.15.88:0/3299739151 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 -- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c41b2790 msgr2=0x7f33c41b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 --2- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c41b2790 0x7f33c41b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 -- 172.21.15.88:0/3299739151 >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 msgr2=0x7f33c40f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 --2- 172.21.15.88:0/3299739151 >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 0x7f33c40f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 -- 172.21.15.88:0/3299739151 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40f1ec0 con 0x7f33c40f82e0 2023-10-18T19:34:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c8dfe700 1 --2- 172.21.15.88:0/3299739151 >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 0x7f33c40f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:32.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c3fff700 1 --2- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f33c40f8b10 tx=0x7f33b0009a30).ready entity=mon.2 client_cookie=380d914ea5482aa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c37fe700 1 -- 172.21.15.88:0/3299739151 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33c40f1ec0 con 0x7f33c40f82e0 2023-10-18T19:34:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c37fe700 1 -- 172.21.15.88:0/3299739151 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000f510 con 0x7f33c40f82e0 2023-10-18T19:34:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33c37fe700 1 -- 172.21.15.88:0/3299739151 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b000f6f0 con 0x7f33c40f82e0 2023-10-18T19:34:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33cc7ff700 1 -- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 msgr2=0x7f33c40f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.614 7f33cc7ff700 1 --2- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f33c40f8b10 tx=0x7f33b0009a30).stop 2023-10-18T19:34:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 -- 172.21.15.88:0/3299739151 shutdown_connections 2023-10-18T19:34:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 --2- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c41b2790 0x7f33c41b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 --2- 172.21.15.88:0/3299739151 >> v2:172.21.15.88:3300/0 conn(0x7f33c40f7e90 0x7f33c40f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 --2- 172.21.15.88:0/3299739151 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f82e0 0x7f33c40f1280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 -- 172.21.15.88:0/3299739151 >> 172.21.15.88:0/3299739151 conn(0x7f33c4125ae0 msgr2=0x7f33c4125f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 -- 172.21.15.88:0/3299739151 shutdown_connections 2023-10-18T19:34:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.615 7f33cc7ff700 1 -- 172.21.15.88:0/3299739151 wait complete. 2023-10-18T19:34:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.639 7f33cc7ff700 1 Processor -- start 2023-10-18T19:34:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.640 7f33cc7ff700 1 -- start start 2023-10-18T19:34:32.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.640 7f33cc7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.640 7f33cc7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c40ce530 0x7f33c40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33cc7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33c41c5720 0x7f33c41c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33cc7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40d5620 con 0x7f33c41c5720 2023-10-18T19:34:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33cc7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40cefb0 con 0x7f33c40ce530 2023-10-18T19:34:32.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33cc7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40d5960 con 0x7f33c40f4360 2023-10-18T19:34:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43024/0 (socket says 172.21.15.88:43024) 2023-10-18T19:34:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 -- 172.21.15.88:0/2852930126 learned_addr learned my addr 172.21.15.88:0/2852930126 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c3fff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c40ce530 0x7f33c40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c95ff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33c41c5720 0x7f33c41c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 -- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c40ce530 msgr2=0x7f33c40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c40ce530 0x7f33c40ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 -- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33c41c5720 msgr2=0x7f33c41c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33c41c5720 0x7f33c41c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 -- 172.21.15.88:0/2852930126 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c41c3380 con 0x7f33c40f4360 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.641 7f33c8dfe700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f33b800c000 tx=0x7f33b800ec50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b800f040 con 0x7f33c40f4360 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800c9c0 con 0x7f33c40f4360 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f33b800cd90 con 0x7f33c40f4360 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c41b81e0 con 0x7f33c40f4360 2023-10-18T19:34:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c41b8550 con 0x7f33c40f4360 2023-10-18T19:34:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.642 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f33b8011070 con 0x7f33c40f4360 2023-10-18T19:34:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.643 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f33b8010040 con 0x7f33c40f4360 2023-10-18T19:34:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.643 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c40f0530 con 0x7f33c40f4360 2023-10-18T19:34:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.646 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f33b800c5c0 con 0x7f33c40f4360 2023-10-18T19:34:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.767 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f33c40a8370 con 0x7f33c40f4360 2023-10-18T19:34:32.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.768 7f33c1ffb700 1 -- 172.21.15.88:0/2852930126 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+34 (secure 0 0 0) 0x7f33b8000c30 con 0x7f33c40f4360 2023-10-18T19:34:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 >> v1:172.21.15.88:6800/107321 conn(0x7f33ac01c1b0 legacy=0x7f33ac01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 msgr2=0x7f33c41b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f33b800c000 tx=0x7f33b800ec50).stop 2023-10-18T19:34:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 shutdown_connections 2023-10-18T19:34:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33c41c5720 0x7f33c41c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f33c40f4360 0x7f33c41b7bb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 --2- 172.21.15.88:0/2852930126 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f33c40ce530 0x7f33c40ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.769 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 >> 172.21.15.88:0/2852930126 conn(0x7f33c40bde70 msgr2=0x7f33c40bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.770 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 shutdown_connections 2023-10-18T19:34:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.770 7f33cc7ff700 1 -- 172.21.15.88:0/2852930126 wait complete. 2023-10-18T19:34:32.787 INFO:teuthology.orchestra.run.smithi088.stdout:{"checks":{},"status":"HEALTH_OK"} 2023-10-18T19:34:32.788 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-18T19:34:32.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:32.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.985 7f19f01ff700 1 Processor -- start 2023-10-18T19:34:32.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.985 7f19f01ff700 1 -- start start 2023-10-18T19:34:32.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.985 7f19f01ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 0x7f19e80f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.985 7f19f01ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e80f1f60 0x7f19e81b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:32.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19f01ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80f23b0 con 0x7f19e810ccc0 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19f01ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8111f40 con 0x7f19e80f14e0 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19f01ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e8111850 con 0x7f19e80f1f60 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 0x7f19e80f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f19e810ccc0 0x7f19e80f6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52128/0 (socket says 172.21.15.88:52128) 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e7fff700 1 -- 172.21.15.88:0/3617065191 learned_addr learned my addr 172.21.15.88:0/3617065191 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:32.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19ecfff700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e80f1f60 0x7f19e81b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:32.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 -- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e80f1f60 msgr2=0x7f19e81b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:32.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e80f1f60 0x7f19e81b9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 -- 172.21.15.88:0/3617065191 >> v1:172.21.15.88:6789/0 conn(0x7f19e810ccc0 legacy=0x7f19e80f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 -- 172.21.15.88:0/3617065191 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e810d6f0 con 0x7f19e80f14e0 2023-10-18T19:34:32.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e6ffd700 1 -- 172.21.15.88:0/3617065191 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938911334 0 0) 0x7f19d8001110 con 0x7f19e810ccc0 2023-10-18T19:34:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.986 7f19e77fe700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 0x7f19e80f1930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f19dc002f70 tx=0x7f19dc00ba20).ready entity=mon.1 client_cookie=1bd04b2520aa4786 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19e6ffd700 1 -- 172.21.15.88:0/3617065191 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19e810d6f0 con 0x7f19e80f14e0 2023-10-18T19:34:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19e6ffd700 1 -- 172.21.15.88:0/3617065191 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00d570 con 0x7f19e80f14e0 2023-10-18T19:34:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19e6ffd700 1 -- 172.21.15.88:0/3617065191 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19dc00d940 con 0x7f19e80f14e0 2023-10-18T19:34:32.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 -- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 msgr2=0x7f19e80f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 0x7f19e80f1930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f19dc002f70 tx=0x7f19dc00ba20).stop 2023-10-18T19:34:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 -- 172.21.15.88:0/3617065191 shutdown_connections 2023-10-18T19:34:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e80f1f60 0x7f19e81b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 --2- 172.21.15.88:0/3617065191 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80f14e0 0x7f19e80f1930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:32.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 -- 172.21.15.88:0/3617065191 >> 172.21.15.88:0/3617065191 conn(0x7f19e8117390 msgr2=0x7f19e80f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:32.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 -- 172.21.15.88:0/3617065191 shutdown_connections 2023-10-18T19:34:32.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:32.987 7f19f01ff700 1 -- 172.21.15.88:0/3617065191 wait complete. 2023-10-18T19:34:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.012 7f19f01ff700 1 Processor -- start 2023-10-18T19:34:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.012 7f19f01ff700 1 -- start start 2023-10-18T19:34:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 0x7f19e81c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 0x7f19e81c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 0x7f19e80b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80de8f0 con 0x7f19e80d5820 2023-10-18T19:34:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80bd2c0 con 0x7f19e80b7e60 2023-10-18T19:34:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19f01ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80bd600 con 0x7f19e81c4170 2023-10-18T19:34:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 0x7f19e81c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 0x7f19e81c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 0x7f19e81c3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37478/0 (socket says 172.21.15.88:37478) 2023-10-18T19:34:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e7fff700 1 -- 172.21.15.88:0/1625123593 learned_addr learned my addr 172.21.15.88:0/1625123593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19ecfff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 0x7f19e80b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 -- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 msgr2=0x7f19e80b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 0x7f19e80b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 -- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 msgr2=0x7f19e81c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 0x7f19e81c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19e77fe700 1 -- 172.21.15.88:0/1625123593 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80bdaa0 con 0x7f19e81c4170 2023-10-18T19:34:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.013 7f19ecfff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 0x7f19e80b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19e77fe700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 0x7f19e81c45c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f19e80bda40 tx=0x7f19dc0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:33.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19e80bdaa0 con 0x7f19e81c4170 2023-10-18T19:34:33.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00d9a0 con 0x7f19e81c4170 2023-10-18T19:34:33.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80d6060 con 0x7f19e81c4170 2023-10-18T19:34:33.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f19dc022070 con 0x7f19e81c4170 2023-10-18T19:34:33.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.014 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80d5c70 con 0x7f19e81c4170 2023-10-18T19:34:33.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.015 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f19dc01ca10 con 0x7f19e81c4170 2023-10-18T19:34:33.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.015 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f19dc006430 con 0x7f19e81c4170 2023-10-18T19:34:33.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.015 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e80b79c0 con 0x7f19e81c4170 2023-10-18T19:34:33.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.018 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f19dc00d360 con 0x7f19e81c4170 2023-10-18T19:34:33.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.116 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19e80f0530 con 0x7f19e81c4170 2023-10-18T19:34:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.117 7f19e57fa700 1 -- 172.21.15.88:0/1625123593 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f19dc0362a0 con 0x7f19e81c4170 2023-10-18T19:34:33.120 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:33.120 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.118 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 >> v1:172.21.15.88:6800/107321 conn(0x7f19c801c1b0 legacy=0x7f19c801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 msgr2=0x7f19e81c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 0x7f19e81c45c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f19e80bda40 tx=0x7f19dc0068c0).stop 2023-10-18T19:34:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 shutdown_connections 2023-10-18T19:34:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19e80b7e60 0x7f19e80b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19e80d5820 0x7f19e81c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 --2- 172.21.15.88:0/1625123593 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f19e81c4170 0x7f19e81c45c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 >> 172.21.15.88:0/1625123593 conn(0x7f19e80ab3b0 msgr2=0x7f19e8120d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:33.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 shutdown_connections 2023-10-18T19:34:33.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.119 7f19f01ff700 1 -- 172.21.15.88:0/1625123593 wait complete. 2023-10-18T19:34:33.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18 19:34:09.738627', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18 19:34:18.877868', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18 19:34:20.222147', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T19:34:33.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:34:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 Processor -- start 2023-10-18T19:34:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 -- start start 2023-10-18T19:34:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424c0f6910 0x7f424c0f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 0x7f424c1ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424c0a7490 con 0x7f424c0f6d60 2023-10-18T19:34:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424c0f2640 con 0x7f424c0f6910 2023-10-18T19:34:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.341 7f4252dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424c1121c0 con 0x7f424c1b7d60 2023-10-18T19:34:33.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424c0f6910 0x7f424c0f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424c0f6910 0x7f424c0f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37488/0 (socket says 172.21.15.88:37488) 2023-10-18T19:34:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 -- 172.21.15.88:0/3124192781 learned_addr learned my addr 172.21.15.88:0/3124192781 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424a7fd700 1 --1- 172.21.15.88:0/3124192781 >> v1:172.21.15.88:6789/0 conn(0x7f424c0f6d60 0x7f424c0f1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52138/0 (socket says 172.21.15.88:52138) 2023-10-18T19:34:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424b7ff700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 0x7f424c1ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 -- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 msgr2=0x7f424c1ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 0x7f424c1ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 -- 172.21.15.88:0/3124192781 >> v1:172.21.15.88:6789/0 conn(0x7f424c0f6d60 legacy=0x7f424c0f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 -- 172.21.15.88:0/3124192781 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c10d0a0 con 0x7f424c0f6910 2023-10-18T19:34:33.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424b7ff700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 0x7f424c1ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:34:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f4249ffc700 1 -- 172.21.15.88:0/3124192781 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009697858 0 0) 0x7f4240001110 con 0x7f424c0f6d60 2023-10-18T19:34:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f424affe700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c0f6910 0x7f424c0f1810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f424c111ca0 tx=0x7f423c009a80).ready entity=mon.0 client_cookie=4ef04f444a084edf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.342 7f4249ffc700 1 -- 172.21.15.88:0/3124192781 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f424c10d0a0 con 0x7f424c0f6910 2023-10-18T19:34:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4249ffc700 1 -- 172.21.15.88:0/3124192781 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00f510 con 0x7f424c0f6910 2023-10-18T19:34:33.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4249ffc700 1 -- 172.21.15.88:0/3124192781 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c00f6f0 con 0x7f424c0f6910 2023-10-18T19:34:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 -- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c0f6910 msgr2=0x7f424c0f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c0f6910 0x7f424c0f1810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f424c111ca0 tx=0x7f423c009a80).stop 2023-10-18T19:34:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 -- 172.21.15.88:0/3124192781 shutdown_connections 2023-10-18T19:34:33.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1b7d60 0x7f424c1ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 --2- 172.21.15.88:0/3124192781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c0f6910 0x7f424c0f1810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 -- 172.21.15.88:0/3124192781 >> 172.21.15.88:0/3124192781 conn(0x7f424c1176c0 msgr2=0x7f424c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 -- 172.21.15.88:0/3124192781 shutdown_connections 2023-10-18T19:34:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.343 7f4252dff700 1 -- 172.21.15.88:0/3124192781 wait complete. 2023-10-18T19:34:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 Processor -- start 2023-10-18T19:34:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 -- start start 2023-10-18T19:34:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 0x7f424c1b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f424c1c6780 0x7f424c1b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c1b3b30 con 0x7f424c1b47f0 2023-10-18T19:34:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0b6e20 con 0x7f424c1c6780 2023-10-18T19:34:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.368 7f4252dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424c1b4350 con 0x7f424c1c6330 2023-10-18T19:34:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424a7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 0x7f424c1b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37490/0 (socket says 172.21.15.88:37490) 2023-10-18T19:34:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 -- 172.21.15.88:0/1235325667 learned_addr learned my addr 172.21.15.88:0/1235325667 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424b7ff700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f424c1c6780 0x7f424c1b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 -- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 msgr2=0x7f424c1b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 0x7f424c1b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 -- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f424c1c6780 msgr2=0x7f424c1b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f424c1c6780 0x7f424c1b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 -- 172.21.15.88:0/1235325667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0b7850 con 0x7f424c1b47f0 2023-10-18T19:34:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424a7fd700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 0x7f424c1b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f424affe700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f423c0030b0 tx=0x7f423c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.369 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c011690 con 0x7f424c1b47f0 2023-10-18T19:34:33.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.370 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c011890 con 0x7f424c1b47f0 2023-10-18T19:34:33.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.370 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f423c011c60 con 0x7f424c1b47f0 2023-10-18T19:34:33.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.370 7f4252dff700 1 -- 172.21.15.88:0/1235325667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424c1b50e0 con 0x7f424c1b47f0 2023-10-18T19:34:33.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.370 7f4252dff700 1 -- 172.21.15.88:0/1235325667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424c0b6a60 con 0x7f424c1b47f0 2023-10-18T19:34:33.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.370 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f423c019030 con 0x7f424c1b47f0 2023-10-18T19:34:33.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.371 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f423c018040 con 0x7f424c1b47f0 2023-10-18T19:34:33.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.371 7f4252dff700 1 -- 172.21.15.88:0/1235325667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424c0f0860 con 0x7f424c1b47f0 2023-10-18T19:34:33.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.374 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f423c00f300 con 0x7f424c1b47f0 2023-10-18T19:34:33.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.470 7f4252dff700 1 -- 172.21.15.88:0/1235325667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f424c0e2350 con 0x7f424c1b47f0 2023-10-18T19:34:33.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.471 7f423bfff700 1 -- 172.21.15.88:0/1235325667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f423c011480 con 0x7f424c1b47f0 2023-10-18T19:34:33.474 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:34:33.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 >> v1:172.21.15.88:6800/107321 conn(0x7f422801c1b0 legacy=0x7f422801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 msgr2=0x7f424c1c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f423c0030b0 tx=0x7f423c0068c0).stop 2023-10-18T19:34:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 shutdown_connections 2023-10-18T19:34:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f424c1c6780 0x7f424c1b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424c1b47f0 0x7f424c1c5d00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 --2- 172.21.15.88:0/1235325667 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f424c1c6330 0x7f424c1b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 >> 172.21.15.88:0/1235325667 conn(0x7f424c121fc0 msgr2=0x7f424c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 shutdown_connections 2023-10-18T19:34:33.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.472 7f4252dff700 1 -- 172.21.15.88:0/1235325667 wait complete. 2023-10-18T19:34:33.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T19:34:33.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.691 7f6e9319d700 1 Processor -- start 2023-10-18T19:34:33.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.691 7f6e9319d700 1 -- start start 2023-10-18T19:34:33.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e9319d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e9319d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 0x7f6e8c1b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e9319d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c10d560 con 0x7f6e8c10cb30 2023-10-18T19:34:33.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e9319d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f8a30 con 0x7f6e8c1b7570 2023-10-18T19:34:33.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e9319d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f1cb0 con 0x7f6e8c1b4ae0 2023-10-18T19:34:33.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e911ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 0x7f6e8c1b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e8bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e909fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6e8c10cb30 0x7f6e8c0f7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52144/0 (socket says 172.21.15.88:52144) 2023-10-18T19:34:33.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e911ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 0x7f6e8c1b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37492/0 (socket says 172.21.15.88:37492) 2023-10-18T19:34:33.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e909fe700 1 -- 172.21.15.88:0/4058927732 learned_addr learned my addr 172.21.15.88:0/4058927732 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:33.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e8bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44576/0 (socket says 172.21.15.88:44576) 2023-10-18T19:34:33.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.692 7f6e8b7fe700 1 -- 172.21.15.88:0/4058927732 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781808614 0 0) 0x7f6e80001110 con 0x7f6e8c10cb30 2023-10-18T19:34:33.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8bfff700 1 -- 172.21.15.88:0/4058927732 >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 msgr2=0x7f6e8c1b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:33.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8bfff700 1 --2- 172.21.15.88:0/4058927732 >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 0x7f6e8c1b99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8bfff700 1 -- 172.21.15.88:0/4058927732 >> v1:172.21.15.88:6789/0 conn(0x7f6e8c10cb30 legacy=0x7f6e8c0f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8bfff700 1 -- 172.21.15.88:0/4058927732 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c1bb010 con 0x7f6e8c1b4ae0 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8bfff700 1 --2- 172.21.15.88:0/4058927732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6e78002f70 tx=0x7f6e7800b970).ready entity=mon.1 client_cookie=d68a1606ad335f94 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8b7fe700 1 -- 172.21.15.88:0/4058927732 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e8c1bb010 con 0x7f6e8c1b4ae0 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8b7fe700 1 -- 172.21.15.88:0/4058927732 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800d610 con 0x7f6e8c1b4ae0 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e8b7fe700 1 -- 172.21.15.88:0/4058927732 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e7800d9e0 con 0x7f6e8c1b4ae0 2023-10-18T19:34:33.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e9319d700 1 -- 172.21.15.88:0/4058927732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 msgr2=0x7f6e8c1b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.693 7f6e9319d700 1 --2- 172.21.15.88:0/4058927732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6e78002f70 tx=0x7f6e7800b970).stop 2023-10-18T19:34:33.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 -- 172.21.15.88:0/4058927732 shutdown_connections 2023-10-18T19:34:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 --2- 172.21.15.88:0/4058927732 >> v2:172.21.15.88:3300/0 conn(0x7f6e8c1b7570 0x7f6e8c1b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 --2- 172.21.15.88:0/4058927732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b4ae0 0x7f6e8c1b6f40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 -- 172.21.15.88:0/4058927732 >> 172.21.15.88:0/4058927732 conn(0x7f6e8c1258d0 msgr2=0x7f6e8c125d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 -- 172.21.15.88:0/4058927732 shutdown_connections 2023-10-18T19:34:33.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.694 7f6e9319d700 1 -- 172.21.15.88:0/4058927732 wait complete. 2023-10-18T19:34:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.718 7f6e9319d700 1 Processor -- start 2023-10-18T19:34:33.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 -- start start 2023-10-18T19:34:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 0x7f6e8c0dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 0x7f6e8c1c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:33.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f3760 con 0x7f6e8c0dc7d0 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f3aa0 con 0x7f6e8c1b7620 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e9319d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0f4290 con 0x7f6e8c0dc380 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e909fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 0x7f6e8c0dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.719 7f6e8bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e8bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43076/0 (socket says 172.21.15.88:43076) 2023-10-18T19:34:33.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e8bfff700 1 -- 172.21.15.88:0/843009607 learned_addr learned my addr 172.21.15.88:0/843009607 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e911ff700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 0x7f6e8c1c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 -- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 msgr2=0x7f6e8c1c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 -- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 msgr2=0x7f6e8c1c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 0x7f6e8c1c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 -- 172.21.15.88:0/843009607 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c1c3950 con 0x7f6e8c1b7620 2023-10-18T19:34:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e911ff700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 0x7f6e8c1c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e8bfff700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e909fe700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 0x7f6e8c0dbd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6e8c1b6610 tx=0x7f6e8000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e8c1c3950 con 0x7f6e8c1b7620 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e800070d0 con 0x7f6e8c1b7620 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e9319d700 1 -- 172.21.15.88:0/843009607 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c1c0390 con 0x7f6e8c1b7620 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.720 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e80005620 con 0x7f6e8c1b7620 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.721 7f6e9319d700 1 -- 172.21.15.88:0/843009607 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c1c6990 con 0x7f6e8c1b7620 2023-10-18T19:34:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.721 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6e80005820 con 0x7f6e8c1b7620 2023-10-18T19:34:33.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.721 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6e800290d0 con 0x7f6e8c1b7620 2023-10-18T19:34:33.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.722 7f6e9319d700 1 -- 172.21.15.88:0/843009607 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c0f0320 con 0x7f6e8c1b7620 2023-10-18T19:34:33.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.725 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6e8000cdd0 con 0x7f6e8c1b7620 2023-10-18T19:34:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.821 7f6e9319d700 1 -- 172.21.15.88:0/843009607 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e8c1c6fd0 con 0x7f6e8c1b7620 2023-10-18T19:34:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.822 7f6e89ffb700 1 -- 172.21.15.88:0/843009607 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e80000c30 con 0x7f6e8c1b7620 2023-10-18T19:34:33.825 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:33.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 -- 172.21.15.88:0/843009607 >> v1:172.21.15.88:6800/107321 conn(0x7f6e7401c1b0 legacy=0x7f6e7401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 -- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 msgr2=0x7f6e8c0dbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 0x7f6e8c0dbd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6e8c1b6610 tx=0x7f6e8000c860).stop 2023-10-18T19:34:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 -- 172.21.15.88:0/843009607 shutdown_connections 2023-10-18T19:34:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e8c0dc7d0 0x7f6e8c1c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e8c1b7620 0x7f6e8c0dbd50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.823 7f6e9319d700 1 --2- 172.21.15.88:0/843009607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e8c0dc380 0x7f6e8c1c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.824 7f6e9319d700 1 -- 172.21.15.88:0/843009607 >> 172.21.15.88:0/843009607 conn(0x7f6e8c0d2060 msgr2=0x7f6e8c0de690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.824 7f6e9319d700 1 -- 172.21.15.88:0/843009607 shutdown_connections 2023-10-18T19:34:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:33.824 7f6e9319d700 1 -- 172.21.15.88:0/843009607 wait complete. 2023-10-18T19:34:33.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T19:34:34.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.043 7f7aba1ff700 1 Processor -- start 2023-10-18T19:34:34.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.043 7f7aba1ff700 1 -- start start 2023-10-18T19:34:34.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.043 7f7aba1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7aba1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ab41b7e00 0x7f7ab41ba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7aba1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40abc70 con 0x7f7ab41b2ab0 2023-10-18T19:34:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7aba1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab4112280 con 0x7f7ab41b7e00 2023-10-18T19:34:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7aba1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40f6d70 con 0x7f7ab410d000 2023-10-18T19:34:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab23fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab23fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43078/0 (socket says 172.21.15.88:43078) 2023-10-18T19:34:34.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab23fe700 1 -- 172.21.15.88:0/682828511 learned_addr learned my addr 172.21.15.88:0/682828511 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab2bff700 1 --2- 172.21.15.88:0/682828511 >> v2:172.21.15.88:3300/0 conn(0x7f7ab41b7e00 0x7f7ab41ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab2bff700 1 -- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 msgr2=0x7f7ab40f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:34.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab2bff700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab2bff700 1 -- 172.21.15.88:0/682828511 >> v1:172.21.15.88:6789/0 conn(0x7f7ab41b2ab0 legacy=0x7f7ab41b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab2bff700 1 -- 172.21.15.88:0/682828511 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4111b90 con 0x7f7ab41b7e00 2023-10-18T19:34:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab23fe700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.044 7f7ab13fc700 1 -- 172.21.15.88:0/682828511 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285810725 0 0) 0x7f7aa8001110 con 0x7f7ab41b2ab0 2023-10-18T19:34:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7ab2bff700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab41b7e00 0x7f7ab41ba260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7ab4112430 tx=0x7f7aac009d40).ready entity=mon.0 client_cookie=fb27d8447d33650f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7ab13fc700 1 -- 172.21.15.88:0/682828511 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7ab4111b90 con 0x7f7ab41b7e00 2023-10-18T19:34:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7ab13fc700 1 -- 172.21.15.88:0/682828511 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00b7c0 con 0x7f7ab41b7e00 2023-10-18T19:34:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7ab13fc700 1 -- 172.21.15.88:0/682828511 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7aac00b9a0 con 0x7f7ab41b7e00 2023-10-18T19:34:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 -- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab41b7e00 msgr2=0x7f7ab41ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab41b7e00 0x7f7ab41ba260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f7ab4112430 tx=0x7f7aac009d40).stop 2023-10-18T19:34:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 -- 172.21.15.88:0/682828511 shutdown_connections 2023-10-18T19:34:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab41b7e00 0x7f7ab41ba260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 --2- 172.21.15.88:0/682828511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab410d000 0x7f7ab40f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.045 7f7aba1ff700 1 -- 172.21.15.88:0/682828511 >> 172.21.15.88:0/682828511 conn(0x7f7ab41176d0 msgr2=0x7f7ab40f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.046 7f7aba1ff700 1 -- 172.21.15.88:0/682828511 shutdown_connections 2023-10-18T19:34:34.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.046 7f7aba1ff700 1 -- 172.21.15.88:0/682828511 wait complete. 2023-10-18T19:34:34.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.070 7f7aba1ff700 1 Processor -- start 2023-10-18T19:34:34.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.070 7f7aba1ff700 1 -- start start 2023-10-18T19:34:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 0x7f7ab40ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40bc8d0 0x7f7ab40bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ac970 con 0x7f7ab40bc8d0 2023-10-18T19:34:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40abe90 con 0x7f7ab40e0110 2023-10-18T19:34:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7aba1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ac630 con 0x7f7ab40ace10 2023-10-18T19:34:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab23fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 0x7f7ab40ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab23fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44596/0 (socket says 172.21.15.88:44596) 2023-10-18T19:34:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab23fe700 1 -- 172.21.15.88:0/3750475495 learned_addr learned my addr 172.21.15.88:0/3750475495 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab2bff700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40bc8d0 0x7f7ab40bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 -- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 msgr2=0x7f7ab40e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 -- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40bc8d0 msgr2=0x7f7ab40bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40bc8d0 0x7f7ab40bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab1bfd700 1 -- 172.21.15.88:0/3750475495 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40ac0e0 con 0x7f7ab40ace10 2023-10-18T19:34:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.071 7f7ab23fe700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7ab1bfd700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 0x7f7ab40ad260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7ab40cda40 tx=0x7f7aa800c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7aa8007030 con 0x7f7ab40ace10 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8007230 con 0x7f7ab40ace10 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7aa8006710 con 0x7f7ab40ace10 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab40ce3b0 con 0x7f7ab40ace10 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.072 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40bd350 con 0x7f7ab40ace10 2023-10-18T19:34:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.073 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f7aa801a020 con 0x7f7ab40ace10 2023-10-18T19:34:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.073 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f7aa8029960 con 0x7f7ab40ace10 2023-10-18T19:34:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.073 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40f0870 con 0x7f7ab40ace10 2023-10-18T19:34:34.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.076 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f7aa8007dd0 con 0x7f7ab40ace10 2023-10-18T19:34:34.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.173 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ab41cac10 con 0x7f7ab40ace10 2023-10-18T19:34:34.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.174 7f7aa37fe700 1 -- 172.21.15.88:0/3750475495 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7aa8000c30 con 0x7f7ab40ace10 2023-10-18T19:34:34.177 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 >> v1:172.21.15.88:6800/107321 conn(0x7f7a9001c1b0 legacy=0x7f7a9001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 msgr2=0x7f7ab40ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 0x7f7ab40ad260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7ab40cda40 tx=0x7f7aa800c7c0).stop 2023-10-18T19:34:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 shutdown_connections 2023-10-18T19:34:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40bc8d0 0x7f7ab40bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7ab40e0110 0x7f7ab40e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 --2- 172.21.15.88:0/3750475495 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7ab40ace10 0x7f7ab40ad260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 >> 172.21.15.88:0/3750475495 conn(0x7f7ab40ce6c0 msgr2=0x7f7ab4115270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 shutdown_connections 2023-10-18T19:34:34.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.175 7f7aba1ff700 1 -- 172.21.15.88:0/3750475495 wait complete. 2023-10-18T19:34:34.194 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:34.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.393 7fc227fff700 1 Processor -- start 2023-10-18T19:34:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.393 7fc227fff700 1 -- start start 2023-10-18T19:34:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.393 7fc227fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.393 7fc227fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2280f6680 0x7fc2281b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc227fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc228111640 con 0x7fc2280f12d0 2023-10-18T19:34:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc227fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22810d040 con 0x7fc2280f6680 2023-10-18T19:34:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc227fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc228111d30 con 0x7fc2280f6230 2023-10-18T19:34:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43102/0 (socket says 172.21.15.88:43102) 2023-10-18T19:34:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 -- 172.21.15.88:0/1974612197 learned_addr learned my addr 172.21.15.88:0/1974612197 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc21ffff700 1 --2- 172.21.15.88:0/1974612197 >> v2:172.21.15.88:3300/0 conn(0x7fc2280f6680 0x7fc2281b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 -- 172.21.15.88:0/1974612197 >> v2:172.21.15.88:3300/0 conn(0x7fc2280f6680 msgr2=0x7fc2281b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 --2- 172.21.15.88:0/1974612197 >> v2:172.21.15.88:3300/0 conn(0x7fc2280f6680 0x7fc2281b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 -- 172.21.15.88:0/1974612197 >> v1:172.21.15.88:6789/0 conn(0x7fc2280f12d0 legacy=0x7fc2280f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 -- 172.21.15.88:0/1974612197 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22810d560 con 0x7fc2280f6230 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.394 7fc2257fe700 1 --2- 172.21.15.88:0/1974612197 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc218002f70 tx=0x7fc2180099d0).ready entity=mon.2 client_cookie=1c4c0a929764a62c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc224ffd700 1 -- 172.21.15.88:0/1974612197 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc22810d560 con 0x7fc2280f6230 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc224ffd700 1 -- 172.21.15.88:0/1974612197 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21800f510 con 0x7fc2280f6230 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc224ffd700 1 -- 172.21.15.88:0/1974612197 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc21800f6f0 con 0x7fc2280f6230 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 -- 172.21.15.88:0/1974612197 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 msgr2=0x7fc2281b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 --2- 172.21.15.88:0/1974612197 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc218002f70 tx=0x7fc2180099d0).stop 2023-10-18T19:34:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 -- 172.21.15.88:0/1974612197 shutdown_connections 2023-10-18T19:34:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 --2- 172.21.15.88:0/1974612197 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280f6230 0x7fc2281b2560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 --2- 172.21.15.88:0/1974612197 >> v2:172.21.15.88:3300/0 conn(0x7fc2280f6680 0x7fc2281b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 -- 172.21.15.88:0/1974612197 >> 172.21.15.88:0/1974612197 conn(0x7fc228117180 msgr2=0x7fc2280f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.395 7fc227fff700 1 -- 172.21.15.88:0/1974612197 shutdown_connections 2023-10-18T19:34:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.396 7fc227fff700 1 -- 172.21.15.88:0/1974612197 wait complete. 2023-10-18T19:34:34.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.420 7fc227fff700 1 Processor -- start 2023-10-18T19:34:34.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.420 7fc227fff700 1 -- start start 2023-10-18T19:34:34.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2280c92a0 0x7fc2280c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280b8130 0x7fc2281c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280f69e0 con 0x7fc2280c92a0 2023-10-18T19:34:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c8ac0 con 0x7fc2280b76b0 2023-10-18T19:34:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc227fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280de180 con 0x7fc2280b8130 2023-10-18T19:34:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc21ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc225fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280b8130 0x7fc2281c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc21ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44598/0 (socket says 172.21.15.88:44598) 2023-10-18T19:34:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc21ffff700 1 -- 172.21.15.88:0/27420973 learned_addr learned my addr 172.21.15.88:0/27420973 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.421 7fc2257fe700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2280c92a0 0x7fc2280c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 -- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280b8130 msgr2=0x7fc2281c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280b8130 0x7fc2281c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 -- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2280c92a0 msgr2=0x7fc2280c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2280c92a0 0x7fc2280c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 -- 172.21.15.88:0/27420973 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280b8750 con 0x7fc2280b76b0 2023-10-18T19:34:34.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21ffff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc2280c8970 tx=0x7fc21000ec20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc2280b8750 con 0x7fc2280b76b0 2023-10-18T19:34:34.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000c7b0 con 0x7fc2280b76b0 2023-10-18T19:34:34.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc227fff700 1 -- 172.21.15.88:0/27420973 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2280dd830 con 0x7fc2280b76b0 2023-10-18T19:34:34.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc21000f040 con 0x7fc2280b76b0 2023-10-18T19:34:34.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.422 7fc227fff700 1 -- 172.21.15.88:0/27420973 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2280ddbf0 con 0x7fc2280b76b0 2023-10-18T19:34:34.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.423 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc210019020 con 0x7fc2280b76b0 2023-10-18T19:34:34.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.423 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc210010040 con 0x7fc2280b76b0 2023-10-18T19:34:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.423 7fc227fff700 1 -- 172.21.15.88:0/27420973 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2280f0320 con 0x7fc2280b76b0 2023-10-18T19:34:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.426 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc21000c5a0 con 0x7fc2280b76b0 2023-10-18T19:34:34.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.546 7fc227fff700 1 -- 172.21.15.88:0/27420973 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2280a5e40 con 0x7fc2280b76b0 2023-10-18T19:34:34.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.547 7fc21e7fc700 1 -- 172.21.15.88:0/27420973 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fc21002a8f0 con 0x7fc2280b76b0 2023-10-18T19:34:34.550 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:34.550 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:25.229238","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:34.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 -- 172.21.15.88:0/27420973 >> v1:172.21.15.88:6800/107321 conn(0x7fc20c01c1b0 legacy=0x7fc20c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 -- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 msgr2=0x7fc2280b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc2280c8970 tx=0x7fc21000ec20).stop 2023-10-18T19:34:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 -- 172.21.15.88:0/27420973 shutdown_connections 2023-10-18T19:34:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc2280b8130 0x7fc2281c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2280c92a0 0x7fc2280c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 --2- 172.21.15.88:0/27420973 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2280b76b0 0x7fc2280b7b00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 -- 172.21.15.88:0/27420973 >> 172.21.15.88:0/27420973 conn(0x7fc228121c50 msgr2=0x7fc2280ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.548 7fc227fff700 1 -- 172.21.15.88:0/27420973 shutdown_connections 2023-10-18T19:34:34.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.549 7fc227fff700 1 -- 172.21.15.88:0/27420973 wait complete. 2023-10-18T19:34:34.554 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 10 2023-10-18T19:34:34.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:34.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.765 7f69fd7ff700 1 Processor -- start 2023-10-18T19:34:34.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.765 7f69fd7ff700 1 -- start start 2023-10-18T19:34:34.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69fd7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69f80f6620 0x7f69f81031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69fd7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f81037e0 0x7f69f81b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69fd7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f80ffa50 con 0x7f69f8103c30 2023-10-18T19:34:34.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69fd7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f81117c0 con 0x7f69f80f6620 2023-10-18T19:34:34.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69fd7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8104080 con 0x7f69f81037e0 2023-10-18T19:34:34.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69f5bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69f80f6620 0x7f69f81031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69f53fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f81037e0 0x7f69f81b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69f5bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69f80f6620 0x7f69f81031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37540/0 (socket says 172.21.15.88:37540) 2023-10-18T19:34:34.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69f5bfe700 1 -- 172.21.15.88:0/1379843469 learned_addr learned my addr 172.21.15.88:0/1379843469 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.766 7f69f63ff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69f8103c30 0x7f69f81b8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52162/0 (socket says 172.21.15.88:52162) 2023-10-18T19:34:34.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f5bfe700 1 -- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f81037e0 msgr2=0x7f69f81b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:34.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f5bfe700 1 --2- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f81037e0 0x7f69f81b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f5bfe700 1 -- 172.21.15.88:0/1379843469 >> v1:172.21.15.88:6789/0 conn(0x7f69f8103c30 legacy=0x7f69f81b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f5bfe700 1 -- 172.21.15.88:0/1379843469 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f810c3e0 con 0x7f69f80f6620 2023-10-18T19:34:34.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f4bfc700 1 -- 172.21.15.88:0/1379843469 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961374313 0 0) 0x7f69f0001490 con 0x7f69f8103c30 2023-10-18T19:34:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f5bfe700 1 --2- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80f6620 0x7f69f81031b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f69f80a8ec0 tx=0x7f69e8009a80).ready entity=mon.0 client_cookie=921ece2f006c0803 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f4bfc700 1 -- 172.21.15.88:0/1379843469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69f810c3e0 con 0x7f69f80f6620 2023-10-18T19:34:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f4bfc700 1 -- 172.21.15.88:0/1379843469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800f510 con 0x7f69f80f6620 2023-10-18T19:34:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69f4bfc700 1 -- 172.21.15.88:0/1379843469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69e800f740 con 0x7f69f80f6620 2023-10-18T19:34:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69fd7ff700 1 -- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80f6620 msgr2=0x7f69f81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.767 7f69fd7ff700 1 --2- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80f6620 0x7f69f81031b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f69f80a8ec0 tx=0x7f69e8009a80).stop 2023-10-18T19:34:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 -- 172.21.15.88:0/1379843469 shutdown_connections 2023-10-18T19:34:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 --2- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80f6620 0x7f69f81031b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 --2- 172.21.15.88:0/1379843469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f81037e0 0x7f69f81b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 -- 172.21.15.88:0/1379843469 >> 172.21.15.88:0/1379843469 conn(0x7f69f8117390 msgr2=0x7f69f80f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 -- 172.21.15.88:0/1379843469 shutdown_connections 2023-10-18T19:34:34.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.768 7f69fd7ff700 1 -- 172.21.15.88:0/1379843469 wait complete. 2023-10-18T19:34:34.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.793 7f69fd7ff700 1 Processor -- start 2023-10-18T19:34:34.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.793 7f69fd7ff700 1 -- start start 2023-10-18T19:34:34.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.793 7f69fd7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.793 7f69fd7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 0x7f69f81b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69fd7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f80cc550 0x7f69f80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69fd7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80db6c0 con 0x7f69f80dd340 2023-10-18T19:34:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69fd7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80ce4c0 con 0x7f69f80cc550 2023-10-18T19:34:34.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69fd7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80de280 con 0x7f69f80dd790 2023-10-18T19:34:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37554/0 (socket says 172.21.15.88:37554) 2023-10-18T19:34:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 -- 172.21.15.88:0/1370905265 learned_addr learned my addr 172.21.15.88:0/1370905265 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f63ff700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f80cc550 0x7f69f80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f53fd700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 0x7f69f81b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:34.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 -- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 msgr2=0x7f69f81b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 0x7f69f81b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 -- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f80cc550 msgr2=0x7f69f80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f80cc550 0x7f69f80cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 -- 172.21.15.88:0/1370905265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80ce6e0 con 0x7f69f80dd340 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f53fd700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 0x7f69f81b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.794 7f69f5bfe700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f69f80dbb20 tx=0x7f69e80068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69f80ce6e0 con 0x7f69f80dd340 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8011690 con 0x7f69f80dd340 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f81b56c0 con 0x7f69f80dd340 2023-10-18T19:34:34.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f69e8011a60 con 0x7f69f80dd340 2023-10-18T19:34:34.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f80ccfd0 con 0x7f69f80dd340 2023-10-18T19:34:34.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.795 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f69e8011c60 con 0x7f69f80dd340 2023-10-18T19:34:34.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.796 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f69e800ea60 con 0x7f69f80dd340 2023-10-18T19:34:34.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.796 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f80f0530 con 0x7f69f80dd340 2023-10-18T19:34:34.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.799 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f69e8011480 con 0x7f69f80dd340 2023-10-18T19:34:34.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.896 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69f80efc00 con 0x7f69f80dd340 2023-10-18T19:34:34.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.897 7f69e6ffd700 1 -- 172.21.15.88:0/1370905265 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f69e80382a0 con 0x7f69f80dd340 2023-10-18T19:34:34.900 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 >> v1:172.21.15.88:6800/107321 conn(0x7f69d401c1b0 legacy=0x7f69d401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 msgr2=0x7f69f81b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f69f80dbb20 tx=0x7f69e80068c0).stop 2023-10-18T19:34:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 shutdown_connections 2023-10-18T19:34:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f69f80cc550 0x7f69f80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f80dd340 0x7f69f81b4a60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 --2- 172.21.15.88:0/1370905265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f69f80dd790 0x7f69f81b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 >> 172.21.15.88:0/1370905265 conn(0x7f69f80b4b80 msgr2=0x7f69f81b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 shutdown_connections 2023-10-18T19:34:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:34.898 7f69fd7ff700 1 -- 172.21.15.88:0/1370905265 wait complete. 2023-10-18T19:34:34.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18 19:34:09.738627', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18 19:34:18.877868', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18 19:34:20.222147', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T19:34:34.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:34:35.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 Processor -- start 2023-10-18T19:34:35.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 -- start start 2023-10-18T19:34:35.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ac0f81d0 0x7f88ac0f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac0abc70 con 0x7f88ac0f8620 2023-10-18T19:34:35.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac0f8ed0 con 0x7f88ac0f81d0 2023-10-18T19:34:35.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.117 7f88b2dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac1184b0 con 0x7f88ac1b7e40 2023-10-18T19:34:35.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ac0f81d0 0x7f88ac0f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88ab7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88ac0f81d0 0x7f88ac0f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37556/0 (socket says 172.21.15.88:37556) 2023-10-18T19:34:35.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 -- 172.21.15.88:0/2959149063 learned_addr learned my addr 172.21.15.88:0/2959149063 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88ab7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43130/0 (socket says 172.21.15.88:43130) 2023-10-18T19:34:35.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aa7fd700 1 --1- 172.21.15.88:0/2959149063 >> v1:172.21.15.88:6789/0 conn(0x7f88ac0f8620 0x7f88ac0f15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52174/0 (socket says 172.21.15.88:52174) 2023-10-18T19:34:35.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 -- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 msgr2=0x7f88ac1ba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:35.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 -- 172.21.15.88:0/2959149063 >> v1:172.21.15.88:6789/0 conn(0x7f88ac0f8620 legacy=0x7f88ac0f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 -- 172.21.15.88:0/2959149063 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0f2200 con 0x7f88ac0f81d0 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88a9ffc700 1 -- 172.21.15.88:0/2959149063 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650365077 0 0) 0x7f88a0001110 con 0x7f88ac0f8620 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88ab7ff700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.118 7f88aaffe700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f81d0 0x7f88ac0f0f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f88ac0f8e50 tx=0x7f889c009a80).ready entity=mon.0 client_cookie=5c4c2f85aa58b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88a9ffc700 1 -- 172.21.15.88:0/2959149063 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f88ac0f2200 con 0x7f88ac0f81d0 2023-10-18T19:34:35.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88a9ffc700 1 -- 172.21.15.88:0/2959149063 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00f510 con 0x7f88ac0f81d0 2023-10-18T19:34:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88a9ffc700 1 -- 172.21.15.88:0/2959149063 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889c00f6f0 con 0x7f88ac0f81d0 2023-10-18T19:34:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 -- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f81d0 msgr2=0x7f88ac0f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f81d0 0x7f88ac0f0f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f88ac0f8e50 tx=0x7f889c009a80).stop 2023-10-18T19:34:35.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 -- 172.21.15.88:0/2959149063 shutdown_connections 2023-10-18T19:34:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac1b7e40 0x7f88ac1ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 --2- 172.21.15.88:0/2959149063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f81d0 0x7f88ac0f0f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 -- 172.21.15.88:0/2959149063 >> 172.21.15.88:0/2959149063 conn(0x7f88ac125e20 msgr2=0x7f88ac126270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 -- 172.21.15.88:0/2959149063 shutdown_connections 2023-10-18T19:34:35.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.119 7f88b2dff700 1 -- 172.21.15.88:0/2959149063 wait complete. 2023-10-18T19:34:35.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 Processor -- start 2023-10-18T19:34:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 -- start start 2023-10-18T19:34:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 0x7f88ac1c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f88ac0f3630 0x7f88ac0f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0e6430 con 0x7f88ac0f2d80 2023-10-18T19:34:35.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0bdb70 con 0x7f88ac0f3630 2023-10-18T19:34:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.144 7f88b2dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0d1190 con 0x7f88ac0f2930 2023-10-18T19:34:35.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aa7fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 0x7f88ac1c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43132/0 (socket says 172.21.15.88:43132) 2023-10-18T19:34:35.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 -- 172.21.15.88:0/1894098669 learned_addr learned my addr 172.21.15.88:0/1894098669 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88ab7ff700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f88ac0f3630 0x7f88ac0f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 -- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f88ac0f3630 msgr2=0x7f88ac0f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f88ac0f3630 0x7f88ac0f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 -- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 msgr2=0x7f88ac1c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 0x7f88ac1c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 -- 172.21.15.88:0/1894098669 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0d1630 con 0x7f88ac0f2930 2023-10-18T19:34:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aa7fd700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 0x7f88ac1c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.145 7f88aaffe700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f88ac0bd720 tx=0x7f889c0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889c011710 con 0x7f88ac0f2930 2023-10-18T19:34:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c011910 con 0x7f88ac0f2930 2023-10-18T19:34:35.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f889c011ce0 con 0x7f88ac0f2930 2023-10-18T19:34:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0d3ae0 con 0x7f88ac0f2930 2023-10-18T19:34:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac0d0c00 con 0x7f88ac0f2930 2023-10-18T19:34:35.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.146 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f889c027460 con 0x7f88ac0f2930 2023-10-18T19:34:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.147 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f889c029d90 con 0x7f88ac0f2930 2023-10-18T19:34:35.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.147 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac0f0870 con 0x7f88ac0f2930 2023-10-18T19:34:35.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.150 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f889c011500 con 0x7f88ac0f2930 2023-10-18T19:34:35.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.248 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88ac0e2350 con 0x7f88ac0f2930 2023-10-18T19:34:35.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.249 7f889bfff700 1 -- 172.21.15.88:0/1894098669 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f889c00f300 con 0x7f88ac0f2930 2023-10-18T19:34:35.252 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:34:35.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 >> v1:172.21.15.88:6800/107321 conn(0x7f888801c1b0 legacy=0x7f888801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 msgr2=0x7f88ac1c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f88ac0bd720 tx=0x7f889c0068c0).stop 2023-10-18T19:34:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 shutdown_connections 2023-10-18T19:34:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f88ac0f3630 0x7f88ac0f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f88ac0f2930 0x7f88ac1c5d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 --2- 172.21.15.88:0/1894098669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88ac0f2d80 0x7f88ac1c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.250 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 >> 172.21.15.88:0/1894098669 conn(0x7f88ac0e1030 msgr2=0x7f88ac0af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.251 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 shutdown_connections 2023-10-18T19:34:35.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.251 7f88b2dff700 1 -- 172.21.15.88:0/1894098669 wait complete. 2023-10-18T19:34:35.271 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T19:34:35.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.470 7f45f79ff700 1 Processor -- start 2023-10-18T19:34:35.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.471 7f45f79ff700 1 -- start start 2023-10-18T19:34:35.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 0x7f45f01b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 0x7f45f01b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f0111b00 con 0x7f45f0103f70 2023-10-18T19:34:35.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01043c0 con 0x7f45f00f6960 2023-10-18T19:34:35.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45f79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0116410 con 0x7f45f0103b20 2023-10-18T19:34:35.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45eeffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 0x7f45f01b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44634/0 (socket says 172.21.15.88:44634) 2023-10-18T19:34:35.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 -- 172.21.15.88:0/347886914 learned_addr learned my addr 172.21.15.88:0/347886914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45effff700 1 --2- 172.21.15.88:0/347886914 >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 0x7f45f01b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 -- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 msgr2=0x7f45f01b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:35.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 0x7f45f01b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 -- 172.21.15.88:0/347886914 >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 msgr2=0x7f45f01b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:35.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 --2- 172.21.15.88:0/347886914 >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 0x7f45f01b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.472 7f45ef7fe700 1 -- 172.21.15.88:0/347886914 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f010c720 con 0x7f45f00f6960 2023-10-18T19:34:35.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45eeffd700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 0x7f45f01b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:35.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45effff700 1 --2- 172.21.15.88:0/347886914 >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 0x7f45f01b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:35.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45ef7fe700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f45f01165c0 tx=0x7f45e000bcb0).ready entity=mon.1 client_cookie=3f107c1faa4c9c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45ee7fc700 1 -- 172.21.15.88:0/347886914 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f45f010c720 con 0x7f45f00f6960 2023-10-18T19:34:35.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45ee7fc700 1 -- 172.21.15.88:0/347886914 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000db60 con 0x7f45f00f6960 2023-10-18T19:34:35.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45ee7fc700 1 -- 172.21.15.88:0/347886914 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f45e0010470 con 0x7f45f00f6960 2023-10-18T19:34:35.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45f79ff700 1 -- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 msgr2=0x7f45f01034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.473 7f45f79ff700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f45f01165c0 tx=0x7f45e000bcb0).stop 2023-10-18T19:34:35.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 -- 172.21.15.88:0/347886914 shutdown_connections 2023-10-18T19:34:35.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 --2- 172.21.15.88:0/347886914 >> v2:172.21.15.88:3300/0 conn(0x7f45f0103f70 0x7f45f01b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f00f6960 0x7f45f01034f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 --2- 172.21.15.88:0/347886914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f0103b20 0x7f45f01b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 -- 172.21.15.88:0/347886914 >> 172.21.15.88:0/347886914 conn(0x7f45f01176d0 msgr2=0x7f45f00f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 -- 172.21.15.88:0/347886914 shutdown_connections 2023-10-18T19:34:35.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.474 7f45f79ff700 1 -- 172.21.15.88:0/347886914 wait complete. 2023-10-18T19:34:35.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.498 7f45f79ff700 1 Processor -- start 2023-10-18T19:34:35.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.498 7f45f79ff700 1 -- start start 2023-10-18T19:34:35.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f00dde70 0x7f45f01c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f00de2c0 0x7f45f01c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00bdb40 con 0x7f45f00de2c0 2023-10-18T19:34:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00bbee0 con 0x7f45f01b6480 2023-10-18T19:34:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45f79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01b8860 con 0x7f45f00dde70 2023-10-18T19:34:35.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45ef7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45ef7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44650/0 (socket says 172.21.15.88:44650) 2023-10-18T19:34:35.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45ef7fe700 1 -- 172.21.15.88:0/2018544264 learned_addr learned my addr 172.21.15.88:0/2018544264 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45effff700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f00de2c0 0x7f45f01c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.499 7f45eeffd700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f00dde70 0x7f45f01c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 -- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f00dde70 msgr2=0x7f45f01c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f00dde70 0x7f45f01c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 -- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f00de2c0 msgr2=0x7f45f01c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f00de2c0 0x7f45f01c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 -- 172.21.15.88:0/2018544264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00bc170 con 0x7f45f01b6480 2023-10-18T19:34:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ef7fe700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f45f010c200 tx=0x7f45e00068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f45f00bc170 con 0x7f45f01b6480 2023-10-18T19:34:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0010b80 con 0x7f45f01b6480 2023-10-18T19:34:35.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f45e001e070 con 0x7f45f01b6480 2023-10-18T19:34:35.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00d3190 con 0x7f45f01b6480 2023-10-18T19:34:35.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.500 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f01c0830 con 0x7f45f01b6480 2023-10-18T19:34:35.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.501 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f45e0018400 con 0x7f45f01b6480 2023-10-18T19:34:35.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.501 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f45e0002c30 con 0x7f45f01b6480 2023-10-18T19:34:35.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.502 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f00f0870 con 0x7f45f01b6480 2023-10-18T19:34:35.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.505 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f45e0010780 con 0x7f45f01b6480 2023-10-18T19:34:35.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.602 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45f00e2350 con 0x7f45f01b6480 2023-10-18T19:34:35.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.602 7f45ecff9700 1 -- 172.21.15.88:0/2018544264 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45e000d760 con 0x7f45f01b6480 2023-10-18T19:34:35.606 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 >> v1:172.21.15.88:6800/107321 conn(0x7f45d001c1b0 legacy=0x7f45d001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 msgr2=0x7f45f00dd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f45f010c200 tx=0x7f45e00068c0).stop 2023-10-18T19:34:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 shutdown_connections 2023-10-18T19:34:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45f00de2c0 0x7f45f01c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f45f01b6480 0x7f45f00dd840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 --2- 172.21.15.88:0/2018544264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f45f00dde70 0x7f45f01c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 >> 172.21.15.88:0/2018544264 conn(0x7f45f00d3710 msgr2=0x7f45f00dfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 shutdown_connections 2023-10-18T19:34:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.604 7f45f79ff700 1 -- 172.21.15.88:0/2018544264 wait complete. 2023-10-18T19:34:35.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T19:34:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.822 7f906cbff700 1 Processor -- start 2023-10-18T19:34:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 -- start start 2023-10-18T19:34:35.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f90681b2ab0 0x7f90681b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90680abc70 con 0x7f90681b3530 2023-10-18T19:34:35.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9068112280 con 0x7f90681b2ab0 2023-10-18T19:34:35.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.823 7f906cbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90680f6d70 con 0x7f906810d000 2023-10-18T19:34:35.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43150/0 (socket says 172.21.15.88:43150) 2023-10-18T19:34:35.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 -- 172.21.15.88:0/2617491558 learned_addr learned my addr 172.21.15.88:0/2617491558 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f905ffff700 1 --2- 172.21.15.88:0/2617491558 >> v2:172.21.15.88:3300/0 conn(0x7f90681b2ab0 0x7f90681b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 -- 172.21.15.88:0/2617491558 >> v2:172.21.15.88:3300/0 conn(0x7f90681b2ab0 msgr2=0x7f90681b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:35.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 --2- 172.21.15.88:0/2617491558 >> v2:172.21.15.88:3300/0 conn(0x7f90681b2ab0 0x7f90681b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 -- 172.21.15.88:0/2617491558 >> v1:172.21.15.88:6789/0 conn(0x7f90681b3530 legacy=0x7f90680f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 -- 172.21.15.88:0/2617491558 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068111b90 con 0x7f906810d000 2023-10-18T19:34:35.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f9064dfe700 1 --2- 172.21.15.88:0/2617491558 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9058002f70 tx=0x7f90580099d0).ready entity=mon.2 client_cookie=75186e3659777f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f905f7fe700 1 -- 172.21.15.88:0/2617491558 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9068111b90 con 0x7f906810d000 2023-10-18T19:34:35.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f905f7fe700 1 -- 172.21.15.88:0/2617491558 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905800f510 con 0x7f906810d000 2023-10-18T19:34:35.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f905f7fe700 1 -- 172.21.15.88:0/2617491558 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f905800f6f0 con 0x7f906810d000 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f906cbff700 1 -- 172.21.15.88:0/2617491558 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 msgr2=0x7f90680f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.824 7f906cbff700 1 --2- 172.21.15.88:0/2617491558 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9058002f70 tx=0x7f90580099d0).stop 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 -- 172.21.15.88:0/2617491558 shutdown_connections 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 --2- 172.21.15.88:0/2617491558 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f906810d000 0x7f90680f6740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 --2- 172.21.15.88:0/2617491558 >> v2:172.21.15.88:3300/0 conn(0x7f90681b2ab0 0x7f90681b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 -- 172.21.15.88:0/2617491558 >> 172.21.15.88:0/2617491558 conn(0x7f90681176d0 msgr2=0x7f90680f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 -- 172.21.15.88:0/2617491558 shutdown_connections 2023-10-18T19:34:35.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.825 7f906cbff700 1 -- 172.21.15.88:0/2617491558 wait complete. 2023-10-18T19:34:35.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.849 7f906cbff700 1 Processor -- start 2023-10-18T19:34:35.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 -- start start 2023-10-18T19:34:35.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 0x7f90680d0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90681c9f20 0x7f90681cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680e2b00 con 0x7f90681c9f20 2023-10-18T19:34:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b9430 con 0x7f90680bc910 2023-10-18T19:34:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.850 7f906cbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90680b6b00 con 0x7f90680cfdd0 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f905ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 0x7f90680d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44654/0 (socket says 172.21.15.88:44654) 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f905ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 0x7f90680d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43158/0 (socket says 172.21.15.88:43158) 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 -- 172.21.15.88:0/3776464963 learned_addr learned my addr 172.21.15.88:0/3776464963 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f90655ff700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90681c9f20 0x7f90681cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 -- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 msgr2=0x7f90680d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 0x7f90680d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 -- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90681c9f20 msgr2=0x7f90681cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90681c9f20 0x7f90681cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 -- 172.21.15.88:0/3776464963 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680bcd60 con 0x7f90680bc910 2023-10-18T19:34:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f9064dfe700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f90680d0de0 tx=0x7f90580068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.851 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90680bcd60 con 0x7f90680bc910 2023-10-18T19:34:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.852 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9058011a50 con 0x7f90680bc910 2023-10-18T19:34:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.852 7f906cbff700 1 -- 172.21.15.88:0/3776464963 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90680d1ca0 con 0x7f90680bc910 2023-10-18T19:34:35.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.852 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f905801d450 con 0x7f90680bc910 2023-10-18T19:34:35.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.852 7f906cbff700 1 -- 172.21.15.88:0/3776464963 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90680b8bf0 con 0x7f90680bc910 2023-10-18T19:34:35.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.852 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9058006a50 con 0x7f90680bc910 2023-10-18T19:34:35.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.853 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9058029060 con 0x7f90680bc910 2023-10-18T19:34:35.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.853 7f906cbff700 1 -- 172.21.15.88:0/3776464963 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90680f0870 con 0x7f90680bc910 2023-10-18T19:34:35.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.856 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f905800f300 con 0x7f90680bc910 2023-10-18T19:34:35.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.954 7f906cbff700 1 -- 172.21.15.88:0/3776464963 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90680e2350 con 0x7f90680bc910 2023-10-18T19:34:35.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.955 7f905dffb700 1 -- 172.21.15.88:0/3776464963 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9058011840 con 0x7f90680bc910 2023-10-18T19:34:35.958 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 -- 172.21.15.88:0/3776464963 >> v1:172.21.15.88:6800/107321 conn(0x7f904c01c1b0 legacy=0x7f904c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 -- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 msgr2=0x7f90680cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f90680d0de0 tx=0x7f90580068c0).stop 2023-10-18T19:34:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 -- 172.21.15.88:0/3776464963 shutdown_connections 2023-10-18T19:34:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90681c9f20 0x7f90681cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90680bc910 0x7f90680cf7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 --2- 172.21.15.88:0/3776464963 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f90680cfdd0 0x7f90680d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.956 7f906cbff700 1 -- 172.21.15.88:0/3776464963 >> 172.21.15.88:0/3776464963 conn(0x7f9068121fd0 msgr2=0x7f90681169b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.957 7f906cbff700 1 -- 172.21.15.88:0/3776464963 shutdown_connections 2023-10-18T19:34:35.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:35.957 7f906cbff700 1 -- 172.21.15.88:0/3776464963 wait complete. 2023-10-18T19:34:35.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:36.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.172 7fc76199d700 1 Processor -- start 2023-10-18T19:34:36.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.172 7fc76199d700 1 -- start start 2023-10-18T19:34:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc76199d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 0x7fc75c1b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc76199d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 0x7fc75c1b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc76199d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c10d560 con 0x7fc75c10cb30 2023-10-18T19:34:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc76199d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0f8a30 con 0x7fc75c1b7570 2023-10-18T19:34:36.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc76199d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0f1cb0 con 0x7fc75c1b4ae0 2023-10-18T19:34:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc75affe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc75c10cb30 0x7fc75c0f7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60922/0 (socket says 172.21.15.88:60922) 2023-10-18T19:34:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc75a7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 0x7fc75c1b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc75affe700 1 -- 172.21.15.88:0/4110879265 learned_addr learned my addr 172.21.15.88:0/4110879265 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc75b7ff700 1 --2- 172.21.15.88:0/4110879265 >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 0x7fc75c1b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.173 7fc759ffc700 1 -- 172.21.15.88:0/4110879265 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167472544 0 0) 0x7fc74c001110 con 0x7fc75c10cb30 2023-10-18T19:34:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc759ffc700 1 -- 172.21.15.88:0/4110879265 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc740003270 con 0x7fc75c10cb30 2023-10-18T19:34:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75a7fd700 1 -- 172.21.15.88:0/4110879265 >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 msgr2=0x7fc75c1b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75a7fd700 1 --2- 172.21.15.88:0/4110879265 >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 0x7fc75c1b99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75a7fd700 1 -- 172.21.15.88:0/4110879265 >> v1:172.21.15.88:6789/0 conn(0x7fc75c10cb30 legacy=0x7fc75c0f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75a7fd700 1 -- 172.21.15.88:0/4110879265 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c1bb010 con 0x7fc75c1b4ae0 2023-10-18T19:34:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75b7ff700 1 --2- 172.21.15.88:0/4110879265 >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 0x7fc75c1b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc75a7fd700 1 --2- 172.21.15.88:0/4110879265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 0x7fc75c1b6f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc750002f70 tx=0x7fc75000b970).ready entity=mon.2 client_cookie=57b5b671d6e47385 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc759ffc700 1 -- 172.21.15.88:0/4110879265 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75c1bb010 con 0x7fc75c1b4ae0 2023-10-18T19:34:36.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc759ffc700 1 -- 172.21.15.88:0/4110879265 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75000d610 con 0x7fc75c1b4ae0 2023-10-18T19:34:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc759ffc700 1 -- 172.21.15.88:0/4110879265 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75000d9e0 con 0x7fc75c1b4ae0 2023-10-18T19:34:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc76199d700 1 -- 172.21.15.88:0/4110879265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 msgr2=0x7fc75c1b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.174 7fc76199d700 1 --2- 172.21.15.88:0/4110879265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 0x7fc75c1b6f40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc750002f70 tx=0x7fc75000b970).stop 2023-10-18T19:34:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 -- 172.21.15.88:0/4110879265 shutdown_connections 2023-10-18T19:34:36.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 --2- 172.21.15.88:0/4110879265 >> v2:172.21.15.88:3300/0 conn(0x7fc75c1b7570 0x7fc75c1b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 --2- 172.21.15.88:0/4110879265 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b4ae0 0x7fc75c1b6f40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 -- 172.21.15.88:0/4110879265 >> 172.21.15.88:0/4110879265 conn(0x7fc75c1258d0 msgr2=0x7fc75c125d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 -- 172.21.15.88:0/4110879265 shutdown_connections 2023-10-18T19:34:36.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.175 7fc76199d700 1 -- 172.21.15.88:0/4110879265 wait complete. 2023-10-18T19:34:36.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.199 7fc76199d700 1 Processor -- start 2023-10-18T19:34:36.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.199 7fc76199d700 1 -- start start 2023-10-18T19:34:36.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc75c1b4030 0x7fc75c1bf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b11b0 0x7fc75c1b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0f0040 con 0x7fc75c1bfc50 2023-10-18T19:34:36.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1b2200 con 0x7fc75c1b4030 2023-10-18T19:34:36.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc76199d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1b1ee0 con 0x7fc75c1b11b0 2023-10-18T19:34:36.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc75a7fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc75b7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b11b0 0x7fc75c1b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc75affe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc75c1b4030 0x7fc75c1bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc75a7fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33948/0 (socket says 172.21.15.88:33948) 2023-10-18T19:34:36.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.200 7fc75a7fd700 1 -- 172.21.15.88:0/3759636130 learned_addr learned my addr 172.21.15.88:0/3759636130 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:36.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 -- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b11b0 msgr2=0x7fc75c1b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b11b0 0x7fc75c1b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 -- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc75c1b4030 msgr2=0x7fc75c1bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc75c1b4030 0x7fc75c1bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 -- 172.21.15.88:0/3759636130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c1b5df0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc75a7fd700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc75c1b1d40 tx=0x7fc75000a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75c1b5df0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750013a80 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc76199d700 1 -- 172.21.15.88:0/3759636130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0d9be0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc75001f450 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.201 7fc76199d700 1 -- 172.21.15.88:0/3759636130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c1b47a0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.202 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc7500113c0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.202 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc750015d60 con 0x7fc75c1bfc50 2023-10-18T19:34:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.202 7fc76199d700 1 -- 172.21.15.88:0/3759636130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c1c6bb0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.205 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc75000d400 con 0x7fc75c1bfc50 2023-10-18T19:34:36.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.330 7fc76199d700 1 -- 172.21.15.88:0/3759636130 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc75c0e2d60 con 0x7fc75c1bfc50 2023-10-18T19:34:36.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.330 7fc74bfff700 1 -- 172.21.15.88:0/3759636130 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fc75002d8f0 con 0x7fc75c1bfc50 2023-10-18T19:34:36.333 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:36.334 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:25.229238","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 >> v1:172.21.15.88:6800/107321 conn(0x7fc73801c1b0 legacy=0x7fc73801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 msgr2=0x7fc75c1b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc75c1b1d40 tx=0x7fc75000a040).stop 2023-10-18T19:34:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 shutdown_connections 2023-10-18T19:34:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc75c1b11b0 0x7fc75c1b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc75c1b4030 0x7fc75c1bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 --2- 172.21.15.88:0/3759636130 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c1bfc50 0x7fc75c1b0b80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 >> 172.21.15.88:0/3759636130 conn(0x7fc75c0b6810 msgr2=0x7fc75c0dc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:36.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 shutdown_connections 2023-10-18T19:34:36.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.332 7fc76199d700 1 -- 172.21.15.88:0/3759636130 wait complete. 2023-10-18T19:34:36.337 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 10 2023-10-18T19:34:36.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:36.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.548 7f08bfdff700 1 Processor -- start 2023-10-18T19:34:36.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 -- start start 2023-10-18T19:34:36.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 0x7f08b80f1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80ab280 con 0x7f08b81b2990 2023-10-18T19:34:36.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80f2100 con 0x7f08b81165b0 2023-10-18T19:34:36.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08bfdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b810d0a0 con 0x7f08b8116160 2023-10-18T19:34:36.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.549 7f08b7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 0x7f08b80f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37310/0 (socket says 172.21.15.88:37310) 2023-10-18T19:34:36.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 -- 172.21.15.88:0/4238227694 learned_addr learned my addr 172.21.15.88:0/4238227694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:36.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08bcbff700 1 --1- 172.21.15.88:0/4238227694 >> v1:172.21.15.88:6789/0 conn(0x7f08b81b2990 0x7f08b81b2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60928/0 (socket says 172.21.15.88:60928) 2023-10-18T19:34:36.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 -- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 msgr2=0x7f08b80f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:36.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 0x7f08b80f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 -- 172.21.15.88:0/4238227694 >> v1:172.21.15.88:6789/0 conn(0x7f08b81b2990 legacy=0x7f08b81b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b6ffd700 1 -- 172.21.15.88:0/4238227694 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891005794 0 0) 0x7f08b0001490 con 0x7f08b81b2990 2023-10-18T19:34:36.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 -- 172.21.15.88:0/4238227694 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8116ca0 con 0x7f08b8116160 2023-10-18T19:34:36.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b77fe700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 0x7f08b80f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:36.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b7fff700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8009a00).ready entity=mon.2 client_cookie=3c3498485121df83 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b6ffd700 1 -- 172.21.15.88:0/4238227694 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08b8116ca0 con 0x7f08b8116160 2023-10-18T19:34:36.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b6ffd700 1 -- 172.21.15.88:0/4238227694 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800f510 con 0x7f08b8116160 2023-10-18T19:34:36.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08b6ffd700 1 -- 172.21.15.88:0/4238227694 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08a800f6f0 con 0x7f08b8116160 2023-10-18T19:34:36.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08bfdff700 1 -- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 msgr2=0x7f08b80f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.550 7f08bfdff700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f08a8002f70 tx=0x7f08a8009a00).stop 2023-10-18T19:34:36.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 -- 172.21.15.88:0/4238227694 shutdown_connections 2023-10-18T19:34:36.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b8116160 0x7f08b80f0e60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 --2- 172.21.15.88:0/4238227694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81165b0 0x7f08b80f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 -- 172.21.15.88:0/4238227694 >> 172.21.15.88:0/4238227694 conn(0x7f08b8125cf0 msgr2=0x7f08b8126140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:36.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 -- 172.21.15.88:0/4238227694 shutdown_connections 2023-10-18T19:34:36.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.551 7f08bfdff700 1 -- 172.21.15.88:0/4238227694 wait complete. 2023-10-18T19:34:36.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.575 7f08bfdff700 1 Processor -- start 2023-10-18T19:34:36.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 -- start start 2023-10-18T19:34:36.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 0x7f08b80cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81c6490 0x7f08b81c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8123320 con 0x7f08b80ccce0 2023-10-18T19:34:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80b0970 con 0x7f08b81c6490 2023-10-18T19:34:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08bfdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80b03c0 con 0x7f08b80aff70 2023-10-18T19:34:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08b77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08b7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 0x7f08b80cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08b77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33958/0 (socket says 172.21.15.88:33958) 2023-10-18T19:34:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.576 7f08b77fe700 1 -- 172.21.15.88:0/511877223 learned_addr learned my addr 172.21.15.88:0/511877223 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08bcbff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81c6490 0x7f08b81c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 -- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 msgr2=0x7f08b80cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 0x7f08b80cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 -- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81c6490 msgr2=0x7f08b81c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81c6490 0x7f08b81c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 -- 172.21.15.88:0/511877223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80d55a0 con 0x7f08b80ccce0 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b7fff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 0x7f08b80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b77fe700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f08ac00c000 tx=0x7f08ac00eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08b80d55a0 con 0x7f08b80ccce0 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00c9a0 con 0x7f08b80ccce0 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f08ac00f040 con 0x7f08b80ccce0 2023-10-18T19:34:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08bfdff700 1 -- 172.21.15.88:0/511877223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b81c3a10 con 0x7f08b80ccce0 2023-10-18T19:34:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.577 7f08bfdff700 1 -- 172.21.15.88:0/511877223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b81cd520 con 0x7f08b80ccce0 2023-10-18T19:34:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.578 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f08ac011070 con 0x7f08b80ccce0 2023-10-18T19:34:36.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.578 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f08ac010040 con 0x7f08b80ccce0 2023-10-18T19:34:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.579 7f08bfdff700 1 -- 172.21.15.88:0/511877223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80f0740 con 0x7f08b80ccce0 2023-10-18T19:34:36.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.582 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f08ac00c5a0 con 0x7f08b80ccce0 2023-10-18T19:34:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.679 7f08bfdff700 1 -- 172.21.15.88:0/511877223 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b80e2250 con 0x7f08b80ccce0 2023-10-18T19:34:36.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.680 7f08b57fa700 1 -- 172.21.15.88:0/511877223 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8847 (secure 0 0 0) 0x7f08ac000c30 con 0x7f08b80ccce0 2023-10-18T19:34:36.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:36.683 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:22.217246","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 >> v1:172.21.15.88:6800/107321 conn(0x7f089801c1b0 legacy=0x7f089801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 msgr2=0x7f08b81c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f08ac00c000 tx=0x7f08ac00eca0).stop 2023-10-18T19:34:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 shutdown_connections 2023-10-18T19:34:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f08b81c6490 0x7f08b81c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f08b80aff70 0x7f08b80cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 --2- 172.21.15.88:0/511877223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08b80ccce0 0x7f08b81c5e60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 >> 172.21.15.88:0/511877223 conn(0x7f08b80d8bf0 msgr2=0x7f08b80bce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 shutdown_connections 2023-10-18T19:34:36.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.681 7f08bfdff700 1 -- 172.21.15.88:0/511877223 wait complete. 2023-10-18T19:34:36.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:36.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.897 7fd93959d700 1 Processor -- start 2023-10-18T19:34:36.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 -- start start 2023-10-18T19:34:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9340f6680 0x7fd9341b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd934111640 con 0x7fd9340f12d0 2023-10-18T19:34:36.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93410d040 con 0x7fd9340f6680 2023-10-18T19:34:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd93959d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd934111d30 con 0x7fd9340f6230 2023-10-18T19:34:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.898 7fd932bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9340f6680 0x7fd9341b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd932bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59370/0 (socket says 172.21.15.88:59370) 2023-10-18T19:34:36.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9333ff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9340f12d0 0x7fd9340f1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60936/0 (socket says 172.21.15.88:60936) 2023-10-18T19:34:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd932bfe700 1 -- 172.21.15.88:0/2550929693 learned_addr learned my addr 172.21.15.88:0/2550929693 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 -- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 msgr2=0x7fd9341b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 -- 172.21.15.88:0/2550929693 >> v1:172.21.15.88:6789/0 conn(0x7fd9340f12d0 legacy=0x7fd9340f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 -- 172.21.15.88:0/2550929693 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93410d560 con 0x7fd9340f6680 2023-10-18T19:34:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd931bfc700 1 -- 172.21.15.88:0/2550929693 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374503797 0 0) 0x7fd92c001490 con 0x7fd9340f12d0 2023-10-18T19:34:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd932bfe700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd9323fd700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340f6680 0x7fd9341b2b90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd93410d1f0 tx=0x7fd92800ba20).ready entity=mon.0 client_cookie=a3150414652c1e40 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.899 7fd931bfc700 1 -- 172.21.15.88:0/2550929693 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd93410d560 con 0x7fd9340f6680 2023-10-18T19:34:36.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd931bfc700 1 -- 172.21.15.88:0/2550929693 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800d5c0 con 0x7fd9340f6680 2023-10-18T19:34:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd931bfc700 1 -- 172.21.15.88:0/2550929693 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd92800d990 con 0x7fd9340f6680 2023-10-18T19:34:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 -- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340f6680 msgr2=0x7fd9341b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340f6680 0x7fd9341b2b90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd93410d1f0 tx=0x7fd92800ba20).stop 2023-10-18T19:34:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 -- 172.21.15.88:0/2550929693 shutdown_connections 2023-10-18T19:34:36.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340f6230 0x7fd9341b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 --2- 172.21.15.88:0/2550929693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340f6680 0x7fd9341b2b90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 -- 172.21.15.88:0/2550929693 >> 172.21.15.88:0/2550929693 conn(0x7fd934117180 msgr2=0x7fd9340f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:36.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 -- 172.21.15.88:0/2550929693 shutdown_connections 2023-10-18T19:34:36.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.900 7fd93959d700 1 -- 172.21.15.88:0/2550929693 wait complete. 2023-10-18T19:34:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.924 7fd93959d700 1 Processor -- start 2023-10-18T19:34:36.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.924 7fd93959d700 1 -- start start 2023-10-18T19:34:36.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340deb40 0x7fd9340def90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9340df5c0 0x7fd9341c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:36.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340f69e0 con 0x7fd9340dddb0 2023-10-18T19:34:36.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340bbe20 con 0x7fd9340deb40 2023-10-18T19:34:36.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd93959d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340ca2d0 con 0x7fd9340df5c0 2023-10-18T19:34:36.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd932bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd932bfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33984/0 (socket says 172.21.15.88:33984) 2023-10-18T19:34:36.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd932bfe700 1 -- 172.21.15.88:0/139439455 learned_addr learned my addr 172.21.15.88:0/139439455 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:36.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.925 7fd9323fd700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340deb40 0x7fd9340def90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd9333ff700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9340df5c0 0x7fd9341c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:36.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 -- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9340df5c0 msgr2=0x7fd9341c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9340df5c0 0x7fd9341c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 -- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340deb40 msgr2=0x7fd9340def90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:36.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340deb40 0x7fd9340def90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:36.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 -- 172.21.15.88:0/139439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340bcc10 con 0x7fd9340dddb0 2023-10-18T19:34:36.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd932bfe700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd9340de830 tx=0x7fd92400ed30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:36.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9340bcc10 con 0x7fd9340dddb0 2023-10-18T19:34:36.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92400c7b0 con 0x7fd9340dddb0 2023-10-18T19:34:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd93959d700 1 -- 172.21.15.88:0/139439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340e01f0 con 0x7fd9340dddb0 2023-10-18T19:34:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.926 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd92400f040 con 0x7fd9340dddb0 2023-10-18T19:34:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.927 7fd93959d700 1 -- 172.21.15.88:0/139439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9341c40e0 con 0x7fd9340dddb0 2023-10-18T19:34:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.927 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd924011070 con 0x7fd9340dddb0 2023-10-18T19:34:36.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.927 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd924010040 con 0x7fd9340dddb0 2023-10-18T19:34:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.928 7fd93959d700 1 -- 172.21.15.88:0/139439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340f0320 con 0x7fd9340dddb0 2023-10-18T19:34:36.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:36.931 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd92400c5a0 con 0x7fd9340dddb0 2023-10-18T19:34:37.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.053 7fd93959d700 1 -- 172.21.15.88:0/139439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9340a5e40 con 0x7fd9340dddb0 2023-10-18T19:34:37.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.054 7fd923fff700 1 -- 172.21.15.88:0/139439455 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fd924000c30 con 0x7fd9340dddb0 2023-10-18T19:34:37.058 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:37.058 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:25.229238","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:37.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 >> v1:172.21.15.88:6800/107321 conn(0x7fd91001c1b0 legacy=0x7fd91001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 msgr2=0x7fd9340bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd9340de830 tx=0x7fd92400ed30).stop 2023-10-18T19:34:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 shutdown_connections 2023-10-18T19:34:37.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd9340df5c0 0x7fd9341c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9340dddb0 0x7fd9340bc5e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 --2- 172.21.15.88:0/139439455 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9340deb40 0x7fd9340def90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 >> 172.21.15.88:0/139439455 conn(0x7fd9340ca520 msgr2=0x7fd9340ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 shutdown_connections 2023-10-18T19:34:37.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.055 7fd93959d700 1 -- 172.21.15.88:0/139439455 wait complete. 2023-10-18T19:34:37.064 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 10 2023-10-18T19:34:37.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:25.229238', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:34:37.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-10-18T19:34:37.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T19:34:37.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.576 7fce1fbff700 1 Processor -- start 2023-10-18T19:34:37.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 -- start start 2023-10-18T19:34:37.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 0x7fce181b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce180abcd0 con 0x7fce181b35d0 2023-10-18T19:34:37.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce18112320 con 0x7fce1810d0a0 2023-10-18T19:34:37.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.577 7fce1fbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce180f6e10 con 0x7fce181b2b50 2023-10-18T19:34:37.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59380/0 (socket says 172.21.15.88:59380) 2023-10-18T19:34:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 -- 172.21.15.88:0/2642164115 learned_addr learned my addr 172.21.15.88:0/2642164115 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce1c9ff700 1 --1- 172.21.15.88:0/2642164115 >> v1:172.21.15.88:6789/0 conn(0x7fce181b35d0 0x7fce180f18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60942/0 (socket says 172.21.15.88:60942) 2023-10-18T19:34:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce0ffff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 0x7fce181b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce177fe700 1 -- 172.21.15.88:0/2642164115 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670389102 0 0) 0x7fce10001490 con 0x7fce181b35d0 2023-10-18T19:34:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce177fe700 1 -- 172.21.15.88:0/2642164115 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003270 con 0x7fce181b35d0 2023-10-18T19:34:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 -- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 msgr2=0x7fce181b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 0x7fce181b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 -- 172.21.15.88:0/2642164115 >> v1:172.21.15.88:6789/0 conn(0x7fce181b35d0 legacy=0x7fce180f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 -- 172.21.15.88:0/2642164115 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18111c30 con 0x7fce1810d0a0 2023-10-18T19:34:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce0ffff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 0x7fce181b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.578 7fce17fff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fce181124d0 tx=0x7fce08009ab0).ready entity=mon.1 client_cookie=19ca17aade87b489 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce177fe700 1 -- 172.21.15.88:0/2642164115 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce18111c30 con 0x7fce1810d0a0 2023-10-18T19:34:37.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce177fe700 1 -- 172.21.15.88:0/2642164115 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800f510 con 0x7fce1810d0a0 2023-10-18T19:34:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce177fe700 1 -- 172.21.15.88:0/2642164115 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce0800f6f0 con 0x7fce1810d0a0 2023-10-18T19:34:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 -- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 msgr2=0x7fce180f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fce181124d0 tx=0x7fce08009ab0).stop 2023-10-18T19:34:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 -- 172.21.15.88:0/2642164115 shutdown_connections 2023-10-18T19:34:37.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce1810d0a0 0x7fce180f67e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 --2- 172.21.15.88:0/2642164115 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce181b2b50 0x7fce181b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 -- 172.21.15.88:0/2642164115 >> 172.21.15.88:0/2642164115 conn(0x7fce18117770 msgr2=0x7fce180f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 -- 172.21.15.88:0/2642164115 shutdown_connections 2023-10-18T19:34:37.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.579 7fce1fbff700 1 -- 172.21.15.88:0/2642164115 wait complete. 2023-10-18T19:34:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.604 7fce1fbff700 1 Processor -- start 2023-10-18T19:34:37.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.604 7fce1fbff700 1 -- start start 2023-10-18T19:34:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 0x7fce180b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce18116840 con 0x7fce180d5760 2023-10-18T19:34:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce181b8a70 con 0x7fce180d0d80 2023-10-18T19:34:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1fbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce180d5f30 con 0x7fce180d11d0 2023-10-18T19:34:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59386/0 (socket says 172.21.15.88:59386) 2023-10-18T19:34:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33998/0 (socket says 172.21.15.88:33998) 2023-10-18T19:34:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 -- 172.21.15.88:0/4022447098 learned_addr learned my addr 172.21.15.88:0/4022447098 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1c9ff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 0x7fce180b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 -- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 msgr2=0x7fce180b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 0x7fce180b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 -- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 msgr2=0x7fce180d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce0ffff700 1 -- 172.21.15.88:0/4022447098 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180d5bb0 con 0x7fce180d0d80 2023-10-18T19:34:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce17fff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.605 7fce1c9ff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 0x7fce180b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce0ffff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce180d3240 tx=0x7fce0000ebf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce15ffb700 1 -- 172.21.15.88:0/4022447098 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce180d5bb0 con 0x7fce180d0d80 2023-10-18T19:34:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce15ffb700 1 -- 172.21.15.88:0/4022447098 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0000ee60 con 0x7fce180d0d80 2023-10-18T19:34:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce15ffb700 1 -- 172.21.15.88:0/4022447098 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce0000f040 con 0x7fce180d0d80 2023-10-18T19:34:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce1fbff700 1 -- 172.21.15.88:0/4022447098 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce18117020 con 0x7fce180d0d80 2023-10-18T19:34:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.606 7fce1fbff700 1 -- 172.21.15.88:0/4022447098 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce180b4550 con 0x7fce180d0d80 2023-10-18T19:34:37.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.607 7fce15ffb700 1 -- 172.21.15.88:0/4022447098 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fce00011070 con 0x7fce180d0d80 2023-10-18T19:34:37.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.607 7fce15ffb700 1 -- 172.21.15.88:0/4022447098 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fce00010040 con 0x7fce180d0d80 2023-10-18T19:34:37.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.610 7fce38a49b80 1 Processor -- start 2023-10-18T19:34:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.610 7fce38a49b80 1 -- start start 2023-10-18T19:34:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 0x55ec20ed5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ed5bb0 0x55ec20ee1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec20df1440 con 0x55ec20ed5130 2023-10-18T19:34:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec20c20fb0 con 0x55ec20ee1f90 2023-10-18T19:34:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce38a49b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec20ddc1b0 con 0x55ec20ed5bb0 2023-10-18T19:34:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce0ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ed5bb0 0x55ec20ee1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59400/0 (socket says 172.21.15.88:59400) 2023-10-18T19:34:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 0x55ec20ed5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 -- 172.21.15.88:0/3609974419 learned_addr learned my addr 172.21.15.88:0/3609974419 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 -- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ed5bb0 msgr2=0x55ec20ee1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ed5bb0 0x55ec20ee1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 -- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 msgr2=0x55ec20ed5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 0x55ec20ed5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce1c9ff700 1 -- 172.21.15.88:0/3609974419 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec20e8e820 con 0x55ec20ee1f90 2023-10-18T19:34:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.611 7fce17fff700 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 0x55ec20ed5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce1c9ff700 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x55ec20eb4420 tx=0x7fce10004b90).ready entity=mon.1 client_cookie=e1f66acde9e5c1d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce1fbff700 1 -- 172.21.15.88:0/3609974419 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ec20e8e820 con 0x55ec20ee1f90 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce1fbff700 1 -- 172.21.15.88:0/3609974419 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce10007500 con 0x55ec20ee1f90 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce1fbff700 1 -- 172.21.15.88:0/3609974419 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce10010040 con 0x55ec20ee1f90 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce38a49b80 1 -- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 msgr2=0x55ec20ef1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.612 7fce38a49b80 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x55ec20eb4420 tx=0x7fce10004b90).stop 2023-10-18T19:34:37.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 -- 172.21.15.88:0/3609974419 shutdown_connections 2023-10-18T19:34:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee1f90 0x55ec20ef1540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20ed5130 0x55ec20ed5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 --2- 172.21.15.88:0/3609974419 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ed5bb0 0x55ec20ee1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 -- 172.21.15.88:0/3609974419 >> 172.21.15.88:0/3609974419 conn(0x55ec20eb5570 msgr2=0x55ec20eb2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 -- 172.21.15.88:0/3609974419 shutdown_connections 2023-10-18T19:34:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 -- 172.21.15.88:0/3609974419 wait complete. 2023-10-18T19:34:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 -- start start 2023-10-18T19:34:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.613 7fce38a49b80 1 Processor -- start 2023-10-18T19:34:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 0x55ec20ed3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee6120 0x55ec20ee6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 0x55ec20ef9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec20dd8e70 con 0x55ec20eba870 2023-10-18T19:34:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ec20edf340 con 0x55ec20ee6120 2023-10-18T19:34:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55ec20ee6ff0 con 0x55ec20ee6ba0 2023-10-18T19:34:37.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce1c9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 0x55ec20ef9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 0x55ec20ed3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce1c9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 0x55ec20ef9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37366/0 (socket says 172.21.15.88:37366) 2023-10-18T19:34:37.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce1c9ff700 1 -- 172.21.15.88:0/1921219885 learned_addr learned my addr 172.21.15.88:0/1921219885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce38a49b80 10 client.0 ll_register_callbacks cb 0x55ec20e10ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.614 7fce0ffff700 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee6120 0x55ec20ee6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 -- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 msgr2=0x55ec20ef9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 0x55ec20ef9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 -- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee6120 msgr2=0x55ec20ee6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee6120 0x55ec20ee6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 -- 172.21.15.88:0/1921219885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec20ce9f00 con 0x55ec20eba870 2023-10-18T19:34:37.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce17fff700 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 0x55ec20ed3a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x55ec20eba420 tx=0x7fce0801f6f0).ready entity=mon.0 client_cookie=11e6db74cf08a2d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fcdf67fc700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-18T19:34:37.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55ec20ce9f00 con 0x55ec20eba870 2023-10-18T19:34:37.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fce0801f890 con 0x55ec20eba870 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.615 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec20e85500 con 0x55ec20eba870 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce0801fb00 con 0x55ec20eba870 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 10 client.4617 fetch_fsmap learned FSMap version 10 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x55ec20ed4080 con 0x55ec20eba870 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ec20e85500 con 0x55ec20eba870 2023-10-18T19:34:37.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7fce0801ebe0 con 0x55ec20eba870 2023-10-18T19:34:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 10 client.4617 fetch_fsmap finished waiting for FSMap version 10 2023-10-18T19:34:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 10 client.4617 resolve_mds: resolved ID 'b' to GID 4180 2023-10-18T19:34:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 20 client.4617 populate_metadata read hostname 'smithi088' 2023-10-18T19:34:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 4 client.4617 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T19:34:37.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 --> v1:172.21.15.88:6817/2557744719 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec20dfa490 con 0x55ec20efa140 2023-10-18T19:34:37.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.616 7fcdf67fc700 10 client.4617 ms_handle_connect on v1:172.21.15.88:6817/2557744719 2023-10-18T19:34:37.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fcdf67fc700 1 -- 172.21.15.88:0/1921219885 <== mds.0 v1:172.21.15.88:6817/2557744719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55ec20dfa490 con 0x55ec20efa140 2023-10-18T19:34:37.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fcdf67fc700 10 client.4617 handle_command_reply: tid=0 2023-10-18T19:34:37.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 client.4617 shutdown 2023-10-18T19:34:37.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 msgr2=0x55ec20ed3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 0x55ec20ed3a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x55ec20eba420 tx=0x7fce0801f6f0).stop 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 shutdown_connections 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55ec20ee6ba0 0x55ec20ef9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ec20eba870 0x55ec20ed3a50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 --2- 172.21.15.88:0/1921219885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55ec20ee6120 0x55ec20ee6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fcdf67fc700 0 client.4617 ms_handle_reset on v1:172.21.15.88:6817/2557744719 2023-10-18T19:34:37.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 >> 172.21.15.88:0/1921219885 conn(0x55ec20ed4560 msgr2=0x55ec20ec8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 shutdown_connections 2023-10-18T19:34:37.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 1 -- 172.21.15.88:0/1921219885 wait complete. 2023-10-18T19:34:37.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.617 7fce38a49b80 20 client.4617 trim_cache size 0 max 16384 2023-10-18T19:34:37.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 >> v1:172.21.15.88:6800/107321 conn(0x7fcdfc01c1b0 legacy=0x7fcdfc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 msgr2=0x7fce180b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fce180d3240 tx=0x7fce0000ebf0).stop 2023-10-18T19:34:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 shutdown_connections 2023-10-18T19:34:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce180d11d0 0x7fce180b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce180d5760 0x7fce180d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 --2- 172.21.15.88:0/4022447098 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce180d0d80 0x7fce180b3710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 >> 172.21.15.88:0/4022447098 conn(0x7fce180bdd40 msgr2=0x7fce180e0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 shutdown_connections 2023-10-18T19:34:37.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.627 7fce0cfff700 1 -- 172.21.15.88:0/4022447098 wait complete. 2023-10-18T19:34:37.640 INFO:teuthology.orchestra.run.smithi088.stderr:no valid command found; 10 closest matches: 2023-10-18T19:34:37.641 INFO:teuthology.orchestra.run.smithi088.stderr:injectargs [...] 2023-10-18T19:34:37.641 INFO:teuthology.orchestra.run.smithi088.stderr:config set 2023-10-18T19:34:37.641 INFO:teuthology.orchestra.run.smithi088.stderr:config unset 2023-10-18T19:34:37.641 INFO:teuthology.orchestra.run.smithi088.stderr:exit 2023-10-18T19:34:37.641 INFO:teuthology.orchestra.run.smithi088.stderr:respawn 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:session kill 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:cpu_profiler status|flush 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:session ls { [...]} 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:client ls { [...]} 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:session evict { [...]} 2023-10-18T19:34:37.642 INFO:teuthology.orchestra.run.smithi088.stderr:Error EINVAL: invalid command 2023-10-18T19:34:37.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-18T19:34:37.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-18T19:34:37.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.845 7f87c89fe700 1 Processor -- start 2023-10-18T19:34:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.845 7f87c89fe700 1 -- start start 2023-10-18T19:34:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.845 7f87c89fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87c4116050 0x7f87c40f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.845 7f87c89fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 0x7f87c40f1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c89fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c40ab1c0 con 0x7f87c41b2880 2023-10-18T19:34:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c89fe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c40f1ff0 con 0x7f87c4116050 2023-10-18T19:34:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c89fe700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c410cf90 con 0x7f87c41164a0 2023-10-18T19:34:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 0x7f87c40f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 0x7f87c40f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37370/0 (socket says 172.21.15.88:37370) 2023-10-18T19:34:37.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c0dfd700 1 -- 172.21.15.88:0/3458224609 learned_addr learned my addr 172.21.15.88:0/3458224609 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c15fe700 1 --2- 172.21.15.88:0/3458224609 >> v2:172.21.15.88:3300/0 conn(0x7f87c4116050 0x7f87c40f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c15fe700 1 -- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 msgr2=0x7f87c40f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c15fe700 1 --2- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 0x7f87c40f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c15fe700 1 -- 172.21.15.88:0/3458224609 >> v1:172.21.15.88:6789/0 conn(0x7f87c41b2880 legacy=0x7f87c41b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87c15fe700 1 -- 172.21.15.88:0/3458224609 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4116b90 con 0x7f87c4116050 2023-10-18T19:34:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.846 7f87b3fff700 1 -- 172.21.15.88:0/3458224609 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091131245 0 0) 0x7f87bc001490 con 0x7f87c41b2880 2023-10-18T19:34:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c15fe700 1 --2- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c4116050 0x7f87c40f0d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f87c410d140 tx=0x7f87b400ba20).ready entity=mon.0 client_cookie=339337433dd63c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87b3fff700 1 -- 172.21.15.88:0/3458224609 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87c4116b90 con 0x7f87c4116050 2023-10-18T19:34:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87b3fff700 1 -- 172.21.15.88:0/3458224609 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b400d5c0 con 0x7f87c4116050 2023-10-18T19:34:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87b3fff700 1 -- 172.21.15.88:0/3458224609 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87b400d9e0 con 0x7f87c4116050 2023-10-18T19:34:37.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 -- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c4116050 msgr2=0x7f87c40f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 --2- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c4116050 0x7f87c40f0d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f87c410d140 tx=0x7f87b400ba20).stop 2023-10-18T19:34:37.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 -- 172.21.15.88:0/3458224609 shutdown_connections 2023-10-18T19:34:37.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 --2- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c4116050 0x7f87c40f0d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 --2- 172.21.15.88:0/3458224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c41164a0 0x7f87c40f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.847 7f87c89fe700 1 -- 172.21.15.88:0/3458224609 >> 172.21.15.88:0/3458224609 conn(0x7f87c4125be0 msgr2=0x7f87c4126030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.848 7f87c89fe700 1 -- 172.21.15.88:0/3458224609 shutdown_connections 2023-10-18T19:34:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.848 7f87c89fe700 1 -- 172.21.15.88:0/3458224609 wait complete. 2023-10-18T19:34:37.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.872 7f87c89fe700 1 Processor -- start 2023-10-18T19:34:37.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.872 7f87c89fe700 1 -- start start 2023-10-18T19:34:37.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 0x7f87c40d4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 0x7f87c41c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40d65c0 con 0x7f87c40d4a90 2023-10-18T19:34:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40cad80 con 0x7f87c40ca7f0 2023-10-18T19:34:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c89fe700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40d5b50 con 0x7f87c40d4010 2023-10-18T19:34:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c1dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 0x7f87c41c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 0x7f87c40d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59420/0 (socket says 172.21.15.88:59420) 2023-10-18T19:34:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c15fe700 1 -- 172.21.15.88:0/1324998602 learned_addr learned my addr 172.21.15.88:0/1324998602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 -- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 msgr2=0x7f87c4122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 -- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 msgr2=0x7f87c41c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 0x7f87c41c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.873 7f87c0dfd700 1 -- 172.21.15.88:0/1324998602 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c40ca430 con 0x7f87c40d4010 2023-10-18T19:34:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87c15fe700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87c1dff700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 0x7f87c41c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87c0dfd700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 0x7f87c40d4460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f87c40b8550 tx=0x7f87b800ea60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87b27fc700 1 -- 172.21.15.88:0/1324998602 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87c40ca430 con 0x7f87c40d4010 2023-10-18T19:34:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87b27fc700 1 -- 172.21.15.88:0/1324998602 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8012600 con 0x7f87c40d4010 2023-10-18T19:34:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87c89fe700 1 -- 172.21.15.88:0/1324998602 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c41c65a0 con 0x7f87c40d4010 2023-10-18T19:34:37.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87b27fc700 1 -- 172.21.15.88:0/1324998602 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87b800f040 con 0x7f87c40d4010 2023-10-18T19:34:37.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.874 7f87c89fe700 1 -- 172.21.15.88:0/1324998602 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41c6af0 con 0x7f87c40d4010 2023-10-18T19:34:37.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.875 7f87b27fc700 1 -- 172.21.15.88:0/1324998602 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f87b8022060 con 0x7f87c40d4010 2023-10-18T19:34:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.875 7f87b27fc700 1 -- 172.21.15.88:0/1324998602 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f87b8010040 con 0x7f87c40d4010 2023-10-18T19:34:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.878 7f87e2047b80 1 Processor -- start 2023-10-18T19:34:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.878 7f87e2047b80 1 -- start start 2023-10-18T19:34:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 0x55667a6b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a6b4f90 0x55667a6c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667a5c4440 con 0x55667a6a8bb0 2023-10-18T19:34:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55667a3f3fb0 con 0x55667a6a8130 2023-10-18T19:34:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87e2047b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55667a5af1b0 con 0x55667a6b4f90 2023-10-18T19:34:37.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59434/0 (socket says 172.21.15.88:59434) 2023-10-18T19:34:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 -- 172.21.15.88:0/2941695583 learned_addr learned my addr 172.21.15.88:0/2941695583 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c1dff700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a6b4f90 0x55667a6c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c0dfd700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 0x55667a6b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 -- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a6b4f90 msgr2=0x55667a6c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a6b4f90 0x55667a6c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 -- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 msgr2=0x55667a6b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 0x55667a6b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c15fe700 1 -- 172.21.15.88:0/2941695583 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55667a661820 con 0x55667a6a8130 2023-10-18T19:34:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.879 7f87c0dfd700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 0x55667a6b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87c15fe700 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x55667a687420 tx=0x7f87b4006830).ready entity=mon.1 client_cookie=e2bb700ef4898a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87c89fe700 1 -- 172.21.15.88:0/2941695583 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55667a661820 con 0x55667a6a8130 2023-10-18T19:34:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87c89fe700 1 -- 172.21.15.88:0/2941695583 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b400dca0 con 0x55667a6a8130 2023-10-18T19:34:37.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87c89fe700 1 -- 172.21.15.88:0/2941695583 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f87b401f630 con 0x55667a6a8130 2023-10-18T19:34:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87e2047b80 1 -- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 msgr2=0x55667a6a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.880 7f87e2047b80 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x55667a687420 tx=0x7f87b4006830).stop 2023-10-18T19:34:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 -- 172.21.15.88:0/2941695583 shutdown_connections 2023-10-18T19:34:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a6b4f90 0x55667a6c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a6a8130 0x55667a6a8580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 --2- 172.21.15.88:0/2941695583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6a8bb0 0x55667a6b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 -- 172.21.15.88:0/2941695583 >> 172.21.15.88:0/2941695583 conn(0x55667a688570 msgr2=0x55667a685ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 -- 172.21.15.88:0/2941695583 shutdown_connections 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 -- 172.21.15.88:0/2941695583 wait complete. 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 -- start start 2023-10-18T19:34:37.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.881 7f87e2047b80 1 Processor -- start 2023-10-18T19:34:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 0x55667a6c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a68c130 0x55667a6cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55667a5abe70 con 0x55667a6c59d0 2023-10-18T19:34:37.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55667a6b8e90 con 0x55667a68c130 2023-10-18T19:34:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55667a6963e0 con 0x55667a68b6b0 2023-10-18T19:34:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87e2047b80 10 client.0 ll_register_callbacks cb 0x55667a5e3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T19:34:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87c0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87c0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37406/0 (socket says 172.21.15.88:37406) 2023-10-18T19:34:37.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87c0dfd700 1 -- 172.21.15.88:0/2581384728 learned_addr learned my addr 172.21.15.88:0/2581384728 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.882 7f87c15fe700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 0x55667a6c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c1dff700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a68c130 0x55667a6cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 -- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 msgr2=0x55667a68bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 -- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a68c130 msgr2=0x55667a6cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a68c130 0x55667a6cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 -- 172.21.15.88:0/2581384728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55667a4bcf00 con 0x55667a6c59d0 2023-10-18T19:34:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c0dfd700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87c15fe700 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 0x55667a6c5e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x55667a68de50 tx=0x7f87b4006da0).ready entity=mon.0 client_cookie=e2a0bcc543131a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:37.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f879bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-10-18T19:34:37.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55667a4bcf00 con 0x55667a6c59d0 2023-10-18T19:34:37.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f87b401f9f0 con 0x55667a6c59d0 2023-10-18T19:34:37.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55667a658500 con 0x55667a6c59d0 2023-10-18T19:34:37.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b401fc60 con 0x55667a6c59d0 2023-10-18T19:34:37.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87e2047b80 10 client.4632 fetch_fsmap learned FSMap version 10 2023-10-18T19:34:37.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.883 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x55667a6c6450 con 0x55667a6c59d0 2023-10-18T19:34:37.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55667a658500 con 0x55667a6c59d0 2023-10-18T19:34:37.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 10) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f87b4029070 con 0x55667a6c59d0 2023-10-18T19:34:37.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f87e2047b80 10 client.4632 fetch_fsmap finished waiting for FSMap version 10 2023-10-18T19:34:37.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f87e2047b80 10 client.4632 resolve_mds: resolved ID 'c' to GID 4186 2023-10-18T19:34:37.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f87e2047b80 20 client.4632 populate_metadata read hostname 'smithi088' 2023-10-18T19:34:37.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f87e2047b80 4 client.4632 mds_command: new command op to 4186 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T19:34:37.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 --> v1:172.21.15.88:6819/159784871 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55667a5cd490 con 0x55667a6cd470 2023-10-18T19:34:37.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.884 7f879bfff700 10 client.4632 ms_handle_connect on v1:172.21.15.88:6819/159784871 2023-10-18T19:34:37.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f879bfff700 1 -- 172.21.15.88:0/2581384728 <== mds.1 v1:172.21.15.88:6819/159784871 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55667a5cd490 con 0x55667a6cd470 2023-10-18T19:34:37.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f879bfff700 10 client.4632 handle_command_reply: tid=0 2023-10-18T19:34:37.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 client.4632 shutdown 2023-10-18T19:34:37.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 msgr2=0x55667a6c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 0x55667a6c5e20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x55667a68de50 tx=0x7f87b4006da0).stop 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 shutdown_connections 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55667a68c130 0x55667a6cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55667a6c59d0 0x55667a6c5e20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 --2- 172.21.15.88:0/2581384728 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55667a68b6b0 0x55667a68bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f879bfff700 0 client.4632 ms_handle_reset on v1:172.21.15.88:6819/159784871 2023-10-18T19:34:37.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 >> 172.21.15.88:0/2581384728 conn(0x55667a6a7560 msgr2=0x55667a69beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 shutdown_connections 2023-10-18T19:34:37.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 1 -- 172.21.15.88:0/2581384728 wait complete. 2023-10-18T19:34:37.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.885 7f87e2047b80 20 client.4632 trim_cache size 0 max 16384 2023-10-18T19:34:37.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 >> v1:172.21.15.88:6800/107321 conn(0x7f87a001c1b0 legacy=0x7f87a001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 msgr2=0x7f87c40d4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:37.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 0x7f87c40d4460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f87c40b8550 tx=0x7f87b800ea60).stop 2023-10-18T19:34:37.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 shutdown_connections 2023-10-18T19:34:37.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87c40d4a90 0x7f87c41c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87c40ca7f0 0x7f87c4122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 --2- 172.21.15.88:0/1324998602 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87c40d4010 0x7f87c40d4460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:37.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 >> 172.21.15.88:0/1324998602 conn(0x7f87c40d89a0 msgr2=0x7f87c41b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:37.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 shutdown_connections 2023-10-18T19:34:37.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:37.895 7f87a63ff700 1 -- 172.21.15.88:0/1324998602 wait complete. 2023-10-18T19:34:37.909 INFO:teuthology.orchestra.run.smithi088.stderr:no valid command found; 10 closest matches: 2023-10-18T19:34:37.910 INFO:teuthology.orchestra.run.smithi088.stderr:injectargs [...] 2023-10-18T19:34:37.910 INFO:teuthology.orchestra.run.smithi088.stderr:config set 2023-10-18T19:34:37.910 INFO:teuthology.orchestra.run.smithi088.stderr:config unset 2023-10-18T19:34:37.910 INFO:teuthology.orchestra.run.smithi088.stderr:exit 2023-10-18T19:34:37.910 INFO:teuthology.orchestra.run.smithi088.stderr:respawn 2023-10-18T19:34:37.911 INFO:teuthology.orchestra.run.smithi088.stderr:session kill 2023-10-18T19:34:37.911 INFO:teuthology.orchestra.run.smithi088.stderr:cpu_profiler status|flush 2023-10-18T19:34:37.911 INFO:teuthology.orchestra.run.smithi088.stderr:session ls { [...]} 2023-10-18T19:34:37.911 INFO:teuthology.orchestra.run.smithi088.stderr:client ls { [...]} 2023-10-18T19:34:37.912 INFO:teuthology.orchestra.run.smithi088.stderr:session evict { [...]} 2023-10-18T19:34:37.912 INFO:teuthology.orchestra.run.smithi088.stderr:Error EINVAL: invalid command 2023-10-18T19:34:37.913 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-18T19:34:37.915 INFO:teuthology.run_tasks:Running task exec... 2023-10-18T19:34:37.924 INFO:teuthology.task.exec:Executing custom commands... 2023-10-18T19:34:37.925 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:34:37.925 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client nautilus' 2023-10-18T19:34:38.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.118 7f18f37ff700 1 Processor -- start 2023-10-18T19:34:38.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.118 7f18f37ff700 1 -- start start 2023-10-18T19:34:38.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18f37ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18f37ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18f37ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec0ffd70 con 0x7f18ec103f50 2023-10-18T19:34:38.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18f37ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec111ae0 con 0x7f18ec103b00 2023-10-18T19:34:38.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18f37ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1043a0 con 0x7f18ec0f6940 2023-10-18T19:34:38.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eaffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37412/0 (socket says 172.21.15.88:37412) 2023-10-18T19:34:38.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eaffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59452/0 (socket says 172.21.15.88:59452) 2023-10-18T19:34:38.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 -- 172.21.15.88:0/991450648 learned_addr learned my addr 172.21.15.88:0/991450648 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:38.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18ebfff700 1 --1- 172.21.15.88:0/991450648 >> v1:172.21.15.88:6789/0 conn(0x7f18ec103f50 0x7f18ec1b85b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60964/0 (socket says 172.21.15.88:60964) 2023-10-18T19:34:38.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 -- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 msgr2=0x7f18ec1b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:38.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18ea7fc700 1 -- 172.21.15.88:0/991450648 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805552005 0 0) 0x7f18e4001490 con 0x7f18ec103f50 2023-10-18T19:34:38.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 -- 172.21.15.88:0/991450648 >> v1:172.21.15.88:6789/0 conn(0x7f18ec103f50 legacy=0x7f18ec1b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eb7fe700 1 -- 172.21.15.88:0/991450648 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec10c700 con 0x7f18ec0f6940 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.119 7f18eaffd700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18eb7fe700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f18dc002f70 tx=0x7f18dc009a00).ready entity=mon.2 client_cookie=a515de6f6927cf9c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18ea7fc700 1 -- 172.21.15.88:0/991450648 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18ec10c700 con 0x7f18ec0f6940 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18ea7fc700 1 -- 172.21.15.88:0/991450648 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00f510 con 0x7f18ec0f6940 2023-10-18T19:34:38.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18ea7fc700 1 -- 172.21.15.88:0/991450648 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc00f6f0 con 0x7f18ec0f6940 2023-10-18T19:34:38.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18f37ff700 1 -- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 msgr2=0x7f18ec1034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.120 7f18f37ff700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f18dc002f70 tx=0x7f18dc009a00).stop 2023-10-18T19:34:38.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 -- 172.21.15.88:0/991450648 shutdown_connections 2023-10-18T19:34:38.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec0f6940 0x7f18ec1034d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 --2- 172.21.15.88:0/991450648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec103b00 0x7f18ec1b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 -- 172.21.15.88:0/991450648 >> 172.21.15.88:0/991450648 conn(0x7f18ec1176b0 msgr2=0x7f18ec0f3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:38.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 -- 172.21.15.88:0/991450648 shutdown_connections 2023-10-18T19:34:38.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.121 7f18f37ff700 1 -- 172.21.15.88:0/991450648 wait complete. 2023-10-18T19:34:38.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.145 7f18f37ff700 1 Processor -- start 2023-10-18T19:34:38.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.145 7f18f37ff700 1 -- start start 2023-10-18T19:34:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.145 7f18f37ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18f37ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 0x7f18ec0d6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18f37ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 0x7f18ec1c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18f37ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1b7a20 con 0x7f18ec1c5ad0 2023-10-18T19:34:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18f37ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1b7d60 con 0x7f18ec1b8650 2023-10-18T19:34:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18f37ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1b9340 con 0x7f18ec1b8200 2023-10-18T19:34:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eaffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 0x7f18ec0d6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18ebfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 0x7f18ec1c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:37422/0 (socket says 172.21.15.88:37422) 2023-10-18T19:34:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 -- 172.21.15.88:0/3841596017 learned_addr learned my addr 172.21.15.88:0/3841596017 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eaffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 0x7f18ec0d6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59466/0 (socket says 172.21.15.88:59466) 2023-10-18T19:34:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 -- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 msgr2=0x7f18ec0d6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 0x7f18ec0d6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 -- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 msgr2=0x7f18ec1c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 0x7f18ec1c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 -- 172.21.15.88:0/3841596017 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec1c36f0 con 0x7f18ec1b8200 2023-10-18T19:34:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18ebfff700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 0x7f18ec1c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.146 7f18eb7fe700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f18dc002f70 tx=0x7f18dc0068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.147 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18ec1c36f0 con 0x7f18ec1b8200 2023-10-18T19:34:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.147 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0117e0 con 0x7f18ec1b8200 2023-10-18T19:34:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.147 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec1b8d40 con 0x7f18ec1b8200 2023-10-18T19:34:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.147 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f18dc011bb0 con 0x7f18ec1b8200 2023-10-18T19:34:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.147 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec1c6550 con 0x7f18ec1b8200 2023-10-18T19:34:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.148 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f18dc027460 con 0x7f18ec1b8200 2023-10-18T19:34:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.148 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f18dc029d90 con 0x7f18ec1b8200 2023-10-18T19:34:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.148 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec0f0850 con 0x7f18ec1b8200 2023-10-18T19:34:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.151 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f18dc0115d0 con 0x7f18ec1b8200 2023-10-18T19:34:38.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.259 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "nautilus"} v 0) v1 -- 0x7f18ec111500 con 0x7f18ec1b8200 2023-10-18T19:34:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.279 7f18e8ff9700 1 -- 172.21.15.88:0/3841596017 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "nautilus"}]=0 set require_min_compat_client to nautilus v17) v1 ==== 145+0+0 (secure 0 0 0) 0x7f18dc00f300 con 0x7f18ec1b8200 2023-10-18T19:34:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 >> v1:172.21.15.88:6800/107321 conn(0x7f18cc01c1b0 legacy=0x7f18cc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 msgr2=0x7f18ec0d60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f18dc002f70 tx=0x7f18dc0068c0).stop 2023-10-18T19:34:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 shutdown_connections 2023-10-18T19:34:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18ec1c5ad0 0x7f18ec1c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18ec1b8200 0x7f18ec0d60f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 --2- 172.21.15.88:0/3841596017 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18ec1b8650 0x7f18ec0d6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.281 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 >> 172.21.15.88:0/3841596017 conn(0x7f18ec0e0830 msgr2=0x7f18ec0df580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.282 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 shutdown_connections 2023-10-18T19:34:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:38.282 7f18f37ff700 1 -- 172.21.15.88:0/3841596017 wait complete. 2023-10-18T19:34:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:set require_min_compat_client to nautilus 2023-10-18T19:34:38.302 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:34:38.312 INFO:teuthology.task.print:**** done ceph 2023-10-18T19:34:38.313 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-18T19:34:38.369 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-18T19:34:38.370 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2023-10-18T19:34:38.370 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-18T19:34:38.370 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-18T19:34:38.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:38.371 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-18T19:34:38.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:38.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-18T19:34:38.501 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-18T19:34:38.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:34:38.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:38.505 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-18T19:34:38.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:38.558 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-18T19:34:38.637 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-18T19:34:38.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:34:38.640 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-18T19:34:38.640 DEBUG:teuthology.orchestra.run.smithi184:> ceph fs ls 2023-10-18T19:34:38.810 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.807 7f67d8fff700 1 Processor -- start 2023-10-18T19:34:38.810 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.807 7f67d8fff700 1 -- start start 2023-10-18T19:34:38.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.808 7f67d8fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.808 7f67d8fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.808 7f67d8fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d418e220 con 0x7f67d4185c90 2023-10-18T19:34:38.811 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.808 7f67d8fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d418f450 con 0x7f67d417fdd0 2023-10-18T19:34:38.812 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.808 7f67d8fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d418f650 con 0x7f67d4185160 2023-10-18T19:34:38.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d11fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d09fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d19ff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f67d4185c90 0x7f67d418c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.184:45054/0 (socket says 172.21.15.184:45054) 2023-10-18T19:34:38.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d11fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.184:45746/0 (socket says 172.21.15.184:45746) 2023-10-18T19:34:38.815 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d09fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.184:42602/0 (socket says 172.21.15.184:42602) 2023-10-18T19:34:38.815 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67d19ff700 1 -- 172.21.15.184:0/2314867026 learned_addr learned my addr 172.21.15.184:0/2314867026 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-18T19:34:38.815 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.809 7f67c3fff700 1 -- 172.21.15.184:0/2314867026 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656125642 0 0) 0x7f67cc001490 con 0x7f67d4185c90 2023-10-18T19:34:38.815 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67c3fff700 1 -- 172.21.15.184:0/2314867026 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b8003270 con 0x7f67d4185c90 2023-10-18T19:34:38.815 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d09fd700 1 -- 172.21.15.184:0/2314867026 >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 msgr2=0x7f67d4180220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:38.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d09fd700 1 --2- 172.21.15.184:0/2314867026 >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d09fd700 1 -- 172.21.15.184:0/2314867026 >> v1:172.21.15.88:6789/0 conn(0x7f67d4185c90 legacy=0x7f67d418c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d09fd700 1 -- 172.21.15.184:0/2314867026 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d418f880 con 0x7f67d4185160 2023-10-18T19:34:38.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d11fe700 1 --2- 172.21.15.184:0/2314867026 >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:38.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d09fd700 1 --2- 172.21.15.184:0/2314867026 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f67c8002f70 tx=0x7f67c800b970).ready entity=mon.1 client_cookie=e30fdd6ec0e9487c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:38.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67c3fff700 1 -- 172.21.15.184:0/2314867026 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67d418f880 con 0x7f67d4185160 2023-10-18T19:34:38.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67c3fff700 1 -- 172.21.15.184:0/2314867026 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c800d5c0 con 0x7f67d4185160 2023-10-18T19:34:38.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67c3fff700 1 -- 172.21.15.184:0/2314867026 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67c800d990 con 0x7f67d4185160 2023-10-18T19:34:38.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d8fff700 1 -- 172.21.15.184:0/2314867026 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 msgr2=0x7f67d41855b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.810 7f67d8fff700 1 --2- 172.21.15.184:0/2314867026 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f67c8002f70 tx=0x7f67c800b970).stop 2023-10-18T19:34:38.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 -- 172.21.15.184:0/2314867026 shutdown_connections 2023-10-18T19:34:38.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 --2- 172.21.15.184:0/2314867026 >> v2:172.21.15.88:3300/0 conn(0x7f67d417fdd0 0x7f67d4180220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 --2- 172.21.15.184:0/2314867026 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4185160 0x7f67d41855b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 -- 172.21.15.184:0/2314867026 >> 172.21.15.184:0/2314867026 conn(0x7f67d40f4d10 msgr2=0x7f67d417dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:38.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 -- 172.21.15.184:0/2314867026 shutdown_connections 2023-10-18T19:34:38.819 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.811 7f67d8fff700 1 -- 172.21.15.184:0/2314867026 wait complete. 2023-10-18T19:34:38.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 Processor -- start 2023-10-18T19:34:38.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 -- start start 2023-10-18T19:34:38.840 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 0x7f67d41966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67d4196df0 0x7f67d419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:38.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.836 7f67d8fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d419e160 con 0x7f67d4196280 2023-10-18T19:34:38.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d8fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d419e340 con 0x7f67d4190fd0 2023-10-18T19:34:38.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d8fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67d419e570 con 0x7f67d4196df0 2023-10-18T19:34:38.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d09fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 0x7f67d41966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.184:42606/0 (socket says 172.21.15.184:42606) 2023-10-18T19:34:38.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d09fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 0x7f67d41966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.184:45752/0 (socket says 172.21.15.184:45752) 2023-10-18T19:34:38.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 -- 172.21.15.184:0/3142488279 learned_addr learned my addr 172.21.15.184:0/3142488279 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-18T19:34:38.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d19ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67d4196df0 0x7f67d419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:38.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 -- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67d4196df0 msgr2=0x7f67d419d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67d4196df0 0x7f67d419d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 -- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 msgr2=0x7f67d41966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 0x7f67d41966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.837 7f67d11fe700 1 -- 172.21.15.184:0/3142488279 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d41852d0 con 0x7f67d4190fd0 2023-10-18T19:34:38.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67d11fe700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f67c400c000 tx=0x7f67c400ec70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:38.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67d41852d0 con 0x7f67d4190fd0 2023-10-18T19:34:38.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c400c9a0 con 0x7f67d4190fd0 2023-10-18T19:34:38.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d40f24d0 con 0x7f67d4190fd0 2023-10-18T19:34:38.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f67c400f040 con 0x7f67d4190fd0 2023-10-18T19:34:38.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.838 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d40f2b00 con 0x7f67d4190fd0 2023-10-18T19:34:38.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.839 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f67c4011070 con 0x7f67d4190fd0 2023-10-18T19:34:38.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.839 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f67c4010040 con 0x7f67d4190fd0 2023-10-18T19:34:38.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.839 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d40f03b0 con 0x7f67d4190fd0 2023-10-18T19:34:38.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.842 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f67c400c5a0 con 0x7f67d4190fd0 2023-10-18T19:34:38.962 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.960 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f67d40a6b50 con 0x7f67d4190fd0 2023-10-18T19:34:38.963 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.961 7f67c27fc700 1 -- 172.21.15.184:0/3142488279 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+73 (secure 0 0 0) 0x7f67c4000c30 con 0x7f67d4190fd0 2023-10-18T19:34:38.963 INFO:teuthology.orchestra.run.smithi184.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T19:34:38.964 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 >> v1:172.21.15.88:6800/107321 conn(0x7f67b001c1b0 legacy=0x7f67b001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.965 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 msgr2=0x7f67d4191420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:38.965 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f67c400c000 tx=0x7f67c400ec70).stop 2023-10-18T19:34:38.965 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 shutdown_connections 2023-10-18T19:34:38.965 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f67d4196df0 0x7f67d419d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f67d4190fd0 0x7f67d4191420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 --2- 172.21.15.184:0/3142488279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4196280 0x7f67d41966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:38.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 >> 172.21.15.184:0/3142488279 conn(0x7f67d40bdf00 msgr2=0x7f67d40be350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:38.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 shutdown_connections 2023-10-18T19:34:38.966 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-18 19:34:38.962 7f67d8fff700 1 -- 172.21.15.184:0/3142488279 wait complete. 2023-10-18T19:34:38.979 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T19:34:38.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T19:34:38.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-18T19:34:38.980 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T19:34:38.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:38.981 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T19:34:38.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T19:34:38.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T19:34:38.982 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T19:34:38.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:38.982 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-18T19:34:39.029 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T19:34:39.030 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T19:34:39.030 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T19:34:39.030 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:39.030 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-18T19:34:39.031 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:39.031 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:39.031 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:39.031 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-18T19:34:39.031 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:39.032 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:39.032 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-18T19:34:39.032 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:39.032 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:39.032 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T19:34:39.033 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:39.033 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-18T19:34:39.033 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-18T19:34:39.033 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-18T19:34:39.033 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:39.034 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T19:34:39.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:39.035 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-18T19:34:39.035 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-18T19:34:39.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-10-18T19:34:39.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-10-18T19:34:39.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-10-18T19:34:39.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T19:34:39.036 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-18T19:34:39.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:39.456 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T19:34:39.560 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-18T19:34:39.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:39.564 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-18T19:34:39.642 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-18T19:34:39.642 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T19:34:39.642 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T19:34:39.643 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-18T19:34:39.643 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T19:34:39.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:39.645 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-18T19:34:39.645 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-18T19:34:39.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T19:34:39.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T19:34:39.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T19:34:39.646 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-18T19:34:40.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:40.349 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-18T19:34:40.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:40.402 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-18T19:34:40.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:40.493 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-18T19:34:40.493 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-18T19:34:40.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T19:34:40.494 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-18T19:34:40.494 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-18T19:34:40.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-18T19:34:40.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:40.683 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-18T19:34:40.683 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-18T19:34:40.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-18T19:34:40.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T19:34:40.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-18T19:34:40.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-18T19:34:40.685 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-18T19:34:40.685 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-18T19:34:40.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:40.955 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-18T19:34:40.955 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-18T19:34:40.955 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-18T19:34:40.955 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T19:34:40.956 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-18T19:34:41.128 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-18T19:34:41.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:41.129 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:41.175 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T19:34:41.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2023-10-18T19:34:41.286 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:41.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:41.355 INFO:teuthology.orchestra.run.smithi184.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:41.357 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:41.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:41.358 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-18T19:34:41.404 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-18T19:34:41.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:41.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2023-10-18T19:34:41.480 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:41.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:41.551 INFO:teuthology.orchestra.run.smithi184.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:41.553 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:41.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:41.554 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-18T19:34:41.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi184.stderr:2023-10-18 19:34:41.642 7f14e927b200 -1 init, newargv = 0x55a8c133add0 newargc=9 2023-10-18T19:34:41.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi184.stderr:ceph-fuse[105223]: starting ceph client 2023-10-18T19:34:41.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi184.stderr:ceph-fuse[105223]: starting fuse 2023-10-18T19:34:42.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2023-10-18T19:34:42.778 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:42.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:42.847 INFO:teuthology.orchestra.run.smithi184.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:42.849 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:42.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:42.850 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-18T19:34:42.897 INFO:teuthology.orchestra.run.smithi184.stdout:43 2023-10-18T19:34:42.897 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-18T19:34:42.898 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-18T19:34:42.898 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-18T19:34:42.898 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-18T19:34:42.899 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-18T19:34:42.899 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-18T19:34:42.899 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-18T19:34:42.900 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-18T19:34:42.900 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-18T19:34:42.900 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-18T19:34:42.900 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-18T19:34:42.901 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-18T19:34:42.901 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-18T19:34:42.901 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-18T19:34:42.902 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-18T19:34:42.902 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-18T19:34:42.902 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-18T19:34:42.902 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-18T19:34:42.903 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-18T19:34:42.903 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-18T19:34:42.903 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-18T19:34:42.904 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-18T19:34:42.904 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-18T19:34:42.904 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-18T19:34:42.904 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-18T19:34:42.905 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-18T19:34:42.905 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.0")) 2023-10-18T19:34:42.905 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-18T19:34:43.047 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.0.105223.asok 2023-10-18T19:34:43.226 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105223.asok 2023-10-18T19:34:43.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:43.227 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.105223.asok status 2023-10-18T19:34:43.430 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-18T19:34:43.430 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-18T19:34:43.430 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "ca74598065096e6fcbd8433c8779a2be0c889351", 2023-10-18T19:34:43.430 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)", 2023-10-18T19:34:43.431 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "0", 2023-10-18T19:34:43.431 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-18T19:34:43.431 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-18T19:34:43.431 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "105223", 2023-10-18T19:34:43.431 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-18T19:34:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-18T19:34:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-18T19:34:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-18T19:34:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 4472, 2023-10-18T19:34:43.432 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-18T19:34:43.433 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-18T19:34:43.433 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-18T19:34:43.433 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 4472 2023-10-18T19:34:43.433 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-18T19:34:43.434 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-18T19:34:43.434 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-18T19:34:43.434 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "172.21.15.184:0", 2023-10-18T19:34:43.434 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1260198635 2023-10-18T19:34:43.434 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-18T19:34:43.435 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-18T19:34:43.435 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-18T19:34:43.435 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-18T19:34:43.435 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "172.21.15.184:0", 2023-10-18T19:34:43.435 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1260198635 2023-10-18T19:34:43.436 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-18T19:34:43.436 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.4472 172.21.15.184:0/1260198635", 2023-10-18T19:34:43.436 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "172.21.15.184:0/1260198635", 2023-10-18T19:34:43.436 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-18T19:34:43.436 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 10, 2023-10-18T19:34:43.437 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 17, 2023-10-18T19:34:43.437 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-18T19:34:43.437 INFO:teuthology.orchestra.run.smithi184.stdout: "blacklisted": false, 2023-10-18T19:34:43.437 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-18T19:34:43.437 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-18T19:34:43.443 DEBUG:teuthology.orchestra.run.smithi192:> ceph fs ls 2023-10-18T19:34:43.622 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.619 7f10ca3ff700 1 Processor -- start 2023-10-18T19:34:43.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 -- start start 2023-10-18T19:34:43.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10c4180220 0x7f10c4185960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:43.623 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c418e290 con 0x7f10c417fdd0 2023-10-18T19:34:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c418f4c0 con 0x7f10c4180220 2023-10-18T19:34:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.620 7f10ca3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10c418f670 con 0x7f10c418b800 2023-10-18T19:34:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.192:39658/0 (socket says 172.21.15.192:39658) 2023-10-18T19:34:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 -- 172.21.15.192:0/307203701 learned_addr learned my addr 172.21.15.192:0/307203701 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-18T19:34:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c1ffd700 1 --2- 172.21.15.192:0/307203701 >> v2:172.21.15.88:3300/0 conn(0x7f10c4180220 0x7f10c4185960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 -- 172.21.15.192:0/307203701 >> v2:172.21.15.88:3300/0 conn(0x7f10c4180220 msgr2=0x7f10c4185960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 --2- 172.21.15.192:0/307203701 >> v2:172.21.15.88:3300/0 conn(0x7f10c4180220 0x7f10c4185960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 -- 172.21.15.192:0/307203701 >> v1:172.21.15.88:6789/0 conn(0x7f10c417fdd0 legacy=0x7f10c4185160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.621 7f10c2fff700 1 -- 172.21.15.192:0/307203701 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c418f870 con 0x7f10c418b800 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10c2fff700 1 --2- 172.21.15.192:0/307203701 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f10bc0032f0 tx=0x7f10bc009d60).ready entity=mon.2 client_cookie=ce90d4fa52dd2449 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10c17fc700 1 -- 172.21.15.192:0/307203701 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10c418f870 con 0x7f10c418b800 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10c17fc700 1 -- 172.21.15.192:0/307203701 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b880 con 0x7f10c418b800 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10c17fc700 1 -- 172.21.15.192:0/307203701 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10bc00ba60 con 0x7f10c418b800 2023-10-18T19:34:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 -- 172.21.15.192:0/307203701 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 msgr2=0x7f10c418dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 --2- 172.21.15.192:0/307203701 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f10bc0032f0 tx=0x7f10bc009d60).stop 2023-10-18T19:34:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 -- 172.21.15.192:0/307203701 shutdown_connections 2023-10-18T19:34:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 --2- 172.21.15.192:0/307203701 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c418b800 0x7f10c418dc60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 --2- 172.21.15.192:0/307203701 >> v2:172.21.15.88:3300/0 conn(0x7f10c4180220 0x7f10c4185960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.622 7f10ca3ff700 1 -- 172.21.15.192:0/307203701 >> 172.21.15.192:0/307203701 conn(0x7f10c40f4d10 msgr2=0x7f10c417dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.623 7f10ca3ff700 1 -- 172.21.15.192:0/307203701 shutdown_connections 2023-10-18T19:34:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.623 7f10ca3ff700 1 -- 172.21.15.192:0/307203701 wait complete. 2023-10-18T19:34:43.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 Processor -- start 2023-10-18T19:34:43.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 -- start start 2023-10-18T19:34:43.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10c4193020 0x7f10c4193470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:43.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c41982d0 0x7f10c4198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:43.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:43.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a01b0 con 0x7f10c4198e40 2023-10-18T19:34:43.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a0390 con 0x7f10c4193020 2023-10-18T19:34:43.651 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.647 7f10ca3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10c41a05c0 con 0x7f10c41982d0 2023-10-18T19:34:43.653 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:43.654 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c1ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c41982d0 0x7f10c4198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:43.654 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.192:53846/0 (socket says 172.21.15.192:53846) 2023-10-18T19:34:43.654 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 -- 172.21.15.192:0/3544942460 learned_addr learned my addr 172.21.15.192:0/3544942460 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-18T19:34:43.654 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c27fe700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10c4193020 0x7f10c4193470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:43.655 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 -- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c41982d0 msgr2=0x7f10c4198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.655 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c41982d0 0x7f10c4198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.655 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 -- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10c4193020 msgr2=0x7f10c4193470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.655 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10c4193020 0x7f10c4193470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.655 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.648 7f10c2fff700 1 -- 172.21.15.192:0/3544942460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c41a07f0 con 0x7f10c4198e40 2023-10-18T19:34:43.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10c2fff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f10bc0032f0 tx=0x7f10bc006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:43.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10c41a07f0 con 0x7f10c4198e40 2023-10-18T19:34:43.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c41a0ab0 con 0x7f10c4198e40 2023-10-18T19:34:43.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc011b00 con 0x7f10c4198e40 2023-10-18T19:34:43.656 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f10bc017040 con 0x7f10c4198e40 2023-10-18T19:34:43.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.649 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41a0fb0 con 0x7f10c4198e40 2023-10-18T19:34:43.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.650 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f10bc01c470 con 0x7f10c4198e40 2023-10-18T19:34:43.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.650 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f10bc018030 con 0x7f10c4198e40 2023-10-18T19:34:43.657 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.650 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c40f03b0 con 0x7f10c4198e40 2023-10-18T19:34:43.658 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.654 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f10bc0118f0 con 0x7f10c4198e40 2023-10-18T19:34:43.775 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.773 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10c40a6b50 con 0x7f10c4198e40 2023-10-18T19:34:43.776 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.774 7f10b37fe700 1 -- 172.21.15.192:0/3544942460 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10bc00b670 con 0x7f10c4198e40 2023-10-18T19:34:43.776 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T19:34:43.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 >> v1:172.21.15.88:6800/107321 conn(0x7f10a001c1b0 legacy=0x7f10a001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 msgr2=0x7f10c419f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:43.778 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f10bc0032f0 tx=0x7f10bc006c40).stop 2023-10-18T19:34:43.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 shutdown_connections 2023-10-18T19:34:43.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10c4198e40 0x7f10c419f970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10c4193020 0x7f10c4193470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.779 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 --2- 172.21.15.192:0/3544942460 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f10c41982d0 0x7f10c4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:43.780 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 >> 172.21.15.192:0/3544942460 conn(0x7f10c40df2d0 msgr2=0x7f10c40df720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:43.780 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 shutdown_connections 2023-10-18T19:34:43.780 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-18 19:34:43.775 7f10ca3ff700 1 -- 172.21.15.192:0/3544942460 wait complete. 2023-10-18T19:34:43.792 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T19:34:43.793 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T19:34:43.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-18T19:34:43.793 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-18T19:34:43.794 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:43.794 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T19:34:43.794 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T19:34:43.794 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T19:34:43.795 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-18T19:34:43.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:43.795 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-18T19:34:43.842 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T19:34:43.842 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T19:34:43.843 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T19:34:43.843 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:43.843 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-18T19:34:43.843 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:43.843 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:43.844 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:43.844 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-18T19:34:43.844 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:43.844 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:43.844 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-18T19:34:43.845 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-10-18T19:34:43.846 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-18T19:34:43.846 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-18T19:34:43.851 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T19:34:43.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:43.852 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-18T19:34:43.852 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-18T19:34:43.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-10-18T19:34:43.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-10-18T19:34:43.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-10-18T19:34:43.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T19:34:43.853 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-18T19:34:44.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:44.254 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T19:34:44.359 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-18T19:34:44.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:44.363 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-18T19:34:44.441 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-18T19:34:44.441 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T19:34:44.442 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T19:34:44.442 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-18T19:34:44.442 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T19:34:44.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:44.443 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-18T19:34:44.443 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-18T19:34:44.444 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T19:34:44.444 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T19:34:44.444 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T19:34:44.445 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-18T19:34:45.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:45.131 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-18T19:34:45.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:45.178 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-10-18T19:34:45.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:45.266 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-18T19:34:45.266 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-18T19:34:45.266 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T19:34:45.267 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-18T19:34:45.267 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-18T19:34:45.420 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-18T19:34:45.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:45.421 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-18T19:34:45.422 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-18T19:34:45.422 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-18T19:34:45.422 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T19:34:45.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-18T19:34:45.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-18T19:34:45.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-18T19:34:45.423 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-18T19:34:45.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T19:34:45.693 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-18T19:34:45.693 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-18T19:34:45.693 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-18T19:34:45.694 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T19:34:45.694 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-18T19:34:45.867 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-18T19:34:45.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:45.868 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:45.913 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-18T19:34:45.914 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-10-18T19:34:46.024 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:46.025 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:46.094 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:46.096 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:46.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:46.097 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-10-18T19:34:46.143 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-18T19:34:46.144 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:46.188 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-10-18T19:34:46.258 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:46.259 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:46.330 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:46.333 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:46.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:46.334 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-10-18T19:34:46.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:2023-10-18 19:34:46.416 7fe9a1a4f200 -1 init, newargv = 0x5597b66ea180 newargc=9 2023-10-18T19:34:46.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[105227]: starting ceph client 2023-10-18T19:34:46.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[105227]: starting fuse 2023-10-18T19:34:47.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2023-10-18T19:34:47.559 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T19:34:47.560 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T19:34:47.630 INFO:teuthology.orchestra.run.smithi192.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T19:34:47.632 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T19:34:47.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:47.633 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2023-10-18T19:34:47.679 INFO:teuthology.orchestra.run.smithi192.stdout:43 2023-10-18T19:34:47.680 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-18T19:34:47.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-18T19:34:47.681 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2023-10-18T19:34:47.681 DEBUG:teuthology.orchestra.run.smithi192:> import re 2023-10-18T19:34:47.681 DEBUG:teuthology.orchestra.run.smithi192:> import os 2023-10-18T19:34:47.681 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2023-10-18T19:34:47.682 DEBUG:teuthology.orchestra.run.smithi192:> 2023-10-18T19:34:47.682 DEBUG:teuthology.orchestra.run.smithi192:> def _find_admin_socket(client_name): 2023-10-18T19:34:47.682 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-18T19:34:47.683 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2023-10-18T19:34:47.683 DEBUG:teuthology.orchestra.run.smithi192:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-18T19:34:47.683 DEBUG:teuthology.orchestra.run.smithi192:> 2023-10-18T19:34:47.683 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2023-10-18T19:34:47.684 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2023-10-18T19:34:47.684 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2023-10-18T19:34:47.684 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2023-10-18T19:34:47.685 DEBUG:teuthology.orchestra.run.smithi192:> 2023-10-18T19:34:47.685 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2023-10-18T19:34:47.685 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-18T19:34:47.685 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-18T19:34:47.686 DEBUG:teuthology.orchestra.run.smithi192:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-18T19:34:47.686 DEBUG:teuthology.orchestra.run.smithi192:> contents = proc_f.read() 2023-10-18T19:34:47.686 DEBUG:teuthology.orchestra.run.smithi192:> if mountpoint in contents: 2023-10-18T19:34:47.687 DEBUG:teuthology.orchestra.run.smithi192:> return f 2023-10-18T19:34:47.687 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-18T19:34:47.687 DEBUG:teuthology.orchestra.run.smithi192:> 2023-10-18T19:34:47.688 DEBUG:teuthology.orchestra.run.smithi192:> print(_find_admin_socket("client.1")) 2023-10-18T19:34:47.688 DEBUG:teuthology.orchestra.run.smithi192:> ' 2023-10-18T19:34:47.830 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.1.105227.asok 2023-10-18T19:34:48.009 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.105227.asok 2023-10-18T19:34:48.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:48.010 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.105227.asok status 2023-10-18T19:34:48.214 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2023-10-18T19:34:48.214 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2023-10-18T19:34:48.214 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "ca74598065096e6fcbd8433c8779a2be0c889351", 2023-10-18T19:34:48.215 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)", 2023-10-18T19:34:48.215 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "1", 2023-10-18T19:34:48.215 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2023-10-18T19:34:48.215 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-18T19:34:48.215 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "105227", 2023-10-18T19:34:48.216 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2023-10-18T19:34:48.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-10-18T19:34:48.216 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2023-10-18T19:34:48.216 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2023-10-18T19:34:48.216 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4674, 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 4674 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-10-18T19:34:48.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-10-18T19:34:48.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-10-18T19:34:48.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2023-10-18T19:34:48.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3142069797 2023-10-18T19:34:48.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2023-10-18T19:34:48.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-10-18T19:34:48.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2023-10-18T19:34:48.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2023-10-18T19:34:48.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:0", 2023-10-18T19:34:48.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3142069797 2023-10-18T19:34:48.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2023-10-18T19:34:48.220 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.4674 172.21.15.192:0/3142069797", 2023-10-18T19:34:48.220 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "172.21.15.192:0/3142069797", 2023-10-18T19:34:48.220 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2023-10-18T19:34:48.220 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 10, 2023-10-18T19:34:48.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 17, 2023-10-18T19:34:48.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2023-10-18T19:34:48.221 INFO:teuthology.orchestra.run.smithi192.stdout: "blacklisted": false, 2023-10-18T19:34:48.221 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2023-10-18T19:34:48.221 INFO:teuthology.orchestra.run.smithi192.stdout:} 2023-10-18T19:34:48.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:48.228 DEBUG:teuthology.orchestra.run.smithi184:> stat --file-system '--printf=%T 2023-10-18T19:34:48.229 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:48.281 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-18T19:34:48.281 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:48.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:48.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T19:34:48.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:48.357 DEBUG:teuthology.orchestra.run.smithi192:> stat --file-system '--printf=%T 2023-10-18T19:34:48.357 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:48.405 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2023-10-18T19:34:48.405 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:48.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:34:48.407 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-18T19:34:51.783 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:34:51.792 INFO:teuthology.task.print:**** done nautilus client 2023-10-18T19:34:51.792 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:34:51.822 INFO:teuthology.task.print:**** done fsstress 2023-10-18T19:34:51.823 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-18T19:34:51.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:52.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.070 7f4465bff700 1 Processor -- start 2023-10-18T19:34:52.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.070 7f4465bff700 1 -- start start 2023-10-18T19:34:52.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.070 7f4465bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.070 7f4465bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f44600f1f60 0x7f44601b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4465bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44600f23b0 con 0x7f446010ccc0 2023-10-18T19:34:52.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4465bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4460111f40 con 0x7f44600f1f60 2023-10-18T19:34:52.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4465bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4460111850 con 0x7f44600f14e0 2023-10-18T19:34:52.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4457fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4457fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52170/0 (socket says 172.21.15.88:52170) 2023-10-18T19:34:52.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445dffe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f446010ccc0 0x7f44600f6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35542/0 (socket says 172.21.15.88:35542) 2023-10-18T19:34:52.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4457fff700 1 -- 172.21.15.88:0/1391601232 learned_addr learned my addr 172.21.15.88:0/1391601232 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:52.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445e7ff700 1 --2- 172.21.15.88:0/1391601232 >> v2:172.21.15.88:3300/0 conn(0x7f44600f1f60 0x7f44601b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445e7ff700 1 -- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 msgr2=0x7f44600f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:52.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445e7ff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445e7ff700 1 -- 172.21.15.88:0/1391601232 >> v1:172.21.15.88:6789/0 conn(0x7f446010ccc0 legacy=0x7f44600f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445e7ff700 1 -- 172.21.15.88:0/1391601232 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446010d6f0 con 0x7f44600f1f60 2023-10-18T19:34:52.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f445d7fd700 1 -- 172.21.15.88:0/1391601232 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743819034 0 0) 0x7f4450001110 con 0x7f446010ccc0 2023-10-18T19:34:52.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.071 7f4457fff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:52.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f445e7ff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600f1f60 0x7f44601b9ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f44580032f0 tx=0x7f4458009d10).ready entity=mon.0 client_cookie=edb2abe5239fa526 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f445d7fd700 1 -- 172.21.15.88:0/1391601232 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f446010d6f0 con 0x7f44600f1f60 2023-10-18T19:34:52.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f445d7fd700 1 -- 172.21.15.88:0/1391601232 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445800b800 con 0x7f44600f1f60 2023-10-18T19:34:52.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f445d7fd700 1 -- 172.21.15.88:0/1391601232 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f445800b9e0 con 0x7f44600f1f60 2023-10-18T19:34:52.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 -- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600f1f60 msgr2=0x7f44601b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600f1f60 0x7f44601b9ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f44580032f0 tx=0x7f4458009d10).stop 2023-10-18T19:34:52.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 -- 172.21.15.88:0/1391601232 shutdown_connections 2023-10-18T19:34:52.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600f1f60 0x7f44601b9ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 --2- 172.21.15.88:0/1391601232 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44600f14e0 0x7f44600f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 -- 172.21.15.88:0/1391601232 >> 172.21.15.88:0/1391601232 conn(0x7f4460117390 msgr2=0x7f44600f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.072 7f4465bff700 1 -- 172.21.15.88:0/1391601232 shutdown_connections 2023-10-18T19:34:52.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.073 7f4465bff700 1 -- 172.21.15.88:0/1391601232 wait complete. 2023-10-18T19:34:52.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.097 7f4465bff700 1 Processor -- start 2023-10-18T19:34:52.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.097 7f4465bff700 1 -- start start 2023-10-18T19:34:52.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 0x7f44600b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44600b3280 con 0x7f44600b4600 2023-10-18T19:34:52.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44600ccbb0 con 0x7f44601c4d20 2023-10-18T19:34:52.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4465bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44600d3b50 con 0x7f44601c57a0 2023-10-18T19:34:52.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445dffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 0x7f44600b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445e7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445e7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52184/0 (socket says 172.21.15.88:52184) 2023-10-18T19:34:52.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445dffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 0x7f44600b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48148/0 (socket says 172.21.15.88:48148) 2023-10-18T19:34:52.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445e7ff700 1 -- 172.21.15.88:0/2111251150 learned_addr learned my addr 172.21.15.88:0/2111251150 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:52.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39760/0 (socket says 172.21.15.88:39760) 2023-10-18T19:34:52.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 -- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 msgr2=0x7f44601c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 -- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 msgr2=0x7f44600b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 0x7f44600b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f4457fff700 1 -- 172.21.15.88:0/2111251150 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44600b5190 con 0x7f44601c4d20 2023-10-18T19:34:52.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.098 7f445e7ff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:52.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4457fff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f446010d1d0 tx=0x7f444800ec50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f444800f040 con 0x7f44601c4d20 2023-10-18T19:34:52.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800c5a0 con 0x7f44601c4d20 2023-10-18T19:34:52.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4465bff700 1 -- 172.21.15.88:0/2111251150 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44600e00c0 con 0x7f44601c4d20 2023-10-18T19:34:52.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f444800c970 con 0x7f44601c4d20 2023-10-18T19:34:52.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.099 7f4465bff700 1 -- 172.21.15.88:0/2111251150 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44601c6380 con 0x7f44601c4d20 2023-10-18T19:34:52.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.100 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f4448011070 con 0x7f44601c4d20 2023-10-18T19:34:52.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.100 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f4448010040 con 0x7f44601c4d20 2023-10-18T19:34:52.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.100 7f4465bff700 1 -- 172.21.15.88:0/2111251150 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44600f0530 con 0x7f44601c4d20 2023-10-18T19:34:52.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.103 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f444800ed90 con 0x7f44601c4d20 2023-10-18T19:34:52.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.200 7f4465bff700 1 -- 172.21.15.88:0/2111251150 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44600a5f60 con 0x7f44601c4d20 2023-10-18T19:34:52.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.201 7f4456ffd700 1 -- 172.21.15.88:0/2111251150 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8850 (secure 0 0 0) 0x7f4448000c30 con 0x7f44601c4d20 2023-10-18T19:34:52.204 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:52.204 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:38.270136","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 >> v1:172.21.15.88:6800/107321 conn(0x7f444401c1b0 legacy=0x7f444401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 msgr2=0x7f44601c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f446010d1d0 tx=0x7f444800ec50).stop 2023-10-18T19:34:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 shutdown_connections 2023-10-18T19:34:52.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f44601c57a0 0x7f44601c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44600b4600 0x7f44600b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 --2- 172.21.15.88:0/2111251150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44601c4d20 0x7f44601c5170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 >> 172.21.15.88:0/2111251150 conn(0x7f44600d89c0 msgr2=0x7f4460121010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 shutdown_connections 2023-10-18T19:34:52.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.203 7f4465bff700 1 -- 172.21.15.88:0/2111251150 wait complete. 2023-10-18T19:34:52.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18 19:34:09.738627', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18 19:34:18.877868', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18 19:34:20.222147', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T19:34:52.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:34:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.422 7efc9cdff700 1 Processor -- start 2023-10-18T19:34:52.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.422 7efc9cdff700 1 -- start start 2023-10-18T19:34:52.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc9cdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 0x7efc980f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc9cdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 0x7efc981b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc9cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc980abc70 con 0x7efc980f1e50 2023-10-18T19:34:52.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc9cdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc981b5b50 con 0x7efc980f22a0 2023-10-18T19:34:52.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc9cdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc9810f870 con 0x7efc98115ea0 2023-10-18T19:34:52.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc959ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 0x7efc981b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc949fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc980f1e50 0x7efc981b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35552/0 (socket says 172.21.15.88:35552) 2023-10-18T19:34:52.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc949fd700 1 -- 172.21.15.88:0/1122902791 learned_addr learned my addr 172.21.15.88:0/1122902791 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:52.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc951fe700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 0x7efc980f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc87fff700 1 -- 172.21.15.88:0/1122902791 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711255358 0 0) 0x7efc8c001110 con 0x7efc980f1e50 2023-10-18T19:34:52.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc959ff700 1 -- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 msgr2=0x7efc980f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc959ff700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 0x7efc980f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc959ff700 1 -- 172.21.15.88:0/1122902791 >> v1:172.21.15.88:6789/0 conn(0x7efc980f1e50 legacy=0x7efc981b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc959ff700 1 -- 172.21.15.88:0/1122902791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9810fd10 con 0x7efc980f22a0 2023-10-18T19:34:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.423 7efc951fe700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 0x7efc980f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc959ff700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 0x7efc981b5520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7efc900032f0 tx=0x7efc90009d40).ready entity=mon.1 client_cookie=454238e16840e1ad server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc87fff700 1 -- 172.21.15.88:0/1122902791 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc9000b800 con 0x7efc980f22a0 2023-10-18T19:34:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc87fff700 1 -- 172.21.15.88:0/1122902791 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000ba00 con 0x7efc980f22a0 2023-10-18T19:34:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc87fff700 1 -- 172.21.15.88:0/1122902791 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc9000bbe0 con 0x7efc980f22a0 2023-10-18T19:34:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 -- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 msgr2=0x7efc981b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 0x7efc981b5520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7efc900032f0 tx=0x7efc90009d40).stop 2023-10-18T19:34:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 -- 172.21.15.88:0/1122902791 shutdown_connections 2023-10-18T19:34:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980f22a0 0x7efc981b5520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 --2- 172.21.15.88:0/1122902791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc98115ea0 0x7efc980f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.424 7efc9cdff700 1 -- 172.21.15.88:0/1122902791 >> 172.21.15.88:0/1122902791 conn(0x7efc981176d0 msgr2=0x7efc980f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.425 7efc9cdff700 1 -- 172.21.15.88:0/1122902791 shutdown_connections 2023-10-18T19:34:52.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.425 7efc9cdff700 1 -- 172.21.15.88:0/1122902791 wait complete. 2023-10-18T19:34:52.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.449 7efc9cdff700 1 Processor -- start 2023-10-18T19:34:52.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.449 7efc9cdff700 1 -- start start 2023-10-18T19:34:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.449 7efc9cdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.449 7efc9cdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980ba740 0x7efc980bab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc9cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980bb1c0 0x7efc981cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc9cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc980b7e60 con 0x7efc980bb1c0 2023-10-18T19:34:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc9cdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc980bb7e0 con 0x7efc980ba740 2023-10-18T19:34:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc9cdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc980d40a0 con 0x7efc980d1e10 2023-10-18T19:34:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52196/0 (socket says 172.21.15.88:52196) 2023-10-18T19:34:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 -- 172.21.15.88:0/3026299352 learned_addr learned my addr 172.21.15.88:0/3026299352 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc949fd700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980ba740 0x7efc980bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc959ff700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980bb1c0 0x7efc981cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 -- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980ba740 msgr2=0x7efc980bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980ba740 0x7efc980bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 -- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980bb1c0 msgr2=0x7efc981cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980bb1c0 0x7efc981cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 -- 172.21.15.88:0/3026299352 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc980d3aa0 con 0x7efc980d1e10 2023-10-18T19:34:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.450 7efc951fe700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efc980ba590 tx=0x7efc8800bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc980d3aa0 con 0x7efc980d1e10 2023-10-18T19:34:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8800c870 con 0x7efc980d1e10 2023-10-18T19:34:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7efc8800f040 con 0x7efc980d1e10 2023-10-18T19:34:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc980d13e0 con 0x7efc980d1e10 2023-10-18T19:34:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc981cd890 con 0x7efc980d1e10 2023-10-18T19:34:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.451 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7efc88011070 con 0x7efc980d1e10 2023-10-18T19:34:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.452 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7efc88010040 con 0x7efc980d1e10 2023-10-18T19:34:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.452 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc980f0870 con 0x7efc980d1e10 2023-10-18T19:34:52.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.455 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7efc8800c470 con 0x7efc980d1e10 2023-10-18T19:34:52.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.554 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc980d1c00 con 0x7efc980d1e10 2023-10-18T19:34:52.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.554 7efc867fc700 1 -- 172.21.15.88:0/3026299352 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc88000c30 con 0x7efc980d1e10 2023-10-18T19:34:52.557 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:34:52.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 >> v1:172.21.15.88:6800/107321 conn(0x7efc7401c1b0 legacy=0x7efc7401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 msgr2=0x7efc980b6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7efc980ba590 tx=0x7efc8800bf70).stop 2023-10-18T19:34:52.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 shutdown_connections 2023-10-18T19:34:52.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc980bb1c0 0x7efc981cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc980d1e10 0x7efc980b6c10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 --2- 172.21.15.88:0/3026299352 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc980ba740 0x7efc980bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.555 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 >> 172.21.15.88:0/3026299352 conn(0x7efc980d7590 msgr2=0x7efc980bc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.556 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 shutdown_connections 2023-10-18T19:34:52.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.556 7efc9cdff700 1 -- 172.21.15.88:0/3026299352 wait complete. 2023-10-18T19:34:52.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T19:34:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.774 7f931b9ff700 1 Processor -- start 2023-10-18T19:34:52.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.774 7f931b9ff700 1 -- start start 2023-10-18T19:34:52.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93140f6960 0x7f93141034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 0x7f93141b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 0x7f93141b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9314111b00 con 0x7f93140f6960 2023-10-18T19:34:52.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93141043c0 con 0x7f9314103f70 2023-10-18T19:34:52.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f931b9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9314116410 con 0x7f9314103b20 2023-10-18T19:34:52.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f93137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93140f6960 0x7f93141034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f930bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 0x7f93141b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f9313fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 0x7f93141b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f93137fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93140f6960 0x7f93141034f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48160/0 (socket says 172.21.15.88:48160) 2023-10-18T19:34:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.775 7f93137fe700 1 -- 172.21.15.88:0/2427333737 learned_addr learned my addr 172.21.15.88:0/2427333737 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 -- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 msgr2=0x7f93141b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 0x7f93141b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 -- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 msgr2=0x7f93141b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:52.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 0x7f93141b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 -- 172.21.15.88:0/2427333737 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931410c720 con 0x7f93140f6960 2023-10-18T19:34:52.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f9313fff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 0x7f93141b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:52.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f930bfff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 0x7f93141b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:52.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f93137fe700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140f6960 0x7f93141034f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9314116850 tx=0x7f9304009ab0).ready entity=mon.0 client_cookie=8ab078b3e4c959d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f9312ffd700 1 -- 172.21.15.88:0/2427333737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f931410c720 con 0x7f93140f6960 2023-10-18T19:34:52.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f9312ffd700 1 -- 172.21.15.88:0/2427333737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930400f510 con 0x7f93140f6960 2023-10-18T19:34:52.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f9312ffd700 1 -- 172.21.15.88:0/2427333737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f930400f6f0 con 0x7f93140f6960 2023-10-18T19:34:52.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f931b9ff700 1 -- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140f6960 msgr2=0x7f93141034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.776 7f931b9ff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140f6960 0x7f93141034f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9314116850 tx=0x7f9304009ab0).stop 2023-10-18T19:34:52.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 -- 172.21.15.88:0/2427333737 shutdown_connections 2023-10-18T19:34:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9314103f70 0x7f93141b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140f6960 0x7f93141034f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 --2- 172.21.15.88:0/2427333737 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9314103b20 0x7f93141b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 -- 172.21.15.88:0/2427333737 >> 172.21.15.88:0/2427333737 conn(0x7f93141176d0 msgr2=0x7f93140f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 -- 172.21.15.88:0/2427333737 shutdown_connections 2023-10-18T19:34:52.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.777 7f931b9ff700 1 -- 172.21.15.88:0/2427333737 wait complete. 2023-10-18T19:34:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.801 7f931b9ff700 1 Processor -- start 2023-10-18T19:34:52.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.801 7f931b9ff700 1 -- start start 2023-10-18T19:34:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93140cf450 0x7f93140cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140b9b60 0x7f93140b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140a7ed0 con 0x7f93140b9b60 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93141b5040 con 0x7f93141b4160 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f931b9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93141b3cc0 con 0x7f93140cf450 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f93137fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f930bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93140cf450 0x7f93140cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f93137fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39804/0 (socket says 172.21.15.88:39804) 2023-10-18T19:34:52.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f93137fe700 1 -- 172.21.15.88:0/3763093774 learned_addr learned my addr 172.21.15.88:0/3763093774 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.802 7f9313fff700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140b9b60 0x7f93140b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 -- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93140cf450 msgr2=0x7f93140cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93140cf450 0x7f93140cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 -- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140b9b60 msgr2=0x7f93140b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140b9b60 0x7f93140b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 -- 172.21.15.88:0/3763093774 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93141b38a0 con 0x7f93141b4160 2023-10-18T19:34:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93137fe700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f931410c200 tx=0x7f93040068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93141b38a0 con 0x7f93141b4160 2023-10-18T19:34:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304011610 con 0x7f93141b4160 2023-10-18T19:34:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93141b5280 con 0x7f93141b4160 2023-10-18T19:34:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f93040119e0 con 0x7f93141b4160 2023-10-18T19:34:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.803 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93140ba7c0 con 0x7f93141b4160 2023-10-18T19:34:52.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.804 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9304009110 con 0x7f93141b4160 2023-10-18T19:34:52.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.804 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9304013e00 con 0x7f93141b4160 2023-10-18T19:34:52.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.804 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93140f0870 con 0x7f93141b4160 2023-10-18T19:34:52.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.807 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f930400f300 con 0x7f93141b4160 2023-10-18T19:34:52.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.904 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93140e2350 con 0x7f93141b4160 2023-10-18T19:34:52.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.905 7f93117fa700 1 -- 172.21.15.88:0/3763093774 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9304011400 con 0x7f93141b4160 2023-10-18T19:34:52.908 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:52.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 >> v1:172.21.15.88:6800/107321 conn(0x7f92f801c1b0 legacy=0x7f92f801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 msgr2=0x7f93141b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:52.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f931410c200 tx=0x7f93040068c0).stop 2023-10-18T19:34:52.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 shutdown_connections 2023-10-18T19:34:52.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93140b9b60 0x7f93140b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93141b4160 0x7f93141b45b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 --2- 172.21.15.88:0/3763093774 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f93140cf450 0x7f93140cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:52.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 >> 172.21.15.88:0/3763093774 conn(0x7f93140b9620 msgr2=0x7f93140de970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:52.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 shutdown_connections 2023-10-18T19:34:52.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:52.906 7f931b9ff700 1 -- 172.21.15.88:0/3763093774 wait complete. 2023-10-18T19:34:52.925 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T19:34:53.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.126 7fce5f39d700 1 Processor -- start 2023-10-18T19:34:53.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.126 7fce5f39d700 1 -- start start 2023-10-18T19:34:53.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5f39d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 0x7fce581b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5f39d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 0x7fce581b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5f39d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce58111640 con 0x7fce580f6230 2023-10-18T19:34:53.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5f39d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce581b3390 con 0x7fce580f6680 2023-10-18T19:34:53.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5f39d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce5810d040 con 0x7fce581b78b0 2023-10-18T19:34:53.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce57fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 0x7fce581b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5d3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 0x7fce581b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5cbfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fce580f6230 0x7fce581b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35556/0 (socket says 172.21.15.88:35556) 2023-10-18T19:34:53.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.127 7fce5cbfe700 1 -- 172.21.15.88:0/3168676781 learned_addr learned my addr 172.21.15.88:0/3168676781 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:53.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce577fe700 1 -- 172.21.15.88:0/3168676781 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716255495 0 0) 0x7fce4c001110 con 0x7fce580f6230 2023-10-18T19:34:53.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce577fe700 1 -- 172.21.15.88:0/3168676781 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce3c003270 con 0x7fce580f6230 2023-10-18T19:34:53.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce57fff700 1 -- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 msgr2=0x7fce581b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:53.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce57fff700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 0x7fce581b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce57fff700 1 -- 172.21.15.88:0/3168676781 >> v1:172.21.15.88:6789/0 conn(0x7fce580f6230 legacy=0x7fce581b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce57fff700 1 -- 172.21.15.88:0/3168676781 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5810d560 con 0x7fce580f6680 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce5d3ff700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 0x7fce581b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce57fff700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 0x7fce581b2d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fce44002f70 tx=0x7fce4400ba20).ready entity=mon.1 client_cookie=72b0a6728c3e727c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce577fe700 1 -- 172.21.15.88:0/3168676781 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce5810d560 con 0x7fce580f6680 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce577fe700 1 -- 172.21.15.88:0/3168676781 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4400d570 con 0x7fce580f6680 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce577fe700 1 -- 172.21.15.88:0/3168676781 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce4400d940 con 0x7fce580f6680 2023-10-18T19:34:53.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce5f39d700 1 -- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 msgr2=0x7fce581b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.128 7fce5f39d700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 0x7fce581b2d60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fce44002f70 tx=0x7fce4400ba20).stop 2023-10-18T19:34:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 -- 172.21.15.88:0/3168676781 shutdown_connections 2023-10-18T19:34:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581b78b0 0x7fce581b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 --2- 172.21.15.88:0/3168676781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580f6680 0x7fce581b2d60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 -- 172.21.15.88:0/3168676781 >> 172.21.15.88:0/3168676781 conn(0x7fce58117180 msgr2=0x7fce580f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 -- 172.21.15.88:0/3168676781 shutdown_connections 2023-10-18T19:34:53.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.129 7fce5f39d700 1 -- 172.21.15.88:0/3168676781 wait complete. 2023-10-18T19:34:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.153 7fce5f39d700 1 Processor -- start 2023-10-18T19:34:53.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.153 7fce5f39d700 1 -- start start 2023-10-18T19:34:53.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580d4b60 0x7fce581c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce580efe30 con 0x7fce581c4990 2023-10-18T19:34:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce580d2070 con 0x7fce580d4b60 2023-10-18T19:34:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5f39d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce580e0930 con 0x7fce581c4540 2023-10-18T19:34:53.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce57fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce57fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52236/0 (socket says 172.21.15.88:52236) 2023-10-18T19:34:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48180/0 (socket says 172.21.15.88:48180) 2023-10-18T19:34:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce57fff700 1 -- 172.21.15.88:0/989885243 learned_addr learned my addr 172.21.15.88:0/989885243 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:53.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.154 7fce5cbfe700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580d4b60 0x7fce581c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 -- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 msgr2=0x7fce580ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 -- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580d4b60 msgr2=0x7fce581c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580d4b60 0x7fce581c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 -- 172.21.15.88:0/989885243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580d5750 con 0x7fce581c4990 2023-10-18T19:34:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce57fff700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5d3ff700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fce5000c000 tx=0x7fce5000ed40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce580d5750 con 0x7fce581c4990 2023-10-18T19:34:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000c880 con 0x7fce581c4990 2023-10-18T19:34:53.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5f39d700 1 -- 172.21.15.88:0/989885243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce580d4fb0 con 0x7fce581c4990 2023-10-18T19:34:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fce5000f040 con 0x7fce581c4990 2023-10-18T19:34:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.155 7fce5f39d700 1 -- 172.21.15.88:0/989885243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce580abef0 con 0x7fce581c4990 2023-10-18T19:34:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.156 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fce50022060 con 0x7fce581c4990 2023-10-18T19:34:53.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.156 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fce50010040 con 0x7fce581c4990 2023-10-18T19:34:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.157 7fce5f39d700 1 -- 172.21.15.88:0/989885243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce580f0320 con 0x7fce581c4990 2023-10-18T19:34:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.160 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fce5000c670 con 0x7fce581c4990 2023-10-18T19:34:53.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.257 7fce5f39d700 1 -- 172.21.15.88:0/989885243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce580f6a00 con 0x7fce581c4990 2023-10-18T19:34:53.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.257 7fce55ffb700 1 -- 172.21.15.88:0/989885243 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce580ffa60 con 0x7fce581c4990 2023-10-18T19:34:53.261 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:34:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 >> v1:172.21.15.88:6800/107321 conn(0x7fce4001c1b0 legacy=0x7fce4001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 msgr2=0x7fce580ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fce5000c000 tx=0x7fce5000ed40).stop 2023-10-18T19:34:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 shutdown_connections 2023-10-18T19:34:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce581c4990 0x7fce580ab8c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fce580d4b60 0x7fce581c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 --2- 172.21.15.88:0/989885243 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fce581c4540 0x7fce580ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 >> 172.21.15.88:0/989885243 conn(0x7fce580bd970 msgr2=0x7fce580d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 shutdown_connections 2023-10-18T19:34:53.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.259 7fce5f39d700 1 -- 172.21.15.88:0/989885243 wait complete. 2023-10-18T19:34:53.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:53.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.478 7f59a89fe700 1 Processor -- start 2023-10-18T19:34:53.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 -- start start 2023-10-18T19:34:53.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 0x7f59a41b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 0x7f59a41b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a4111640 con 0x7f59a40f12d0 2023-10-18T19:34:53.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a410d040 con 0x7f59a40f6230 2023-10-18T19:34:53.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a89fe700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a4111d30 con 0x7f59a40f6680 2023-10-18T19:34:53.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 0x7f59a41b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.479 7f59a0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 0x7f59a41b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 0x7f59a41b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39818/0 (socket says 172.21.15.88:39818) 2023-10-18T19:34:53.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a15fe700 1 -- 172.21.15.88:0/2278260221 learned_addr learned my addr 172.21.15.88:0/2278260221 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f5993fff700 1 -- 172.21.15.88:0/2278260221 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451722868 0 0) 0x7f599c001490 con 0x7f59a40f12d0 2023-10-18T19:34:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a0dfd700 1 -- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 msgr2=0x7f59a41b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a0dfd700 1 --2- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 0x7f59a41b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a0dfd700 1 -- 172.21.15.88:0/2278260221 >> v1:172.21.15.88:6789/0 conn(0x7f59a40f12d0 legacy=0x7f59a40f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a0dfd700 1 -- 172.21.15.88:0/2278260221 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a410d560 con 0x7f59a40f6680 2023-10-18T19:34:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a0dfd700 1 --2- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 0x7f59a41b2b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5998002f70 tx=0x7f599800b9a0).ready entity=mon.2 client_cookie=b18d8416bd82b6f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f5993fff700 1 -- 172.21.15.88:0/2278260221 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a410d560 con 0x7f59a40f6680 2023-10-18T19:34:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f5993fff700 1 -- 172.21.15.88:0/2278260221 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599800d570 con 0x7f59a40f6680 2023-10-18T19:34:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f5993fff700 1 -- 172.21.15.88:0/2278260221 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f599800d940 con 0x7f59a40f6680 2023-10-18T19:34:53.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a89fe700 1 -- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 msgr2=0x7f59a41b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.480 7f59a89fe700 1 --2- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 0x7f59a41b2b90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5998002f70 tx=0x7f599800b9a0).stop 2023-10-18T19:34:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 -- 172.21.15.88:0/2278260221 shutdown_connections 2023-10-18T19:34:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 --2- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40f6230 0x7f59a41b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 --2- 172.21.15.88:0/2278260221 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40f6680 0x7f59a41b2b90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 -- 172.21.15.88:0/2278260221 >> 172.21.15.88:0/2278260221 conn(0x7f59a4117180 msgr2=0x7f59a40f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 -- 172.21.15.88:0/2278260221 shutdown_connections 2023-10-18T19:34:53.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.481 7f59a89fe700 1 -- 172.21.15.88:0/2278260221 wait complete. 2023-10-18T19:34:53.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.506 7f59a89fe700 1 Processor -- start 2023-10-18T19:34:53.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.506 7f59a89fe700 1 -- start start 2023-10-18T19:34:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 0x7f59a41c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59a40b8ef0 0x7f59a40b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40f69e0 con 0x7f59a40b8ef0 2023-10-18T19:34:53.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40cf900 con 0x7f59a40b8010 2023-10-18T19:34:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a89fe700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40b7830 con 0x7f59a40b8460 2023-10-18T19:34:53.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a0dfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 0x7f59a41c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39826/0 (socket says 172.21.15.88:39826) 2023-10-18T19:34:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 -- 172.21.15.88:0/4292288904 learned_addr learned my addr 172.21.15.88:0/4292288904 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a1dff700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59a40b8ef0 0x7f59a40b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 -- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 msgr2=0x7f59a41c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 0x7f59a41c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 -- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59a40b8ef0 msgr2=0x7f59a40b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59a40b8ef0 0x7f59a40b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a15fe700 1 -- 172.21.15.88:0/4292288904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40b7490 con 0x7f59a40b8010 2023-10-18T19:34:53.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.507 7f59a0dfd700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 0x7f59a41c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:53.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59a15fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f59a410cfc0 tx=0x7f599400ed00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f59a40b7490 con 0x7f59a40b8010 2023-10-18T19:34:53.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400ee40 con 0x7f59a40b8010 2023-10-18T19:34:53.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a40d1b70 con 0x7f59a40b8010 2023-10-18T19:34:53.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f599400f040 con 0x7f59a40b8010 2023-10-18T19:34:53.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.508 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a40b9970 con 0x7f59a40b8010 2023-10-18T19:34:53.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.509 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f5994022060 con 0x7f59a40b8010 2023-10-18T19:34:53.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.509 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f5994010040 con 0x7f59a40b8010 2023-10-18T19:34:53.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.509 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a40f0320 con 0x7f59a40b8010 2023-10-18T19:34:53.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.512 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f599400c5a0 con 0x7f59a40b8010 2023-10-18T19:34:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.630 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59a40cfb90 con 0x7f59a40b8010 2023-10-18T19:34:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.631 7f59927fc700 1 -- 172.21.15.88:0/4292288904 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f5994000c30 con 0x7f59a40b8010 2023-10-18T19:34:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:53.634 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:25.229238","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.632 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 >> v1:172.21.15.88:6800/107321 conn(0x7f598001c1b0 legacy=0x7f598001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.632 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 msgr2=0x7f59a41c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.632 7f59a89fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f59a410cfc0 tx=0x7f599400ed00).stop 2023-10-18T19:34:53.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 shutdown_connections 2023-10-18T19:34:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59a40b8ef0 0x7f59a40b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f59a40b8010 0x7f59a41c3a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 --2- 172.21.15.88:0/4292288904 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f59a40b8460 0x7f59a41c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 >> 172.21.15.88:0/4292288904 conn(0x7f59a40e0c30 msgr2=0x7f59a40bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 shutdown_connections 2023-10-18T19:34:53.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.633 7f59a89fe700 1 -- 172.21.15.88:0/4292288904 wait complete. 2023-10-18T19:34:53.638 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 10 2023-10-18T19:34:53.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:34:53.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 Processor -- start 2023-10-18T19:34:53.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 -- start start 2023-10-18T19:34:53.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 0x7fb3400f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb340111850 con 0x7fb3401b31f0 2023-10-18T19:34:53.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb340111f40 con 0x7fb3401b2770 2023-10-18T19:34:53.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.851 7fb3477ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400f6a30 con 0x7fb34010ccc0 2023-10-18T19:34:53.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb337fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 0x7fb3400f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb337fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48196/0 (socket says 172.21.15.88:48196) 2023-10-18T19:34:53.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb337fff700 1 -- 172.21.15.88:0/4134418256 learned_addr learned my addr 172.21.15.88:0/4134418256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:53.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33ffff700 1 --1- 172.21.15.88:0/4134418256 >> v1:172.21.15.88:6789/0 conn(0x7fb3401b31f0 0x7fb3400f14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35580/0 (socket says 172.21.15.88:35580) 2023-10-18T19:34:53.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 -- 172.21.15.88:0/4134418256 >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 msgr2=0x7fb3401b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:53.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 --2- 172.21.15.88:0/4134418256 >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 -- 172.21.15.88:0/4134418256 >> v1:172.21.15.88:6789/0 conn(0x7fb3401b31f0 legacy=0x7fb3400f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 -- 172.21.15.88:0/4134418256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34010d6f0 con 0x7fb34010ccc0 2023-10-18T19:34:53.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb337fff700 1 --2- 172.21.15.88:0/4134418256 >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:53.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.852 7fb33f7fe700 1 --2- 172.21.15.88:0/4134418256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 0x7fb3400f6400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb330002f70 tx=0x7fb33000b970).ready entity=mon.1 client_cookie=e169e32257d9c72e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb33effd700 1 -- 172.21.15.88:0/4134418256 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb34010d6f0 con 0x7fb34010ccc0 2023-10-18T19:34:53.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb33effd700 1 -- 172.21.15.88:0/4134418256 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000d5c0 con 0x7fb34010ccc0 2023-10-18T19:34:53.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb33effd700 1 -- 172.21.15.88:0/4134418256 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb33000d990 con 0x7fb34010ccc0 2023-10-18T19:34:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 -- 172.21.15.88:0/4134418256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 msgr2=0x7fb3400f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 --2- 172.21.15.88:0/4134418256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 0x7fb3400f6400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb330002f70 tx=0x7fb33000b970).stop 2023-10-18T19:34:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 -- 172.21.15.88:0/4134418256 shutdown_connections 2023-10-18T19:34:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 --2- 172.21.15.88:0/4134418256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb34010ccc0 0x7fb3400f6400 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 --2- 172.21.15.88:0/4134418256 >> v2:172.21.15.88:3300/0 conn(0x7fb3401b2770 0x7fb3401b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 -- 172.21.15.88:0/4134418256 >> 172.21.15.88:0/4134418256 conn(0x7fb340117390 msgr2=0x7fb3400f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 -- 172.21.15.88:0/4134418256 shutdown_connections 2023-10-18T19:34:53.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.853 7fb3477ff700 1 -- 172.21.15.88:0/4134418256 wait complete. 2023-10-18T19:34:53.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 Processor -- start 2023-10-18T19:34:53.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 -- start start 2023-10-18T19:34:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 0x7fb3401c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3400bc400 0x7fb3401c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:53.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b5cf0 con 0x7fb3400b00d0 2023-10-18T19:34:53.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400b59a0 con 0x7fb3400bc400 2023-10-18T19:34:53.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.878 7fb3477ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400d2e40 con 0x7fb3400bbfb0 2023-10-18T19:34:53.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48198/0 (socket says 172.21.15.88:48198) 2023-10-18T19:34:53.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 -- 172.21.15.88:0/2214663006 learned_addr learned my addr 172.21.15.88:0/2214663006 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:53.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb337fff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 0x7fb3401c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33ffff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3400bc400 0x7fb3401c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:53.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 -- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 msgr2=0x7fb3401c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 0x7fb3401c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 -- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3400bc400 msgr2=0x7fb3401c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3400bc400 0x7fb3401c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 -- 172.21.15.88:0/2214663006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400a8390 con 0x7fb3400b00d0 2023-10-18T19:34:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb337fff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 0x7fb3401c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33f7fe700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb3400d6040 tx=0x7fb3300068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:53.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.879 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3400a8390 con 0x7fb3400b00d0 2023-10-18T19:34:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.880 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330006a90 con 0x7fb3400b00d0 2023-10-18T19:34:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.880 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb330017040 con 0x7fb3400b00d0 2023-10-18T19:34:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.880 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3400b5310 con 0x7fb3400b00d0 2023-10-18T19:34:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.880 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3400d5090 con 0x7fb3400b00d0 2023-10-18T19:34:53.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.880 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fb330011b80 con 0x7fb3400b00d0 2023-10-18T19:34:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.881 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fb330018070 con 0x7fb3400b00d0 2023-10-18T19:34:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.881 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3400d36f0 con 0x7fb3400b00d0 2023-10-18T19:34:53.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.884 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fb33000d3b0 con 0x7fb3400b00d0 2023-10-18T19:34:53.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.982 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3400f0530 con 0x7fb3400b00d0 2023-10-18T19:34:53.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.983 7fb33d7fa700 1 -- 172.21.15.88:0/2214663006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8850 (secure 0 0 0) 0x7fb330011780 con 0x7fb3400b00d0 2023-10-18T19:34:53.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:53.986 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18 19:33:59.453951","modified":"2023-10-18 19:34:38.270136","last_up_change":"2023-10-18 19:34:06.488799","last_in_change":"2023-10-18 19:34:06.488799","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18 19:34:09.738627","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18 19:34:18.877868","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18 19:34:20.222147","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2023-10-18T19:34:53.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 >> v1:172.21.15.88:6800/107321 conn(0x7fb32401c150 legacy=0x7fb32401e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 msgr2=0x7fb3400bb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:53.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb3400d6040 tx=0x7fb3300068c0).stop 2023-10-18T19:34:53.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 shutdown_connections 2023-10-18T19:34:53.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3400bc400 0x7fb3401c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3400b00d0 0x7fb3400bb980 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 --2- 172.21.15.88:0/2214663006 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb3400bbfb0 0x7fb3401c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:53.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 >> 172.21.15.88:0/2214663006 conn(0x7fb340122150 msgr2=0x7fb340120bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:53.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 shutdown_connections 2023-10-18T19:34:53.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:53.984 7fb3477ff700 1 -- 172.21.15.88:0/2214663006 wait complete. 2023-10-18T19:34:54.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T19:34:54.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.204 7ffb1c5ff700 1 Processor -- start 2023-10-18T19:34:54.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.204 7ffb1c5ff700 1 -- start start 2023-10-18T19:34:54.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffb140f81d0 0x7ffb140f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 0x7ffb140f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140f8ed0 con 0x7ffb140f81d0 2023-10-18T19:34:54.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb141184b0 con 0x7ffb141b2ad0 2023-10-18T19:34:54.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb1c5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1410d1d0 con 0x7ffb140f8620 2023-10-18T19:34:54.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb193ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb18bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffb140f81d0 0x7ffb140f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb13fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 0x7ffb140f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb18bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffb140f81d0 0x7ffb140f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48202/0 (socket says 172.21.15.88:48202) 2023-10-18T19:34:54.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb193ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39844/0 (socket says 172.21.15.88:39844) 2023-10-18T19:34:54.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.205 7ffb18bfe700 1 -- 172.21.15.88:0/3347658855 learned_addr learned my addr 172.21.15.88:0/3347658855 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:54.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 -- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 msgr2=0x7ffb140f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:54.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 0x7ffb140f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 -- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 msgr2=0x7ffb141b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:54.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 -- 172.21.15.88:0/3347658855 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140f2200 con 0x7ffb140f81d0 2023-10-18T19:34:54.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb193ff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:54.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb13fff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 0x7ffb140f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:54.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb18bfe700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb140f81d0 0x7ffb140f0f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ffb14116370 tx=0x7ffb08009ab0).ready entity=mon.0 client_cookie=fcf56b7b34f519cf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:54.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb137fe700 1 -- 172.21.15.88:0/3347658855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb140f2200 con 0x7ffb140f81d0 2023-10-18T19:34:54.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb137fe700 1 -- 172.21.15.88:0/3347658855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800f510 con 0x7ffb140f81d0 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb137fe700 1 -- 172.21.15.88:0/3347658855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb0800f6f0 con 0x7ffb140f81d0 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb1c5ff700 1 -- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb140f81d0 msgr2=0x7ffb140f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.206 7ffb1c5ff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb140f81d0 0x7ffb140f0f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ffb14116370 tx=0x7ffb08009ab0).stop 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 -- 172.21.15.88:0/3347658855 shutdown_connections 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb141b2ad0 0x7ffb141b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb140f81d0 0x7ffb140f0f90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 --2- 172.21.15.88:0/3347658855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140f8620 0x7ffb140f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 -- 172.21.15.88:0/3347658855 >> 172.21.15.88:0/3347658855 conn(0x7ffb14125e20 msgr2=0x7ffb14126270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 -- 172.21.15.88:0/3347658855 shutdown_connections 2023-10-18T19:34:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.207 7ffb1c5ff700 1 -- 172.21.15.88:0/3347658855 wait complete. 2023-10-18T19:34:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.232 7ffb1c5ff700 1 Processor -- start 2023-10-18T19:34:54.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.232 7ffb1c5ff700 1 -- start start 2023-10-18T19:34:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 0x7ffb141c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb141c5fc0 0x7ffb141c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140e2de0 con 0x7ffb141c5fc0 2023-10-18T19:34:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140f4430 con 0x7ffb140e08a0 2023-10-18T19:34:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb1c5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140f3e90 con 0x7ffb140d5f00 2023-10-18T19:34:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb18bfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb13fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 0x7ffb141c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb18bfe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52274/0 (socket says 172.21.15.88:52274) 2023-10-18T19:34:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb18bfe700 1 -- 172.21.15.88:0/853090435 learned_addr learned my addr 172.21.15.88:0/853090435 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.233 7ffb193ff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb141c5fc0 0x7ffb141c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 -- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 msgr2=0x7ffb141c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 0x7ffb141c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 -- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb141c5fc0 msgr2=0x7ffb141c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb141c5fc0 0x7ffb141c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 -- 172.21.15.88:0/853090435 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb140d2340 con 0x7ffb140d5f00 2023-10-18T19:34:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb13fff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 0x7ffb141c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb18bfe700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ffb08009250 tx=0x7ffb080068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb140d2340 con 0x7ffb140d5f00 2023-10-18T19:34:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08011610 con 0x7ffb140d5f00 2023-10-18T19:34:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb141c35b0 con 0x7ffb140d5f00 2023-10-18T19:34:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ffb080119e0 con 0x7ffb140d5f00 2023-10-18T19:34:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.234 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb140b4af0 con 0x7ffb140d5f00 2023-10-18T19:34:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.235 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7ffb08011be0 con 0x7ffb140d5f00 2023-10-18T19:34:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.235 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ffb08013e00 con 0x7ffb140d5f00 2023-10-18T19:34:54.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.236 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb140f0870 con 0x7ffb140d5f00 2023-10-18T19:34:54.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.239 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7ffb0800f300 con 0x7ffb140d5f00 2023-10-18T19:34:54.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:54.359 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffb140d6530 con 0x7ffb140d5f00 2023-10-18T19:34:55.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.023 7ffb11ffb700 1 -- 172.21.15.88:0/853090435 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb08011400 con 0x7ffb140d5f00 2023-10-18T19:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 >> v1:172.21.15.88:6800/107321 conn(0x7ffafc01c1b0 legacy=0x7ffafc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 msgr2=0x7ffb140e0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ffb08009250 tx=0x7ffb080068c0).stop 2023-10-18T19:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 shutdown_connections 2023-10-18T19:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb141c5fc0 0x7ffb141c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb140d5f00 0x7ffb140e0270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 --2- 172.21.15.88:0/853090435 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb140e08a0 0x7ffb141c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 >> 172.21.15.88:0/853090435 conn(0x7ffb140d6a20 msgr2=0x7ffb140d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 shutdown_connections 2023-10-18T19:34:55.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.025 7ffb1c5ff700 1 -- 172.21.15.88:0/853090435 wait complete. 2023-10-18T19:34:55.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-18T19:34:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.248 7f367f7ff700 1 Processor -- start 2023-10-18T19:34:55.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.248 7f367f7ff700 1 -- start start 2023-10-18T19:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.248 7f367f7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f367f7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 0x7f36781ba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f367f7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36780abc70 con 0x7f36781b2ab0 2023-10-18T19:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f367f7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3678112280 con 0x7f367810d000 2023-10-18T19:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f367f7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36780f6d70 con 0x7f36781b7e00 2023-10-18T19:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f36777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f3677fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 0x7f36781ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f36777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48224/0 (socket says 172.21.15.88:48224) 2023-10-18T19:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f36777fe700 1 -- 172.21.15.88:0/3733711229 learned_addr learned my addr 172.21.15.88:0/3733711229 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f3677fff700 1 -- 172.21.15.88:0/3733711229 >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 msgr2=0x7f36780f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f3677fff700 1 --2- 172.21.15.88:0/3733711229 >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f3677fff700 1 -- 172.21.15.88:0/3733711229 >> v1:172.21.15.88:6789/0 conn(0x7f36781b2ab0 legacy=0x7f36781b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f3677fff700 1 -- 172.21.15.88:0/3733711229 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678111b90 con 0x7f36781b7e00 2023-10-18T19:34:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.249 7f36777fe700 1 --2- 172.21.15.88:0/3733711229 >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f3677fff700 1 --2- 172.21.15.88:0/3733711229 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 0x7f36781ba260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f36700032f0 tx=0x7f3670009c90).ready entity=mon.2 client_cookie=c609fe17dbecd4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f36767fc700 1 -- 172.21.15.88:0/3733711229 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3678111b90 con 0x7f36781b7e00 2023-10-18T19:34:55.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f36767fc700 1 -- 172.21.15.88:0/3733711229 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000b880 con 0x7f36781b7e00 2023-10-18T19:34:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f36767fc700 1 -- 172.21.15.88:0/3733711229 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f367000ba60 con 0x7f36781b7e00 2023-10-18T19:34:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 -- 172.21.15.88:0/3733711229 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 msgr2=0x7f36781ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 --2- 172.21.15.88:0/3733711229 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 0x7f36781ba260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f36700032f0 tx=0x7f3670009c90).stop 2023-10-18T19:34:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 -- 172.21.15.88:0/3733711229 shutdown_connections 2023-10-18T19:34:55.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 --2- 172.21.15.88:0/3733711229 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36781b7e00 0x7f36781ba260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 --2- 172.21.15.88:0/3733711229 >> v2:172.21.15.88:3300/0 conn(0x7f367810d000 0x7f36780f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.250 7f367f7ff700 1 -- 172.21.15.88:0/3733711229 >> 172.21.15.88:0/3733711229 conn(0x7f36781176d0 msgr2=0x7f36780f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.251 7f367f7ff700 1 -- 172.21.15.88:0/3733711229 shutdown_connections 2023-10-18T19:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.251 7f367f7ff700 1 -- 172.21.15.88:0/3733711229 wait complete. 2023-10-18T19:34:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.275 7f367f7ff700 1 Processor -- start 2023-10-18T19:34:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.275 7f367f7ff700 1 -- start start 2023-10-18T19:34:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 0x7f36781bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36780d5930 0x7f36781bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780b2f60 con 0x7f36781c5b70 2023-10-18T19:34:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36781c0300 con 0x7f36780d5930 2023-10-18T19:34:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f367f7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36780e0a80 con 0x7f36780d54e0 2023-10-18T19:34:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f3677fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f36777fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 0x7f36781bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f3677fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48226/0 (socket says 172.21.15.88:48226) 2023-10-18T19:34:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f3677fff700 1 -- 172.21.15.88:0/224400505 learned_addr learned my addr 172.21.15.88:0/224400505 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f3676ffd700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36780d5930 0x7f36781bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f36777fe700 1 -- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36780d5930 msgr2=0x7f36781bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f36777fe700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36780d5930 0x7f36781bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f36777fe700 1 -- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 msgr2=0x7f36781c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.276 7f36777fe700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f36777fe700 1 -- 172.21.15.88:0/224400505 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780cc700 con 0x7f36780d54e0 2023-10-18T19:34:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f3677fff700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f36777fe700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 0x7f36781bf5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f366800c000 tx=0x7f366800ea20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36780cc700 con 0x7f36780d54e0 2023-10-18T19:34:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668012600 con 0x7f36780d54e0 2023-10-18T19:34:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f367f7ff700 1 -- 172.21.15.88:0/224400505 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36780cc320 con 0x7f36780d54e0 2023-10-18T19:34:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f366800f040 con 0x7f36780d54e0 2023-10-18T19:34:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.277 7f367f7ff700 1 -- 172.21.15.88:0/224400505 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36781c65f0 con 0x7f36780d54e0 2023-10-18T19:34:55.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.278 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f3668011070 con 0x7f36780d54e0 2023-10-18T19:34:55.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.278 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f3668010040 con 0x7f36780d54e0 2023-10-18T19:34:55.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.278 7f367f7ff700 1 -- 172.21.15.88:0/224400505 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780f0870 con 0x7f36780d54e0 2023-10-18T19:34:55.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.281 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f36680123f0 con 0x7f36780d54e0 2023-10-18T19:34:55.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:55.401 7f367f7ff700 1 -- 172.21.15.88:0/224400505 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f36780e2350 con 0x7f36780d54e0 2023-10-18T19:34:56.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.028 7f3674ff9700 1 -- 172.21.15.88:0/224400505 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v12) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3668000c30 con 0x7f36780d54e0 2023-10-18T19:34:56.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 >> v1:172.21.15.88:6800/107321 conn(0x7f365801c1b0 legacy=0x7f365801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 msgr2=0x7f36781bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 0x7f36781bf5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f366800c000 tx=0x7f366800ea20).stop 2023-10-18T19:34:56.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 shutdown_connections 2023-10-18T19:34:56.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36781c5b70 0x7f36781c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36780d54e0 0x7f36781bf5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 --2- 172.21.15.88:0/224400505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36780d5930 0x7f36781bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 >> 172.21.15.88:0/224400505 conn(0x7f36780ccf90 msgr2=0x7f36780d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:56.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 shutdown_connections 2023-10-18T19:34:56.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.030 7f367f7ff700 1 -- 172.21.15.88:0/224400505 wait complete. 2023-10-18T19:34:56.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:56.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.248 7f82aa1ff700 1 Processor -- start 2023-10-18T19:34:56.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.248 7f82aa1ff700 1 -- start start 2023-10-18T19:34:56.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82aa1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 0x7f82a40f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:56.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82aa1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a41b7ac0 0x7f82a41b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82aa1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a4111850 con 0x7f82a41b2770 2023-10-18T19:34:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82aa1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4111f40 con 0x7f82a41b7ac0 2023-10-18T19:34:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82aa1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40f6a30 con 0x7f82a410ccc0 2023-10-18T19:34:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82a23fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 0x7f82a40f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:56.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82a1bfd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82a41b2770 0x7f82a41b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43126/0 (socket says 172.21.15.88:43126) 2023-10-18T19:34:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82a1bfd700 1 -- 172.21.15.88:0/2234286711 learned_addr learned my addr 172.21.15.88:0/2234286711 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.249 7f82a2bff700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a41b7ac0 0x7f82a41b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a23fe700 1 -- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a41b7ac0 msgr2=0x7f82a41b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a23fe700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a41b7ac0 0x7f82a41b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a23fe700 1 -- 172.21.15.88:0/2234286711 >> v1:172.21.15.88:6789/0 conn(0x7f82a41b2770 legacy=0x7f82a41b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a13fc700 1 -- 172.21.15.88:0/2234286711 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608070807 0 0) 0x7f8298001110 con 0x7f82a41b2770 2023-10-18T19:34:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a23fe700 1 -- 172.21.15.88:0/2234286711 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a410d6f0 con 0x7f82a410ccc0 2023-10-18T19:34:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a23fe700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 0x7f82a40f6400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8294002f70 tx=0x7f829400b9a0).ready entity=mon.2 client_cookie=5bed0bed5fa1600b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a13fc700 1 -- 172.21.15.88:0/2234286711 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82a410d6f0 con 0x7f82a410ccc0 2023-10-18T19:34:56.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a13fc700 1 -- 172.21.15.88:0/2234286711 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400d570 con 0x7f82a410ccc0 2023-10-18T19:34:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82a13fc700 1 -- 172.21.15.88:0/2234286711 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f829400d940 con 0x7f82a410ccc0 2023-10-18T19:34:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82aa1ff700 1 -- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 msgr2=0x7f82a40f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.250 7f82aa1ff700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 0x7f82a40f6400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8294002f70 tx=0x7f829400b9a0).stop 2023-10-18T19:34:56.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 -- 172.21.15.88:0/2234286711 shutdown_connections 2023-10-18T19:34:56.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a41b7ac0 0x7f82a41b9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 --2- 172.21.15.88:0/2234286711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a410ccc0 0x7f82a40f6400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 -- 172.21.15.88:0/2234286711 >> 172.21.15.88:0/2234286711 conn(0x7f82a4117390 msgr2=0x7f82a40f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:56.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 -- 172.21.15.88:0/2234286711 shutdown_connections 2023-10-18T19:34:56.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.251 7f82aa1ff700 1 -- 172.21.15.88:0/2234286711 wait complete. 2023-10-18T19:34:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.275 7f82aa1ff700 1 Processor -- start 2023-10-18T19:34:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.275 7f82aa1ff700 1 -- start start 2023-10-18T19:34:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41c37c0 0x7f82a41c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40a7e40 con 0x7f82a41c37c0 2023-10-18T19:34:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b0b00 con 0x7f82a40b0fa0 2023-10-18T19:34:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82aa1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b1bf0 con 0x7f82a40b13f0 2023-10-18T19:34:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a1bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a23fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a1bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39160/0 (socket says 172.21.15.88:39160) 2023-10-18T19:34:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a1bfd700 1 -- 172.21.15.88:0/1208521298 learned_addr learned my addr 172.21.15.88:0/1208521298 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a23fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34438/0 (socket says 172.21.15.88:34438) 2023-10-18T19:34:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.276 7f82a2bff700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41c37c0 0x7f82a41c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 -- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 msgr2=0x7f82a40d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 -- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41c37c0 msgr2=0x7f82a41c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41c37c0 0x7f82a41c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 -- 172.21.15.88:0/1208521298 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40d11d0 con 0x7f82a40b0fa0 2023-10-18T19:34:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a1bfd700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82a23fe700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f82a40d3c90 tx=0x7f82940068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f82a40d11d0 con 0x7f82a40b0fa0 2023-10-18T19:34:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8294011760 con 0x7f82a40b0fa0 2023-10-18T19:34:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a41c4240 con 0x7f82a40b0fa0 2023-10-18T19:34:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.277 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8294017040 con 0x7f82a40b0fa0 2023-10-18T19:34:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.278 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41cab20 con 0x7f82a40b0fa0 2023-10-18T19:34:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.278 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f8294011b30 con 0x7f82a40b0fa0 2023-10-18T19:34:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.278 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8294018070 con 0x7f82a40b0fa0 2023-10-18T19:34:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.279 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40f0530 con 0x7f82a40b0fa0 2023-10-18T19:34:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.282 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f829400d360 con 0x7f82a40b0fa0 2023-10-18T19:34:56.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.400 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82a40a5f60 con 0x7f82a40b0fa0 2023-10-18T19:34:56.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.400 7f82937fe700 1 -- 172.21.15.88:0/1208521298 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f8294011550 con 0x7f82a40b0fa0 2023-10-18T19:34:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:56.404 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 >> v1:172.21.15.88:6800/107321 conn(0x7f828001c1b0 legacy=0x7f828001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 msgr2=0x7f82a40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:56.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f82a40d3c90 tx=0x7f82940068c0).stop 2023-10-18T19:34:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 shutdown_connections 2023-10-18T19:34:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41c37c0 0x7f82a41c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f82a40b0fa0 0x7f82a40d0570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 --2- 172.21.15.88:0/1208521298 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f82a40b13f0 0x7f82a40d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:56.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 >> 172.21.15.88:0/1208521298 conn(0x7f82a40d6220 msgr2=0x7f82a40adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 shutdown_connections 2023-10-18T19:34:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:56.402 7f82aa1ff700 1 -- 172.21.15.88:0/1208521298 wait complete. 2023-10-18T19:34:56.407 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:34:56.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:34:56.723 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:34:57.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:57.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.932 7f183659d700 1 Processor -- start 2023-10-18T19:34:57.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 -- start start 2023-10-18T19:34:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 0x7f18301b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:57.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1830111640 con 0x7f18300f12d0 2023-10-18T19:34:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183010d040 con 0x7f18300f6230 2023-10-18T19:34:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f183659d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830111d30 con 0x7f18300f6680 2023-10-18T19:34:57.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f182f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.933 7f1827fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 0x7f18301b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:57.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43400/0 (socket says 172.21.15.88:43400) 2023-10-18T19:34:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182f7fe700 1 -- 172.21.15.88:0/3730415599 learned_addr learned my addr 172.21.15.88:0/3730415599 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f1827fff700 1 -- 172.21.15.88:0/3730415599 >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 msgr2=0x7f18301b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f1827fff700 1 --2- 172.21.15.88:0/3730415599 >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:57.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f1827fff700 1 -- 172.21.15.88:0/3730415599 >> v1:172.21.15.88:6789/0 conn(0x7f18300f12d0 legacy=0x7f18300f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182effd700 1 -- 172.21.15.88:0/3730415599 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080740281 0 0) 0x7f1828001490 con 0x7f18300f12d0 2023-10-18T19:34:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f1827fff700 1 -- 172.21.15.88:0/3730415599 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183010d560 con 0x7f18300f6680 2023-10-18T19:34:57.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182f7fe700 1 --2- 172.21.15.88:0/3730415599 >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f1827fff700 1 --2- 172.21.15.88:0/3730415599 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 0x7f18301b2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1818002f70 tx=0x7f181800dd30).ready entity=mon.1 client_cookie=daaad987a2b6ea1a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182effd700 1 -- 172.21.15.88:0/3730415599 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f183010d560 con 0x7f18300f6680 2023-10-18T19:34:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182effd700 1 -- 172.21.15.88:0/3730415599 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800f7d0 con 0x7f18300f6680 2023-10-18T19:34:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f182effd700 1 -- 172.21.15.88:0/3730415599 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1818013070 con 0x7f18300f6680 2023-10-18T19:34:57.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f183659d700 1 -- 172.21.15.88:0/3730415599 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 msgr2=0x7f18301b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.934 7f183659d700 1 --2- 172.21.15.88:0/3730415599 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 0x7f18301b2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f1818002f70 tx=0x7f181800dd30).stop 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 -- 172.21.15.88:0/3730415599 shutdown_connections 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 --2- 172.21.15.88:0/3730415599 >> v2:172.21.15.88:3300/0 conn(0x7f18300f6230 0x7f18301b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 --2- 172.21.15.88:0/3730415599 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18300f6680 0x7f18301b2b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 -- 172.21.15.88:0/3730415599 >> 172.21.15.88:0/3730415599 conn(0x7f1830117180 msgr2=0x7f18300f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:57.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 -- 172.21.15.88:0/3730415599 shutdown_connections 2023-10-18T19:34:57.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.935 7f183659d700 1 -- 172.21.15.88:0/3730415599 wait complete. 2023-10-18T19:34:57.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.960 7f183659d700 1 Processor -- start 2023-10-18T19:34:57.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.960 7f183659d700 1 -- start start 2023-10-18T19:34:57.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 0x7f18301c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:57.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:57.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18301c24c0 0x7f18300d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:57.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300f69e0 con 0x7f18300d0ba0 2023-10-18T19:34:57.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300d3d50 con 0x7f18301c24c0 2023-10-18T19:34:57.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f183659d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18300dc780 con 0x7f18301c2070 2023-10-18T19:34:57.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f1827fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:57.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f1827fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39166/0 (socket says 172.21.15.88:39166) 2023-10-18T19:34:57.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f182f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 0x7f18301c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f1827fff700 1 -- 172.21.15.88:0/102477168 learned_addr learned my addr 172.21.15.88:0/102477168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.961 7f182ffff700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18301c24c0 0x7f18300d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 -- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18301c24c0 msgr2=0x7f18300d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18301c24c0 0x7f18300d30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 -- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 msgr2=0x7f18301c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 0x7f18301c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:57.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 -- 172.21.15.88:0/102477168 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300dd1b0 con 0x7f18301c2070 2023-10-18T19:34:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f182f7fe700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 0x7f18301c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f1827fff700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f18301b51f0 tx=0x7f18180068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1818017a90 con 0x7f18301c2070 2023-10-18T19:34:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818017c90 con 0x7f18301c2070 2023-10-18T19:34:57.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f183659d700 1 -- 172.21.15.88:0/102477168 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18300dc460 con 0x7f18301c2070 2023-10-18T19:34:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.962 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f181800b640 con 0x7f18301c2070 2023-10-18T19:34:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.963 7f183659d700 1 -- 172.21.15.88:0/102477168 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300d0ff0 con 0x7f18301c2070 2023-10-18T19:34:57.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.963 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f181802a060 con 0x7f18301c2070 2023-10-18T19:34:57.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.963 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1818006430 con 0x7f18301c2070 2023-10-18T19:34:57.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.964 7f183659d700 1 -- 172.21.15.88:0/102477168 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18300f0320 con 0x7f18301c2070 2023-10-18T19:34:57.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:57.967 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f181801f070 con 0x7f18301c2070 2023-10-18T19:34:58.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.088 7f183659d700 1 -- 172.21.15.88:0/102477168 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18300dca10 con 0x7f18301c2070 2023-10-18T19:34:58.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.088 7f182d7fa700 1 -- 172.21.15.88:0/102477168 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f181800d0d0 con 0x7f18301c2070 2023-10-18T19:34:58.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:58.091 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:58.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.089 7f183659d700 1 -- 172.21.15.88:0/102477168 >> v1:172.21.15.88:6800/107321 conn(0x7f181401c1b0 legacy=0x7f181401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:58.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.089 7f183659d700 1 -- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 msgr2=0x7f18300d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:58.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.089 7f183659d700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f18301b51f0 tx=0x7f18180068c0).stop 2023-10-18T19:34:58.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.089 7f183659d700 1 -- 172.21.15.88:0/102477168 shutdown_connections 2023-10-18T19:34:58.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.089 7f183659d700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18301c24c0 0x7f18300d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:58.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.090 7f183659d700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18300d0ba0 0x7f18301c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:58.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.090 7f183659d700 1 --2- 172.21.15.88:0/102477168 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f18301c2070 0x7f18300d2aa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:58.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.090 7f183659d700 1 -- 172.21.15.88:0/102477168 >> 172.21.15.88:0/102477168 conn(0x7f18300e0ab0 msgr2=0x7f18300df630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:58.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.090 7f183659d700 1 -- 172.21.15.88:0/102477168 shutdown_connections 2023-10-18T19:34:58.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:58.090 7f183659d700 1 -- 172.21.15.88:0/102477168 wait complete. 2023-10-18T19:34:58.095 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:34:58.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:34:58.412 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:34:59.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:34:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.619 7f9670dff700 1 Processor -- start 2023-10-18T19:34:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.619 7f9670dff700 1 -- start start 2023-10-18T19:34:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.619 7f9670dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 0x7f966c0f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9670dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0f1f60 0x7f966c1b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9670dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c0f23b0 con 0x7f966c10ccc0 2023-10-18T19:34:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9670dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c111f40 con 0x7f966c0f1f60 2023-10-18T19:34:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9670dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f966c111850 con 0x7f966c0f14e0 2023-10-18T19:34:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f96691fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f966c10ccc0 0x7f966c0f6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43140/0 (socket says 172.21.15.88:43140) 2023-10-18T19:34:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9663fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 0x7f966c0f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f96691fe700 1 -- 172.21.15.88:0/1000922592 learned_addr learned my addr 172.21.15.88:0/1000922592 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:34:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f96699ff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0f1f60 0x7f966c1b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9663fff700 1 -- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0f1f60 msgr2=0x7f966c1b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:34:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9663fff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0f1f60 0x7f966c1b9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9663fff700 1 -- 172.21.15.88:0/1000922592 >> v1:172.21.15.88:6789/0 conn(0x7f966c10ccc0 legacy=0x7f966c0f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.620 7f9663fff700 1 -- 172.21.15.88:0/1000922592 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c10d6f0 con 0x7f966c0f14e0 2023-10-18T19:34:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9663fff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 0x7f966c0f1930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9654002f70 tx=0x7f965400b9a0).ready entity=mon.2 client_cookie=1d6af63bbcec412c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f96689fd700 1 -- 172.21.15.88:0/1000922592 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f966c10d6f0 con 0x7f966c0f14e0 2023-10-18T19:34:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f96689fd700 1 -- 172.21.15.88:0/1000922592 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400d570 con 0x7f966c0f14e0 2023-10-18T19:34:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f96689fd700 1 -- 172.21.15.88:0/1000922592 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f965400d940 con 0x7f966c0f14e0 2023-10-18T19:34:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 -- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 msgr2=0x7f966c0f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 0x7f966c0f1930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f9654002f70 tx=0x7f965400b9a0).stop 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 -- 172.21.15.88:0/1000922592 shutdown_connections 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0f1f60 0x7f966c1b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 --2- 172.21.15.88:0/1000922592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c0f14e0 0x7f966c0f1930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.621 7f9670dff700 1 -- 172.21.15.88:0/1000922592 >> 172.21.15.88:0/1000922592 conn(0x7f966c117390 msgr2=0x7f966c0f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.622 7f9670dff700 1 -- 172.21.15.88:0/1000922592 shutdown_connections 2023-10-18T19:34:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.622 7f9670dff700 1 -- 172.21.15.88:0/1000922592 wait complete. 2023-10-18T19:34:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 Processor -- start 2023-10-18T19:34:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 -- start start 2023-10-18T19:34:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 0x7f966c0dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0bca20 con 0x7f966c0bd650 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0bdaa0 con 0x7f966c0bd200 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.646 7f9670dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0bcd60 con 0x7f966c1c5e10 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f9663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96691fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 0x7f966c0dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:34:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f9663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43404/0 (socket says 172.21.15.88:43404) 2023-10-18T19:34:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96691fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 0x7f966c0dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34474/0 (socket says 172.21.15.88:34474) 2023-10-18T19:34:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39186/0 (socket says 172.21.15.88:39186) 2023-10-18T19:34:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f9663fff700 1 -- 172.21.15.88:0/711269214 learned_addr learned my addr 172.21.15.88:0/711269214 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:34:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 -- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 msgr2=0x7f966c0dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 0x7f966c0dfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 -- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 msgr2=0x7f966c0e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 -- 172.21.15.88:0/711269214 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0bc000 con 0x7f966c1c5e10 2023-10-18T19:34:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f9663fff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:34:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.647 7f96699ff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f966c10d1d0 tx=0x7f966400ed80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:34:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f966c0bc000 con 0x7f966c1c5e10 2023-10-18T19:34:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400c900 con 0x7f966c1c5e10 2023-10-18T19:34:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f9670dff700 1 -- 172.21.15.88:0/711269214 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c1c0470 con 0x7f966c1c5e10 2023-10-18T19:34:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f966400f040 con 0x7f966c1c5e10 2023-10-18T19:34:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f9670dff700 1 -- 172.21.15.88:0/711269214 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c1c6890 con 0x7f966c1c5e10 2023-10-18T19:34:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.648 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9664022060 con 0x7f966c1c5e10 2023-10-18T19:34:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.649 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9664010040 con 0x7f966c1c5e10 2023-10-18T19:34:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.649 7f9670dff700 1 -- 172.21.15.88:0/711269214 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0f0530 con 0x7f966c1c5e10 2023-10-18T19:34:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.652 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f966400c6f0 con 0x7f966c1c5e10 2023-10-18T19:34:59.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.771 7f9670dff700 1 -- 172.21.15.88:0/711269214 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f966c0a5f60 con 0x7f966c1c5e10 2023-10-18T19:34:59.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.771 7f96627fc700 1 -- 172.21.15.88:0/711269214 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f966c0ffc70 con 0x7f966c1c5e10 2023-10-18T19:34:59.774 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:34:59.775 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:34:59.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 >> v1:172.21.15.88:6800/107321 conn(0x7f965001c1b0 legacy=0x7f965001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 msgr2=0x7f966c1c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:34:59.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f966c10d1d0 tx=0x7f966400ed80).stop 2023-10-18T19:34:59.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 shutdown_connections 2023-10-18T19:34:59.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f966c1c5e10 0x7f966c1c6260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f966c0bd200 0x7f966c0dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 --2- 172.21.15.88:0/711269214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f966c0bd650 0x7f966c0e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:34:59.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 >> 172.21.15.88:0/711269214 conn(0x7f966c0d6770 msgr2=0x7f966c0d36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:34:59.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 shutdown_connections 2023-10-18T19:34:59.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:34:59.773 7f9670dff700 1 -- 172.21.15.88:0/711269214 wait complete. 2023-10-18T19:34:59.779 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:00.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:00.094 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:01.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:01.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.301 7fdd85b9d700 1 Processor -- start 2023-10-18T19:35:01.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.301 7fdd85b9d700 1 -- start start 2023-10-18T19:35:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd85b9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd85b9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd801b24a0 0x7fdd801037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd85b9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800ff840 con 0x7fdd801b2050 2023-10-18T19:35:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd85b9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd80116250 con 0x7fdd801b24a0 2023-10-18T19:35:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd85b9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801115b0 con 0x7fdd800f6410 2023-10-18T19:35:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7effe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7f7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd801b24a0 0x7fdd801037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7effe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34478/0 (socket says 172.21.15.88:34478) 2023-10-18T19:35:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7f7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdd801b24a0 0x7fdd801037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43412/0 (socket says 172.21.15.88:43412) 2023-10-18T19:35:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7effe700 1 -- 172.21.15.88:0/2795249897 learned_addr learned my addr 172.21.15.88:0/2795249897 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.302 7fdd7e7fd700 1 --1- 172.21.15.88:0/2795249897 >> v1:172.21.15.88:6789/0 conn(0x7fdd801b2050 0x7fdd80102fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43142/0 (socket says 172.21.15.88:43142) 2023-10-18T19:35:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7f7ff700 1 -- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 msgr2=0x7fdd801b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7f7ff700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7f7ff700 1 -- 172.21.15.88:0/2795249897 >> v1:172.21.15.88:6789/0 conn(0x7fdd801b2050 legacy=0x7fdd80102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7f7ff700 1 -- 172.21.15.88:0/2795249897 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80103dd0 con 0x7fdd801b24a0 2023-10-18T19:35:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7effe700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7dffc700 1 -- 172.21.15.88:0/2795249897 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135502799 0 0) 0x7fdd74001110 con 0x7fdd801b2050 2023-10-18T19:35:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7f7ff700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd801b24a0 0x7fdd801037a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdd780032f0 tx=0x7fdd78009d10).ready entity=mon.0 client_cookie=196dbca60141d5b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7dffc700 1 -- 172.21.15.88:0/2795249897 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd80103dd0 con 0x7fdd801b24a0 2023-10-18T19:35:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7dffc700 1 -- 172.21.15.88:0/2795249897 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800b800 con 0x7fdd801b24a0 2023-10-18T19:35:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd7dffc700 1 -- 172.21.15.88:0/2795249897 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd7800b9e0 con 0x7fdd801b24a0 2023-10-18T19:35:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd85b9d700 1 -- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd801b24a0 msgr2=0x7fdd801037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.303 7fdd85b9d700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd801b24a0 0x7fdd801037a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fdd780032f0 tx=0x7fdd78009d10).stop 2023-10-18T19:35:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 -- 172.21.15.88:0/2795249897 shutdown_connections 2023-10-18T19:35:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd801b24a0 0x7fdd801037a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 --2- 172.21.15.88:0/2795249897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd800f6410 0x7fdd801b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 -- 172.21.15.88:0/2795249897 >> 172.21.15.88:0/2795249897 conn(0x7fdd80117180 msgr2=0x7fdd800f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:01.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 -- 172.21.15.88:0/2795249897 shutdown_connections 2023-10-18T19:35:01.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.304 7fdd85b9d700 1 -- 172.21.15.88:0/2795249897 wait complete. 2023-10-18T19:35:01.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 Processor -- start 2023-10-18T19:35:01.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 -- start start 2023-10-18T19:35:01.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 0x7fdd800d1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:01.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:01.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800e23f0 con 0x7fdd800df200 2023-10-18T19:35:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800dfc20 con 0x7fdd801b2560 2023-10-18T19:35:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.329 7fdd85b9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801b3800 con 0x7fdd800d1fb0 2023-10-18T19:35:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7e7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:01.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7f7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7e7fd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39190/0 (socket says 172.21.15.88:39190) 2023-10-18T19:35:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7f7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43424/0 (socket says 172.21.15.88:43424) 2023-10-18T19:35:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7e7fd700 1 -- 172.21.15.88:0/1512340898 learned_addr learned my addr 172.21.15.88:0/1512340898 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 0x7fdd800d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:01.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 -- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 msgr2=0x7fdd800debd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 -- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 msgr2=0x7fdd801c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 -- 172.21.15.88:0/1512340898 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd801b2f60 con 0x7fdd801b2560 2023-10-18T19:35:01.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7e7fd700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7f7ff700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.330 7fdd7effe700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 0x7fdd800d1980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdd800e0110 tx=0x7fdd7000de30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd801b2f60 con 0x7fdd801b2560 2023-10-18T19:35:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70014040 con 0x7fdd801b2560 2023-10-18T19:35:01.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd800e0bc0 con 0x7fdd801b2560 2023-10-18T19:35:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fdd70010990 con 0x7fdd801b2560 2023-10-18T19:35:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd801b1860 con 0x7fdd801b2560 2023-10-18T19:35:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.331 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fdd70010b90 con 0x7fdd801b2560 2023-10-18T19:35:01.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.332 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fdd7002dc90 con 0x7fdd801b2560 2023-10-18T19:35:01.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.332 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd800f0320 con 0x7fdd801b2560 2023-10-18T19:35:01.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.335 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fdd70000c30 con 0x7fdd801b2560 2023-10-18T19:35:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.456 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd800e2d60 con 0x7fdd801b2560 2023-10-18T19:35:01.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.457 7fdd6ffff700 1 -- 172.21.15.88:0/1512340898 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7fdd7000d0d0 con 0x7fdd801b2560 2023-10-18T19:35:01.460 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:01.460 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:01.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 >> v1:172.21.15.88:6800/107321 conn(0x7fdd5c01c1b0 legacy=0x7fdd5c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 msgr2=0x7fdd800d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 0x7fdd800d1980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdd800e0110 tx=0x7fdd7000de30).stop 2023-10-18T19:35:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 shutdown_connections 2023-10-18T19:35:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd800df200 0x7fdd801c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdd801b2560 0x7fdd800d1980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 --2- 172.21.15.88:0/1512340898 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdd800d1fb0 0x7fdd800debd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 >> 172.21.15.88:0/1512340898 conn(0x7fdd801b3ba0 msgr2=0x7fdd800da9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 shutdown_connections 2023-10-18T19:35:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:01.458 7fdd85b9d700 1 -- 172.21.15.88:0/1512340898 wait complete. 2023-10-18T19:35:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:01.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:01.780 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:02.781 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:02.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.987 7fd047fff700 1 Processor -- start 2023-10-18T19:35:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 -- start start 2023-10-18T19:35:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 0x7fd0400f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 0x7fd0401b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0400f23b0 con 0x7fd04010ccc0 2023-10-18T19:35:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040111f40 con 0x7fd0400f14e0 2023-10-18T19:35:02.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.988 7fd047fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd040111850 con 0x7fd0400f1f60 2023-10-18T19:35:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd03ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd04010ccc0 0x7fd0400f6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43144/0 (socket says 172.21.15.88:43144) 2023-10-18T19:35:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 0x7fd0401b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:02.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd03ffff700 1 -- 172.21.15.88:0/2162771386 learned_addr learned my addr 172.21.15.88:0/2162771386 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:35:02.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd037fff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 0x7fd0400f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:02.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 -- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 msgr2=0x7fd0400f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:02.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 0x7fd0400f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:02.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd03f7fe700 1 -- 172.21.15.88:0/2162771386 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455231708 0 0) 0x7fd030001110 con 0x7fd04010ccc0 2023-10-18T19:35:02.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 -- 172.21.15.88:0/2162771386 >> v1:172.21.15.88:6789/0 conn(0x7fd04010ccc0 legacy=0x7fd0400f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 -- 172.21.15.88:0/2162771386 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04010d6f0 con 0x7fd0400f1f60 2023-10-18T19:35:03.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd037fff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 0x7fd0400f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:03.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd044dff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 0x7fd0401b9ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd0380032f0 tx=0x7fd038009cc0).ready entity=mon.2 client_cookie=7c774a25856e6741 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:03.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd03f7fe700 1 -- 172.21.15.88:0/2162771386 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd04010d6f0 con 0x7fd0400f1f60 2023-10-18T19:35:03.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.989 7fd03f7fe700 1 -- 172.21.15.88:0/2162771386 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800b880 con 0x7fd0400f1f60 2023-10-18T19:35:03.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd03f7fe700 1 -- 172.21.15.88:0/2162771386 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd03800ba60 con 0x7fd0400f1f60 2023-10-18T19:35:03.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 -- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 msgr2=0x7fd0401b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 0x7fd0401b9ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd0380032f0 tx=0x7fd038009cc0).stop 2023-10-18T19:35:03.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 -- 172.21.15.88:0/2162771386 shutdown_connections 2023-10-18T19:35:03.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0400f1f60 0x7fd0401b9ad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 --2- 172.21.15.88:0/2162771386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400f14e0 0x7fd0400f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 -- 172.21.15.88:0/2162771386 >> 172.21.15.88:0/2162771386 conn(0x7fd040117390 msgr2=0x7fd0400f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:03.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 -- 172.21.15.88:0/2162771386 shutdown_connections 2023-10-18T19:35:03.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:02.990 7fd047fff700 1 -- 172.21.15.88:0/2162771386 wait complete. 2023-10-18T19:35:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 Processor -- start 2023-10-18T19:35:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 -- start start 2023-10-18T19:35:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 0x7fd0401bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0401c38e0 con 0x7fd0401c0020 2023-10-18T19:35:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b6e90 con 0x7fd0400ca330 2023-10-18T19:35:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.015 7fd047fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b6720 con 0x7fd0401bfbd0 2023-10-18T19:35:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd03ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 0x7fd0401bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd044dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39208/0 (socket says 172.21.15.88:39208) 2023-10-18T19:35:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd03ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 0x7fd0401bf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34502/0 (socket says 172.21.15.88:34502) 2023-10-18T19:35:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd044dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43440/0 (socket says 172.21.15.88:43440) 2023-10-18T19:35:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 -- 172.21.15.88:0/1472986124 learned_addr learned my addr 172.21.15.88:0/1472986124 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 -- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 msgr2=0x7fd0401bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 0x7fd0401bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 -- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 msgr2=0x7fd0401c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 -- 172.21.15.88:0/1472986124 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400b6bd0 con 0x7fd0401bfbd0 2023-10-18T19:35:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd044dff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd037fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd02800c000 tx=0x7fd02800eb40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.016 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd0400b6bd0 con 0x7fd0401bfbd0 2023-10-18T19:35:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02800c7f0 con 0x7fd0401bfbd0 2023-10-18T19:35:03.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd02800f040 con 0x7fd0401bfbd0 2023-10-18T19:35:03.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd047fff700 1 -- 172.21.15.88:0/1472986124 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400dfc90 con 0x7fd0401bfbd0 2023-10-18T19:35:03.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd047fff700 1 -- 172.21.15.88:0/1472986124 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0400ca780 con 0x7fd0401bfbd0 2023-10-18T19:35:03.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd028011070 con 0x7fd0401bfbd0 2023-10-18T19:35:03.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.017 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd028010040 con 0x7fd0401bfbd0 2023-10-18T19:35:03.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.018 7fd047fff700 1 -- 172.21.15.88:0/1472986124 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0400f0530 con 0x7fd0401bfbd0 2023-10-18T19:35:03.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.021 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd02800c3f0 con 0x7fd0401bfbd0 2023-10-18T19:35:03.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.137 7fd047fff700 1 -- 172.21.15.88:0/1472986124 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0400a5f60 con 0x7fd0401bfbd0 2023-10-18T19:35:03.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.138 7fd03dffb700 1 -- 172.21.15.88:0/1472986124 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7fd028000c30 con 0x7fd0401bfbd0 2023-10-18T19:35:03.141 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:03.141 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:03.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 >> v1:172.21.15.88:6800/107321 conn(0x7fd02401c150 legacy=0x7fd02401e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 msgr2=0x7fd0401c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:03.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd02800c000 tx=0x7fd02800eb40).stop 2023-10-18T19:35:03.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 shutdown_connections 2023-10-18T19:35:03.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0401c0020 0x7fd0401c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd0400ca330 0x7fd0401bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 --2- 172.21.15.88:0/1472986124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd0401bfbd0 0x7fd0401c5cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:03.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 >> 172.21.15.88:0/1472986124 conn(0x7fd0400e0790 msgr2=0x7fd040121030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:03.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 shutdown_connections 2023-10-18T19:35:03.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:03.139 7fd047fff700 1 -- 172.21.15.88:0/1472986124 wait complete. 2023-10-18T19:35:03.145 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:03.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:03.461 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:04.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:04.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.671 7f9198f9d700 1 Processor -- start 2023-10-18T19:35:04.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.671 7f9198f9d700 1 -- start start 2023-10-18T19:35:04.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 0x7f91940f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941b2790 0x7f91941b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919410d650 con 0x7f91940f6b90 2023-10-18T19:35:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919410cce0 con 0x7f91940f6740 2023-10-18T19:35:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9198f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91940f2160 con 0x7f91941b2790 2023-10-18T19:35:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9191bfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 0x7f91940f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34514/0 (socket says 172.21.15.88:34514) 2023-10-18T19:35:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 -- 172.21.15.88:0/2140946777 learned_addr learned my addr 172.21.15.88:0/2140946777 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9192bff700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941b2790 0x7f91941b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 -- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941b2790 msgr2=0x7f91941b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:04.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941b2790 0x7f91941b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 -- 172.21.15.88:0/2140946777 >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 msgr2=0x7f91940f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 --2- 172.21.15.88:0/2140946777 >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 0x7f91940f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f91923fe700 1 -- 172.21.15.88:0/2140946777 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91941b3210 con 0x7f91940f6740 2023-10-18T19:35:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.672 7f9191bfd700 1 --2- 172.21.15.88:0/2140946777 >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 0x7f91940f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f91923fe700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9184002f70 tx=0x7f9184009a50).ready entity=mon.1 client_cookie=1315890e895c5eeb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f91913fc700 1 -- 172.21.15.88:0/2140946777 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91941b3210 con 0x7f91940f6740 2023-10-18T19:35:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f91913fc700 1 -- 172.21.15.88:0/2140946777 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918400f510 con 0x7f91940f6740 2023-10-18T19:35:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f91913fc700 1 -- 172.21.15.88:0/2140946777 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f918400f6f0 con 0x7f91940f6740 2023-10-18T19:35:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f9198f9d700 1 -- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 msgr2=0x7f91940f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.673 7f9198f9d700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9184002f70 tx=0x7f9184009a50).stop 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 -- 172.21.15.88:0/2140946777 shutdown_connections 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941b2790 0x7f91941b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 --2- 172.21.15.88:0/2140946777 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940f6740 0x7f91940f1500 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 --2- 172.21.15.88:0/2140946777 >> v2:172.21.15.88:3300/0 conn(0x7f91940f6b90 0x7f91940f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 -- 172.21.15.88:0/2140946777 >> 172.21.15.88:0/2140946777 conn(0x7f91941173b0 msgr2=0x7f91940f2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 -- 172.21.15.88:0/2140946777 shutdown_connections 2023-10-18T19:35:04.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.674 7f9198f9d700 1 -- 172.21.15.88:0/2140946777 wait complete. 2023-10-18T19:35:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.698 7f9198f9d700 1 Processor -- start 2023-10-18T19:35:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.698 7f9198f9d700 1 -- start start 2023-10-18T19:35:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 0x7f91941be360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91941be990 0x7f91941c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:04.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940e2830 con 0x7f91941be990 2023-10-18T19:35:04.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91941b44a0 con 0x7f91940cc430 2023-10-18T19:35:04.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9198f9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91941b40e0 con 0x7f91941bdf10 2023-10-18T19:35:04.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f9191bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 0x7f91941be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.699 7f91923fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f9191bfd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 0x7f91941be360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39230/0 (socket says 172.21.15.88:39230) 2023-10-18T19:35:04.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f9192bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91941be990 0x7f91941c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:04.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f9191bfd700 1 -- 172.21.15.88:0/4232018080 learned_addr learned my addr 172.21.15.88:0/4232018080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:04.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:34518/0 (socket says 172.21.15.88:34518) 2023-10-18T19:35:04.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 -- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 msgr2=0x7f91941be360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:04.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 0x7f91941be360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 -- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91941be990 msgr2=0x7f91941c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:04.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91941be990 0x7f91941c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 -- 172.21.15.88:0/4232018080 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940cd310 con 0x7f91940cc430 2023-10-18T19:35:04.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91923fe700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9184002f70 tx=0x7f91840068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:04.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91940cd310 con 0x7f91940cc430 2023-10-18T19:35:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9184011610 con 0x7f91940cc430 2023-10-18T19:35:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91941c1730 con 0x7f91940cc430 2023-10-18T19:35:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.700 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9184022070 con 0x7f91940cc430 2023-10-18T19:35:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.701 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91941c1bd0 con 0x7f91940cc430 2023-10-18T19:35:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.701 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f91840119e0 con 0x7f91940cc430 2023-10-18T19:35:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.701 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9184008dd0 con 0x7f91940cc430 2023-10-18T19:35:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.702 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91940f0550 con 0x7f91940cc430 2023-10-18T19:35:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.705 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f9184011400 con 0x7f91940cc430 2023-10-18T19:35:04.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.823 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91940a5e40 con 0x7f91940cc430 2023-10-18T19:35:04.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.824 7f91837fe700 1 -- 172.21.15.88:0/4232018080 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f918400f300 con 0x7f91940cc430 2023-10-18T19:35:04.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:04.827 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:04.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 >> v1:172.21.15.88:6800/107321 conn(0x7f917001c1b0 legacy=0x7f917001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:04.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 msgr2=0x7f91940cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:04.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9184002f70 tx=0x7f91840068c0).stop 2023-10-18T19:35:04.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 shutdown_connections 2023-10-18T19:35:04.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91941be990 0x7f91941c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f91940cc430 0x7f91940cc880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 --2- 172.21.15.88:0/4232018080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f91941bdf10 0x7f91941be360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:04.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 >> 172.21.15.88:0/4232018080 conn(0x7f91940e08d0 msgr2=0x7f91940df4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:04.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.825 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 shutdown_connections 2023-10-18T19:35:04.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:04.826 7f9198f9d700 1 -- 172.21.15.88:0/4232018080 wait complete. 2023-10-18T19:35:04.831 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:05.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:05.148 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:06.149 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:06.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.356 7f21991ff700 1 Processor -- start 2023-10-18T19:35:06.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.356 7f21991ff700 1 -- start start 2023-10-18T19:35:06.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21991ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:06.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21991ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 0x7f21941b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:06.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21991ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21940ffa50 con 0x7f2194103c30 2023-10-18T19:35:06.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21991ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21941117c0 con 0x7f21941037e0 2023-10-18T19:35:06.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21991ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2194104080 con 0x7f21940f6620 2023-10-18T19:35:06.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21915fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:06.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f2190dfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 0x7f21941b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:06.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f21915fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:45512/0 (socket says 172.21.15.88:45512) 2023-10-18T19:35:06.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 -- 172.21.15.88:0/1558463968 learned_addr learned my addr 172.21.15.88:0/1558463968 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:06.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.357 7f2190dfd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 0x7f21941b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60546/0 (socket says 172.21.15.88:60546) 2023-10-18T19:35:06.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f2191dff700 1 --1- 172.21.15.88:0/1558463968 >> v1:172.21.15.88:6789/0 conn(0x7f2194103c30 0x7f21941b8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48226/0 (socket says 172.21.15.88:48226) 2023-10-18T19:35:06.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f2183fff700 1 -- 172.21.15.88:0/1558463968 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234120306 0 0) 0x7f218c001490 con 0x7f2194103c30 2023-10-18T19:35:06.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 -- 172.21.15.88:0/1558463968 >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 msgr2=0x7f21941b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:06.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 --2- 172.21.15.88:0/1558463968 >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 0x7f21941b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 -- 172.21.15.88:0/1558463968 >> v1:172.21.15.88:6789/0 conn(0x7f2194103c30 legacy=0x7f21941b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 -- 172.21.15.88:0/1558463968 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219410c3e0 con 0x7f21940f6620 2023-10-18T19:35:06.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21915fe700 1 --2- 172.21.15.88:0/1558463968 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2184002f70 tx=0x7f21840099d0).ready entity=mon.1 client_cookie=a51a217118ad3435 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:06.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f2183fff700 1 -- 172.21.15.88:0/1558463968 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f219410c3e0 con 0x7f21940f6620 2023-10-18T19:35:06.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f2183fff700 1 -- 172.21.15.88:0/1558463968 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218400f510 con 0x7f21940f6620 2023-10-18T19:35:06.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f2183fff700 1 -- 172.21.15.88:0/1558463968 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f218400f6f0 con 0x7f21940f6620 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21991ff700 1 -- 172.21.15.88:0/1558463968 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 msgr2=0x7f21941031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.358 7f21991ff700 1 --2- 172.21.15.88:0/1558463968 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f2184002f70 tx=0x7f21840099d0).stop 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 -- 172.21.15.88:0/1558463968 shutdown_connections 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 --2- 172.21.15.88:0/1558463968 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940f6620 0x7f21941031b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 --2- 172.21.15.88:0/1558463968 >> v2:172.21.15.88:3300/0 conn(0x7f21941037e0 0x7f21941b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 -- 172.21.15.88:0/1558463968 >> 172.21.15.88:0/1558463968 conn(0x7f2194117390 msgr2=0x7f21940f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:06.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 -- 172.21.15.88:0/1558463968 shutdown_connections 2023-10-18T19:35:06.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.359 7f21991ff700 1 -- 172.21.15.88:0/1558463968 wait complete. 2023-10-18T19:35:06.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 Processor -- start 2023-10-18T19:35:06.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 -- start start 2023-10-18T19:35:06.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:06.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 0x7f21940e0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:06.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f21941c6120 0x7f21941c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:06.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940d7a30 con 0x7f21940b9570 2023-10-18T19:35:06.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940bbab0 con 0x7f21940e0320 2023-10-18T19:35:06.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.384 7f21991ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21941c3d40 con 0x7f21941c6120 2023-10-18T19:35:06.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f21915fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:06.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f21915fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60562/0 (socket says 172.21.15.88:60562) 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2191dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f21941c6120 0x7f21941c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f21915fe700 1 -- 172.21.15.88:0/3013293205 learned_addr learned my addr 172.21.15.88:0/3013293205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 0x7f21940e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 -- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f21941c6120 msgr2=0x7f21941c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f21941c6120 0x7f21941c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 -- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 msgr2=0x7f21940b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 -- 172.21.15.88:0/3013293205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21940ba0b0 con 0x7f21940e0320 2023-10-18T19:35:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f21915fe700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.385 7f2190dfd700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 0x7f21940e0770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f218800c000 tx=0x7f218800ec70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f21940ba0b0 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800c9a0 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21991ff700 1 -- 172.21.15.88:0/3013293205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940bb690 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f218800f040 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21991ff700 1 -- 172.21.15.88:0/3013293205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21941c6d80 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2188011070 con 0x7f21940e0320 2023-10-18T19:35:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.386 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2188010040 con 0x7f21940e0320 2023-10-18T19:35:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.387 7f21991ff700 1 -- 172.21.15.88:0/3013293205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21940f0530 con 0x7f21940e0320 2023-10-18T19:35:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.390 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f218800c5a0 con 0x7f21940e0320 2023-10-18T19:35:06.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.507 7f21991ff700 1 -- 172.21.15.88:0/3013293205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21940a8370 con 0x7f21940e0320 2023-10-18T19:35:06.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.508 7f21827fc700 1 -- 172.21.15.88:0/3013293205 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f2188000c30 con 0x7f21940e0320 2023-10-18T19:35:06.511 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:06.511 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 >> v1:172.21.15.88:6800/107321 conn(0x7f217801c1b0 legacy=0x7f217801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 msgr2=0x7f21940e0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 0x7f21940e0770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f218800c000 tx=0x7f218800ec70).stop 2023-10-18T19:35:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 shutdown_connections 2023-10-18T19:35:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f21941c6120 0x7f21941c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21940b9570 0x7f21940b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 --2- 172.21.15.88:0/3013293205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21940e0320 0x7f21940e0770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 >> 172.21.15.88:0/3013293205 conn(0x7f21940bd900 msgr2=0x7f21940d4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 shutdown_connections 2023-10-18T19:35:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:06.509 7f21991ff700 1 -- 172.21.15.88:0/3013293205 wait complete. 2023-10-18T19:35:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:06.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:06.832 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:07.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.042 7f6e7ef9d700 1 Processor -- start 2023-10-18T19:35:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.042 7f6e7ef9d700 1 -- start start 2023-10-18T19:35:08.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7ef9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 0x7f6e781b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:08.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7ef9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 0x7f6e781b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7ef9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e78111640 con 0x7f6e780f12d0 2023-10-18T19:35:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7ef9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7810d040 con 0x7f6e780f6230 2023-10-18T19:35:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7ef9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78111d30 con 0x7f6e780f6680 2023-10-18T19:35:08.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e777fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 0x7f6e781b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7cfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6e780f12d0 0x7f6e780f1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48234/0 (socket says 172.21.15.88:48234) 2023-10-18T19:35:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e7cfff700 1 -- 172.21.15.88:0/3659291590 learned_addr learned my addr 172.21.15.88:0/3659291590 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:35:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e77fff700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 0x7f6e781b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e777fe700 1 -- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 msgr2=0x7f6e781b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:08.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e777fe700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 0x7f6e781b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e76ffd700 1 -- 172.21.15.88:0/3659291590 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496719670 0 0) 0x7f6e70001490 con 0x7f6e780f12d0 2023-10-18T19:35:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e777fe700 1 -- 172.21.15.88:0/3659291590 >> v1:172.21.15.88:6789/0 conn(0x7f6e780f12d0 legacy=0x7f6e780f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e777fe700 1 -- 172.21.15.88:0/3659291590 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7810d560 con 0x7f6e780f6680 2023-10-18T19:35:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.043 7f6e77fff700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 0x7f6e781b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:08.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e777fe700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 0x7f6e781b2b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e6c002f70 tx=0x7f6e6c00b9a0).ready entity=mon.2 client_cookie=5a06c4987c904086 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:08.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e76ffd700 1 -- 172.21.15.88:0/3659291590 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e7810d560 con 0x7f6e780f6680 2023-10-18T19:35:08.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e76ffd700 1 -- 172.21.15.88:0/3659291590 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00d570 con 0x7f6e780f6680 2023-10-18T19:35:08.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e76ffd700 1 -- 172.21.15.88:0/3659291590 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e6c00d940 con 0x7f6e780f6680 2023-10-18T19:35:08.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e7ef9d700 1 -- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 msgr2=0x7f6e781b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.044 7f6e7ef9d700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 0x7f6e781b2b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e6c002f70 tx=0x7f6e6c00b9a0).stop 2023-10-18T19:35:08.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 -- 172.21.15.88:0/3659291590 shutdown_connections 2023-10-18T19:35:08.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780f6230 0x7f6e781b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 --2- 172.21.15.88:0/3659291590 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e780f6680 0x7f6e781b2b90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 -- 172.21.15.88:0/3659291590 >> 172.21.15.88:0/3659291590 conn(0x7f6e78117180 msgr2=0x7f6e780f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 -- 172.21.15.88:0/3659291590 shutdown_connections 2023-10-18T19:35:08.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.045 7f6e7ef9d700 1 -- 172.21.15.88:0/3659291590 wait complete. 2023-10-18T19:35:08.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.069 7f6e7ef9d700 1 Processor -- start 2023-10-18T19:35:08.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.069 7f6e7ef9d700 1 -- start start 2023-10-18T19:35:08.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:08.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 0x7f6e780bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:08.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 0x7f6e780bcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:08.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780d4d70 con 0x7f6e780b9400 2023-10-18T19:35:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780d2a70 con 0x7f6e781c66b0 2023-10-18T19:35:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7ef9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780ba050 con 0x7f6e781c6260 2023-10-18T19:35:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e77fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e777fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 0x7f6e780bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:08.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e77fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60566/0 (socket says 172.21.15.88:60566) 2023-10-18T19:35:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e77fff700 1 -- 172.21.15.88:0/765180181 learned_addr learned my addr 172.21.15.88:0/765180181 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.070 7f6e7cfff700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 0x7f6e780bcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 -- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 msgr2=0x7f6e780bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 0x7f6e780bc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 -- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 msgr2=0x7f6e780bcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 0x7f6e780bcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 -- 172.21.15.88:0/765180181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780ba9d0 con 0x7f6e780b9400 2023-10-18T19:35:08.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e777fe700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 0x7f6e780bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e7cfff700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 0x7f6e780bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e77fff700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6e780d5df0 tx=0x7f6e6800bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e780ba9d0 con 0x7f6e780b9400 2023-10-18T19:35:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800c9a0 con 0x7f6e780b9400 2023-10-18T19:35:08.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e780d26b0 con 0x7f6e780b9400 2023-10-18T19:35:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6e6800f040 con 0x7f6e780b9400 2023-10-18T19:35:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.071 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780b9850 con 0x7f6e780b9400 2023-10-18T19:35:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.072 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6e68011070 con 0x7f6e780b9400 2023-10-18T19:35:08.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.072 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6e68010040 con 0x7f6e780b9400 2023-10-18T19:35:08.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.073 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e780f0320 con 0x7f6e780b9400 2023-10-18T19:35:08.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.076 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6e6800c5a0 con 0x7f6e780b9400 2023-10-18T19:35:08.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.193 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e780d2d00 con 0x7f6e780b9400 2023-10-18T19:35:08.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.194 7f6e757fa700 1 -- 172.21.15.88:0/765180181 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f6e68000c30 con 0x7f6e780b9400 2023-10-18T19:35:08.196 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:08.197 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:08.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 >> v1:172.21.15.88:6800/107321 conn(0x7f6e5801c1b0 legacy=0x7f6e5801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 msgr2=0x7f6e781c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:08.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6e780d5df0 tx=0x7f6e6800bf70).stop 2023-10-18T19:35:08.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 shutdown_connections 2023-10-18T19:35:08.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e781c66b0 0x7f6e780bcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780b9400 0x7f6e781c5c30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 --2- 172.21.15.88:0/765180181 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e781c6260 0x7f6e780bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:08.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 >> 172.21.15.88:0/765180181 conn(0x7f6e780b01b0 msgr2=0x7f6e781209f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:08.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 shutdown_connections 2023-10-18T19:35:08.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:08.195 7f6e7ef9d700 1 -- 172.21.15.88:0/765180181 wait complete. 2023-10-18T19:35:08.201 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:08.516 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:08.517 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:09.518 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.726 7f71df5ff700 1 Processor -- start 2023-10-18T19:35:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.726 7f71df5ff700 1 -- start start 2023-10-18T19:35:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 0x7f71d80f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 0x7f71d80f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d8111f40 con 0x7f71d81b2770 2023-10-18T19:35:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80f6a30 con 0x7f71d810ccc0 2023-10-18T19:35:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71df5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8111850 con 0x7f71d81b31f0 2023-10-18T19:35:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 0x7f71d80f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 0x7f71d80f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 0x7f71d80f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:45552/0 (socket says 172.21.15.88:45552) 2023-10-18T19:35:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60568/0 (socket says 172.21.15.88:60568) 2023-10-18T19:35:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.727 7f71d77fe700 1 -- 172.21.15.88:0/2608451763 learned_addr learned my addr 172.21.15.88:0/2608451763 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 -- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 msgr2=0x7f71d80f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:09.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 --2- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 0x7f71d80f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 -- 172.21.15.88:0/2608451763 >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 msgr2=0x7f71d81b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 --2- 172.21.15.88:0/2608451763 >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 -- 172.21.15.88:0/2608451763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d810d6f0 con 0x7f71d81b31f0 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d6ffd700 1 --2- 172.21.15.88:0/2608451763 >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d7fff700 1 --2- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 0x7f71d80f14e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f71d81120f0 tx=0x7f71d0009cc0).ready entity=mon.2 client_cookie=784a5befd28c2702 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:09.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d67fc700 1 -- 172.21.15.88:0/2608451763 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71d810d6f0 con 0x7f71d81b31f0 2023-10-18T19:35:09.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d67fc700 1 -- 172.21.15.88:0/2608451763 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000b840 con 0x7f71d81b31f0 2023-10-18T19:35:09.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71d67fc700 1 -- 172.21.15.88:0/2608451763 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71d000ba20 con 0x7f71d81b31f0 2023-10-18T19:35:09.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71df5ff700 1 -- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 msgr2=0x7f71d80f14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:09.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.728 7f71df5ff700 1 --2- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 0x7f71d80f14e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f71d81120f0 tx=0x7f71d0009cc0).stop 2023-10-18T19:35:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 -- 172.21.15.88:0/2608451763 shutdown_connections 2023-10-18T19:35:09.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 --2- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81b31f0 0x7f71d80f14e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 --2- 172.21.15.88:0/2608451763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d810ccc0 0x7f71d80f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 --2- 172.21.15.88:0/2608451763 >> v2:172.21.15.88:3300/0 conn(0x7f71d81b2770 0x7f71d81b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 -- 172.21.15.88:0/2608451763 >> 172.21.15.88:0/2608451763 conn(0x7f71d8117390 msgr2=0x7f71d80f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 -- 172.21.15.88:0/2608451763 shutdown_connections 2023-10-18T19:35:09.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.729 7f71df5ff700 1 -- 172.21.15.88:0/2608451763 wait complete. 2023-10-18T19:35:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.753 7f71df5ff700 1 Processor -- start 2023-10-18T19:35:09.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.753 7f71df5ff700 1 -- start start 2023-10-18T19:35:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d80d3860 0x7f71d81be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81c1220 0x7f71d81c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80cc8b0 con 0x7f71d80d3410 2023-10-18T19:35:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d81b45a0 con 0x7f71d80d3860 2023-10-18T19:35:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71df5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80e0ea0 con 0x7f71d81c1220 2023-10-18T19:35:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60582/0 (socket says 172.21.15.88:60582) 2023-10-18T19:35:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71d77fe700 1 -- 172.21.15.88:0/2744882504 learned_addr learned my addr 172.21.15.88:0/2744882504 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71d6ffd700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d80d3860 0x7f71d81be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.754 7f71d7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81c1220 0x7f71d81c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 -- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81c1220 msgr2=0x7f71d81c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:09.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81c1220 0x7f71d81c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 -- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d80d3860 msgr2=0x7f71d81be6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d80d3860 0x7f71d81be6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 -- 172.21.15.88:0/2744882504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80d0e70 con 0x7f71d80d3410 2023-10-18T19:35:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d77fe700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f71c8006b50 tx=0x7f71c800eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:09.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71d80d0e70 con 0x7f71d80d3410 2023-10-18T19:35:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800c7b0 con 0x7f71d80d3410 2023-10-18T19:35:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f71c800f040 con 0x7f71d80d3410 2023-10-18T19:35:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d81b3780 con 0x7f71d80d3410 2023-10-18T19:35:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.755 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d81c1ca0 con 0x7f71d80d3410 2023-10-18T19:35:09.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.756 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f71c8022060 con 0x7f71d80d3410 2023-10-18T19:35:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.756 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f71c8010040 con 0x7f71d80d3410 2023-10-18T19:35:09.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.756 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80f0530 con 0x7f71d80d3410 2023-10-18T19:35:09.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.759 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f71c800c5a0 con 0x7f71d80d3410 2023-10-18T19:35:09.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.878 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d81b47a0 con 0x7f71d80d3410 2023-10-18T19:35:09.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.878 7f71d4ff9700 1 -- 172.21.15.88:0/2744882504 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f71c8000c30 con 0x7f71d80d3410 2023-10-18T19:35:09.882 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:09.883 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:09.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 >> v1:172.21.15.88:6800/107321 conn(0x7f71b801c1b0 legacy=0x7f71b801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:09.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 msgr2=0x7f71d81be0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:09.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f71c8006b50 tx=0x7f71c800eca0).stop 2023-10-18T19:35:09.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 shutdown_connections 2023-10-18T19:35:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71d81c1220 0x7f71d81c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71d80d3410 0x7f71d81be0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.879 7f71df5ff700 1 --2- 172.21.15.88:0/2744882504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71d80d3860 0x7f71d81be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.880 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 >> 172.21.15.88:0/2744882504 conn(0x7f71d80e0a50 msgr2=0x7f71d80df630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:09.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.880 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 shutdown_connections 2023-10-18T19:35:09.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:09.880 7f71df5ff700 1 -- 172.21.15.88:0/2744882504 wait complete. 2023-10-18T19:35:09.886 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:10.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:10.199 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:11.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:11.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.409 7f294d3ff700 1 Processor -- start 2023-10-18T19:35:11.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 -- start start 2023-10-18T19:35:11.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 0x7f29481b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2948111f40 con 0x7f29481b31f0 2023-10-18T19:35:11.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29480f6a30 con 0x7f29481b2770 2023-10-18T19:35:11.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.410 7f294d3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2948111850 con 0x7f294810ccc0 2023-10-18T19:35:11.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2945fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 0x7f29481b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f29457fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2945fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60584/0 (socket says 172.21.15.88:60584) 2023-10-18T19:35:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f29457fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45128/0 (socket says 172.21.15.88:45128) 2023-10-18T19:35:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2945fff700 1 -- 172.21.15.88:0/714739083 learned_addr learned my addr 172.21.15.88:0/714739083 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 -- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 msgr2=0x7f29480f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 -- 172.21.15.88:0/714739083 >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 msgr2=0x7f29480f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 --2- 172.21.15.88:0/714739083 >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 -- 172.21.15.88:0/714739083 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294810d6f0 con 0x7f29481b2770 2023-10-18T19:35:11.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2945fff700 1 --2- 172.21.15.88:0/714739083 >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:11.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f29457fe700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:11.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.411 7f2944ffd700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 0x7f29481b2bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c00b9f0).ready entity=mon.1 client_cookie=448ce0b0e7b4916e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:11.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f2937fff700 1 -- 172.21.15.88:0/714739083 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f294810d6f0 con 0x7f29481b2770 2023-10-18T19:35:11.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f2937fff700 1 -- 172.21.15.88:0/714739083 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00d570 con 0x7f29481b2770 2023-10-18T19:35:11.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f2937fff700 1 -- 172.21.15.88:0/714739083 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f293c00d940 con 0x7f29481b2770 2023-10-18T19:35:11.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 -- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 msgr2=0x7f29481b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:11.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 0x7f29481b2bc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c00b9f0).stop 2023-10-18T19:35:11.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 -- 172.21.15.88:0/714739083 shutdown_connections 2023-10-18T19:35:11.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f294810ccc0 0x7f29480f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 --2- 172.21.15.88:0/714739083 >> v2:172.21.15.88:3300/0 conn(0x7f29481b31f0 0x7f29480f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 --2- 172.21.15.88:0/714739083 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29481b2770 0x7f29481b2bc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 -- 172.21.15.88:0/714739083 >> 172.21.15.88:0/714739083 conn(0x7f2948117390 msgr2=0x7f29480f2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:11.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 -- 172.21.15.88:0/714739083 shutdown_connections 2023-10-18T19:35:11.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.412 7f294d3ff700 1 -- 172.21.15.88:0/714739083 wait complete. 2023-10-18T19:35:11.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 Processor -- start 2023-10-18T19:35:11.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 -- start start 2023-10-18T19:35:11.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 0x7f29480dfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29480e0050 0x7f29481c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:11.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29480e25e0 con 0x7f29480e0050 2023-10-18T19:35:11.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2948116600 con 0x7f29480df5d0 2023-10-18T19:35:11.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.437 7f294d3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29480d6040 con 0x7f2948116aa0 2023-10-18T19:35:11.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f29457fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 0x7f29480dfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f29457fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45134/0 (socket says 172.21.15.88:45134) 2023-10-18T19:35:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f29457fe700 1 -- 172.21.15.88:0/681978511 learned_addr learned my addr 172.21.15.88:0/681978511 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2945fff700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29480e0050 0x7f29481c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 -- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 msgr2=0x7f29480d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 -- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29480e0050 msgr2=0x7f29481c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:11.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29480e0050 0x7f29481c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 -- 172.21.15.88:0/681978511 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29481c3440 con 0x7f29480df5d0 2023-10-18T19:35:11.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f29457fe700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:11.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.438 7f2944ffd700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 0x7f29480dfa20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:11.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f29481c3440 con 0x7f29480df5d0 2023-10-18T19:35:11.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c006ab0 con 0x7f29480df5d0 2023-10-18T19:35:11.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f293c017040 con 0x7f29480df5d0 2023-10-18T19:35:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f294d3ff700 1 -- 172.21.15.88:0/681978511 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29480d17f0 con 0x7f29480df5d0 2023-10-18T19:35:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f294d3ff700 1 -- 172.21.15.88:0/681978511 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29480d1f70 con 0x7f29480df5d0 2023-10-18T19:35:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.439 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f293c0263f0 con 0x7f29480df5d0 2023-10-18T19:35:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.440 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f293c018070 con 0x7f29480df5d0 2023-10-18T19:35:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.440 7f294d3ff700 1 -- 172.21.15.88:0/681978511 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29480f0530 con 0x7f29480df5d0 2023-10-18T19:35:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.443 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f293c0117f0 con 0x7f29480df5d0 2023-10-18T19:35:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.561 7f294d3ff700 1 -- 172.21.15.88:0/681978511 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29480d43c0 con 0x7f29480df5d0 2023-10-18T19:35:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.562 7f29367fc700 1 -- 172.21.15.88:0/681978511 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f293c00d360 con 0x7f29480df5d0 2023-10-18T19:35:11.564 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:11.564 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:11.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 -- 172.21.15.88:0/681978511 >> v1:172.21.15.88:6800/107321 conn(0x7f292401c1b0 legacy=0x7f292401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:11.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 -- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 msgr2=0x7f29480dfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:11.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 0x7f29480dfa20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f293c002f70 tx=0x7f293c0068c0).stop 2023-10-18T19:35:11.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 -- 172.21.15.88:0/681978511 shutdown_connections 2023-10-18T19:35:11.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29480e0050 0x7f29481c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2948116aa0 0x7f29480d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 --2- 172.21.15.88:0/681978511 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29480df5d0 0x7f29480dfa20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:11.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 -- 172.21.15.88:0/681978511 >> 172.21.15.88:0/681978511 conn(0x7f29480e0d90 msgr2=0x7f29480d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:11.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.563 7f294d3ff700 1 -- 172.21.15.88:0/681978511 shutdown_connections 2023-10-18T19:35:11.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:11.564 7f294d3ff700 1 -- 172.21.15.88:0/681978511 wait complete. 2023-10-18T19:35:11.568 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:11.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:11.885 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:12.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.094 7f1f5b9ff700 1 Processor -- start 2023-10-18T19:35:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.094 7f1f5b9ff700 1 -- start start 2023-10-18T19:35:13.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.094 7f1f5b9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f540f67f0 0x7f1f540f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.094 7f1f5b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 0x7f1f540f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f5b9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540ab280 con 0x7f1f541b28f0 2023-10-18T19:35:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f5b9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f541120a0 con 0x7f1f540f67f0 2023-10-18T19:35:13.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f5b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5410cf80 con 0x7f1f540f6c40 2023-10-18T19:35:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f537fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f540f67f0 0x7f1f540f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f53fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1f541b28f0 0x7f1f541b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48238/0 (socket says 172.21.15.88:48238) 2023-10-18T19:35:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f53fff700 1 -- 172.21.15.88:0/244801222 learned_addr learned my addr 172.21.15.88:0/244801222 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:35:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f4bfff700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 0x7f1f540f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:13.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f52ffd700 1 -- 172.21.15.88:0/244801222 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310513926 0 0) 0x7f1f4c001490 con 0x7f1f541b28f0 2023-10-18T19:35:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f52ffd700 1 -- 172.21.15.88:0/244801222 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f34003270 con 0x7f1f541b28f0 2023-10-18T19:35:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f537fe700 1 -- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 msgr2=0x7f1f540f1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f537fe700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 0x7f1f540f1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f537fe700 1 -- 172.21.15.88:0/244801222 >> v1:172.21.15.88:6789/0 conn(0x7f1f541b28f0 legacy=0x7f1f541b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f537fe700 1 -- 172.21.15.88:0/244801222 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5410d860 con 0x7f1f540f67f0 2023-10-18T19:35:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.095 7f1f4bfff700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 0x7f1f540f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f537fe700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f540f67f0 0x7f1f540f16f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1f44002f70 tx=0x7f1f4400b9f0).ready entity=mon.0 client_cookie=b3f2cbde42848f97 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f52ffd700 1 -- 172.21.15.88:0/244801222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f5410d860 con 0x7f1f540f67f0 2023-10-18T19:35:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f52ffd700 1 -- 172.21.15.88:0/244801222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4400d5c0 con 0x7f1f540f67f0 2023-10-18T19:35:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f52ffd700 1 -- 172.21.15.88:0/244801222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f4400d9e0 con 0x7f1f540f67f0 2023-10-18T19:35:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f5b9ff700 1 -- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f540f67f0 msgr2=0x7f1f540f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f5b9ff700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f540f67f0 0x7f1f540f16f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f1f44002f70 tx=0x7f1f4400b9f0).stop 2023-10-18T19:35:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f5b9ff700 1 -- 172.21.15.88:0/244801222 shutdown_connections 2023-10-18T19:35:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.096 7f1f5b9ff700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f540f67f0 0x7f1f540f16f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.097 7f1f5b9ff700 1 --2- 172.21.15.88:0/244801222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540f6c40 0x7f1f540f1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.097 7f1f5b9ff700 1 -- 172.21.15.88:0/244801222 >> 172.21.15.88:0/244801222 conn(0x7f1f541175a0 msgr2=0x7f1f540f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.097 7f1f5b9ff700 1 -- 172.21.15.88:0/244801222 shutdown_connections 2023-10-18T19:35:13.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.097 7f1f5b9ff700 1 -- 172.21.15.88:0/244801222 wait complete. 2023-10-18T19:35:13.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.121 7f1f5b9ff700 1 Processor -- start 2023-10-18T19:35:13.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.121 7f1f5b9ff700 1 -- start start 2023-10-18T19:35:13.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 0x7f1f540b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:13.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:13.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1f541c6830 0x7f1f540b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:13.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540d4f50 con 0x7f1f541c5db0 2023-10-18T19:35:13.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540b0830 con 0x7f1f540d0c30 2023-10-18T19:35:13.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f5b9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540d5290 con 0x7f1f541c6830 2023-10-18T19:35:13.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f537fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 0x7f1f540b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60608/0 (socket says 172.21.15.88:60608) 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 -- 172.21.15.88:0/1909044295 learned_addr learned my addr 172.21.15.88:0/1909044295 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f53fff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1f541c6830 0x7f1f540b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 -- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1f541c6830 msgr2=0x7f1f540b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1f541c6830 0x7f1f540b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 -- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 msgr2=0x7f1f540b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 0x7f1f540b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f4bfff700 1 -- 172.21.15.88:0/1909044295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540d0870 con 0x7f1f541c5db0 2023-10-18T19:35:13.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.122 7f1f537fe700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 0x7f1f540b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:13.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f4bfff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f1f3c00c000 tx=0x7f1f3c00bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:13.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f540d0870 con 0x7f1f541c5db0 2023-10-18T19:35:13.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00c9a0 con 0x7f1f541c5db0 2023-10-18T19:35:13.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f540b7940 con 0x7f1f541c5db0 2023-10-18T19:35:13.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1f3c00f040 con 0x7f1f541c5db0 2023-10-18T19:35:13.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.123 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f540b7e90 con 0x7f1f541c5db0 2023-10-18T19:35:13.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.124 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f1f3c011070 con 0x7f1f541c5db0 2023-10-18T19:35:13.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.124 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1f3c010040 con 0x7f1f541c5db0 2023-10-18T19:35:13.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.124 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f540f0740 con 0x7f1f541c5db0 2023-10-18T19:35:13.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.127 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f1f3c00c5a0 con 0x7f1f541c5db0 2023-10-18T19:35:13.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.244 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f540e2250 con 0x7f1f541c5db0 2023-10-18T19:35:13.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.245 7f1f517fa700 1 -- 172.21.15.88:0/1909044295 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f1f3c000c30 con 0x7f1f541c5db0 2023-10-18T19:35:13.247 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:13.247 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:13.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 >> v1:172.21.15.88:6800/107321 conn(0x7f1f3801c1b0 legacy=0x7f1f3801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 msgr2=0x7f1f541c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:13.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f1f3c00c000 tx=0x7f1f3c00bf70).stop 2023-10-18T19:35:13.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 shutdown_connections 2023-10-18T19:35:13.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1f541c6830 0x7f1f540b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f540d0c30 0x7f1f540b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 --2- 172.21.15.88:0/1909044295 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f541c5db0 0x7f1f541c6200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:13.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 >> 172.21.15.88:0/1909044295 conn(0x7f1f541166e0 msgr2=0x7f1f540b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:13.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 shutdown_connections 2023-10-18T19:35:13.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:13.246 7f1f5b9ff700 1 -- 172.21.15.88:0/1909044295 wait complete. 2023-10-18T19:35:13.250 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:13.566 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:13.567 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:14.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:14.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 Processor -- start 2023-10-18T19:35:14.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 -- start start 2023-10-18T19:35:14.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 0x7f92201b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:14.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 0x7f92201b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:14.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9220111640 con 0x7f92200f6230 2023-10-18T19:35:14.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92201b3390 con 0x7f92201b78b0 2023-10-18T19:35:14.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.777 7f922739d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922010d040 con 0x7f92200f6680 2023-10-18T19:35:14.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f921ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 0x7f92201b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:14.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f9224bfe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92200f6230 0x7f92201b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48246/0 (socket says 172.21.15.88:48246) 2023-10-18T19:35:14.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f9224bfe700 1 -- 172.21.15.88:0/4048611694 learned_addr learned my addr 172.21.15.88:0/4048611694 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:35:14.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 0x7f92201b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 -- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 msgr2=0x7f92201b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 0x7f92201b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 -- 172.21.15.88:0/4048611694 >> v1:172.21.15.88:6789/0 conn(0x7f92200f6230 legacy=0x7f92201b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 -- 172.21.15.88:0/4048611694 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922010d560 con 0x7f92201b78b0 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f921ffff700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 0x7f92201b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:14.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.778 7f92253ff700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 0x7f92201b9d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218009d40).ready entity=mon.1 client_cookie=ff63abb6d3b22000 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:14.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f921f7fe700 1 -- 172.21.15.88:0/4048611694 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f922010d560 con 0x7f92201b78b0 2023-10-18T19:35:14.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f921f7fe700 1 -- 172.21.15.88:0/4048611694 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800b800 con 0x7f92201b78b0 2023-10-18T19:35:14.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f921f7fe700 1 -- 172.21.15.88:0/4048611694 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f921800b9e0 con 0x7f92201b78b0 2023-10-18T19:35:14.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 -- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 msgr2=0x7f92201b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 0x7f92201b9d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f92180032f0 tx=0x7f9218009d40).stop 2023-10-18T19:35:14.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 -- 172.21.15.88:0/4048611694 shutdown_connections 2023-10-18T19:35:14.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92201b78b0 0x7f92201b9d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 --2- 172.21.15.88:0/4048611694 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92200f6680 0x7f92201b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 -- 172.21.15.88:0/4048611694 >> 172.21.15.88:0/4048611694 conn(0x7f9220117180 msgr2=0x7f92200f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:14.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 -- 172.21.15.88:0/4048611694 shutdown_connections 2023-10-18T19:35:14.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.779 7f922739d700 1 -- 172.21.15.88:0/4048611694 wait complete. 2023-10-18T19:35:14.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 Processor -- start 2023-10-18T19:35:14.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 -- start start 2023-10-18T19:35:14.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92200bab10 0x7f92201c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200b9690 con 0x7f92201c64d0 2023-10-18T19:35:14.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200d2ce0 con 0x7f92200bab10 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.804 7f922739d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92200ba330 con 0x7f92201c6080 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f9224bfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92200bab10 0x7f92201c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f92253ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45164/0 (socket says 172.21.15.88:45164) 2023-10-18T19:35:14.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f92253ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60614/0 (socket says 172.21.15.88:60614) 2023-10-18T19:35:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 -- 172.21.15.88:0/1778588401 learned_addr learned my addr 172.21.15.88:0/1778588401 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 -- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92200bab10 msgr2=0x7f92201c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92200bab10 0x7f92201c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 -- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 msgr2=0x7f92200bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 -- 172.21.15.88:0/1778588401 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200d3590 con 0x7f92201c6080 2023-10-18T19:35:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f92253ff700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.805 7f921ffff700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f92200ba1e0 tx=0x7f920c00bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f920c00f040 con 0x7f92201c6080 2023-10-18T19:35:14.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c00ee60 con 0x7f92201c6080 2023-10-18T19:35:14.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f922739d700 1 -- 172.21.15.88:0/1778588401 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92200d4f30 con 0x7f92201c6080 2023-10-18T19:35:14.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f920c00cc10 con 0x7f92201c6080 2023-10-18T19:35:14.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f922739d700 1 -- 172.21.15.88:0/1778588401 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92200d2920 con 0x7f92201c6080 2023-10-18T19:35:14.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.806 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f920c011070 con 0x7f92201c6080 2023-10-18T19:35:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.807 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f920c010040 con 0x7f92201c6080 2023-10-18T19:35:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.807 7f922739d700 1 -- 172.21.15.88:0/1778588401 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92200f0320 con 0x7f92201c6080 2023-10-18T19:35:14.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.810 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f920c00c620 con 0x7f92201c6080 2023-10-18T19:35:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.926 7f922739d700 1 -- 172.21.15.88:0/1778588401 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92200f6a00 con 0x7f92201c6080 2023-10-18T19:35:14.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.927 7f921dffb700 1 -- 172.21.15.88:0/1778588401 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f920c02b8f0 con 0x7f92201c6080 2023-10-18T19:35:14.929 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:14.929 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:14.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 >> v1:172.21.15.88:6800/107321 conn(0x7f920801c1b0 legacy=0x7f920801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 msgr2=0x7f92200bb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:14.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f92200ba1e0 tx=0x7f920c00bf70).stop 2023-10-18T19:35:14.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 shutdown_connections 2023-10-18T19:35:14.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92201c64d0 0x7f92200bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92200bab10 0x7f92201c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 --2- 172.21.15.88:0/1778588401 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f92201c6080 0x7f92200bb9f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:14.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 >> 172.21.15.88:0/1778588401 conn(0x7f92200b02c0 msgr2=0x7f9220114c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:14.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 shutdown_connections 2023-10-18T19:35:14.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:14.928 7f922739d700 1 -- 172.21.15.88:0/1778588401 wait complete. 2023-10-18T19:35:14.933 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:15.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:15.249 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:16.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.458 7f6da999d700 1 Processor -- start 2023-10-18T19:35:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 -- start start 2023-10-18T19:35:16.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:16.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 0x7f6da41b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:16.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40ab160 con 0x7f6da41b3210 2023-10-18T19:35:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da4111f60 con 0x7f6da41b2790 2023-10-18T19:35:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.459 7f6da999d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40f6a50 con 0x7f6da410cce0 2023-10-18T19:35:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da27fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 0x7f6da41b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42458/0 (socket says 172.21.15.88:42458) 2023-10-18T19:35:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 -- 172.21.15.88:0/1516543354 learned_addr learned my addr 172.21.15.88:0/1516543354 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da1ffc700 1 -- 172.21.15.88:0/1516543354 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834710543 0 0) 0x7f6d9c001490 con 0x7f6da41b3210 2023-10-18T19:35:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 -- 172.21.15.88:0/1516543354 >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 msgr2=0x7f6da41b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 --2- 172.21.15.88:0/1516543354 >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 0x7f6da41b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 -- 172.21.15.88:0/1516543354 >> v1:172.21.15.88:6789/0 conn(0x7f6da41b3210 legacy=0x7f6da40f1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 -- 172.21.15.88:0/1516543354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4111870 con 0x7f6da410cce0 2023-10-18T19:35:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da27fd700 1 --2- 172.21.15.88:0/1516543354 >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 0x7f6da41b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.460 7f6da2ffe700 1 --2- 172.21.15.88:0/1516543354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d940099d0).ready entity=mon.1 client_cookie=bd7edd3631e1a4d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da1ffc700 1 -- 172.21.15.88:0/1516543354 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da4111870 con 0x7f6da410cce0 2023-10-18T19:35:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da1ffc700 1 -- 172.21.15.88:0/1516543354 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9400f510 con 0x7f6da410cce0 2023-10-18T19:35:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da1ffc700 1 -- 172.21.15.88:0/1516543354 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d9400f6f0 con 0x7f6da410cce0 2023-10-18T19:35:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 -- 172.21.15.88:0/1516543354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 msgr2=0x7f6da40f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 --2- 172.21.15.88:0/1516543354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6d94002f70 tx=0x7f6d940099d0).stop 2023-10-18T19:35:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 -- 172.21.15.88:0/1516543354 shutdown_connections 2023-10-18T19:35:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 --2- 172.21.15.88:0/1516543354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da410cce0 0x7f6da40f6420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 --2- 172.21.15.88:0/1516543354 >> v2:172.21.15.88:3300/0 conn(0x7f6da41b2790 0x7f6da41b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 -- 172.21.15.88:0/1516543354 >> 172.21.15.88:0/1516543354 conn(0x7f6da41173b0 msgr2=0x7f6da40f2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 -- 172.21.15.88:0/1516543354 shutdown_connections 2023-10-18T19:35:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.461 7f6da999d700 1 -- 172.21.15.88:0/1516543354 wait complete. 2023-10-18T19:35:16.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 Processor -- start 2023-10-18T19:35:16.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 -- start start 2023-10-18T19:35:16.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:16.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6da41c56d0 0x7f6da41c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:16.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 0x7f6da40b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:16.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b90b0 con 0x7f6da40cb780 2023-10-18T19:35:16.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b6a80 con 0x7f6da41c6150 2023-10-18T19:35:16.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.486 7f6da999d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b8430 con 0x7f6da41c56d0 2023-10-18T19:35:16.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:16.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34172/0 (socket says 172.21.15.88:34172) 2023-10-18T19:35:16.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da37ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 0x7f6da40b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:16.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 -- 172.21.15.88:0/3416890034 learned_addr learned my addr 172.21.15.88:0/3416890034 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:16.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da27fd700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6da41c56d0 0x7f6da41c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:16.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 -- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6da41c56d0 msgr2=0x7f6da41c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6da41c56d0 0x7f6da41c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 -- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 msgr2=0x7f6da40b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 0x7f6da40b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 -- 172.21.15.88:0/3416890034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da40b8660 con 0x7f6da40cb780 2023-10-18T19:35:16.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da37ff700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 0x7f6da40b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:16.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6da2ffe700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6da40b6f70 tx=0x7f6d940068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:16.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.487 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6da40b8660 con 0x7f6da40cb780 2023-10-18T19:35:16.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.488 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94011a50 con 0x7f6da40cb780 2023-10-18T19:35:16.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.488 7f6da999d700 1 -- 172.21.15.88:0/3416890034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40b8920 con 0x7f6da40cb780 2023-10-18T19:35:16.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.488 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6d9401d450 con 0x7f6da40cb780 2023-10-18T19:35:16.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.488 7f6da999d700 1 -- 172.21.15.88:0/3416890034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40b8e20 con 0x7f6da40cb780 2023-10-18T19:35:16.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.488 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6d94006a50 con 0x7f6da40cb780 2023-10-18T19:35:16.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.489 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6d94029d90 con 0x7f6da40cb780 2023-10-18T19:35:16.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.489 7f6da999d700 1 -- 172.21.15.88:0/3416890034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40f0550 con 0x7f6da40cb780 2023-10-18T19:35:16.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.492 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6d9400f300 con 0x7f6da40cb780 2023-10-18T19:35:16.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.611 7f6da999d700 1 -- 172.21.15.88:0/3416890034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6da40a5e40 con 0x7f6da40cb780 2023-10-18T19:35:16.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.612 7f6d93fff700 1 -- 172.21.15.88:0/3416890034 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2269 (secure 0 0 0) 0x7f6d94011840 con 0x7f6da40cb780 2023-10-18T19:35:16.614 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:16.615 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:34:56.029383","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4180,"mds_1":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4186":{"gid":4186,"name":"c","rank":1,"incarnation":9,"state":"up:stopping","state_seq":5,"addr":"172.21.15.88:6819/159784871","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":159784871}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:16.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 -- 172.21.15.88:0/3416890034 >> v1:172.21.15.88:6800/107321 conn(0x7f6d8001c1b0 legacy=0x7f6d8001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 -- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 msgr2=0x7f6da40bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:16.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6da40b6f70 tx=0x7f6d940068c0).stop 2023-10-18T19:35:16.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 -- 172.21.15.88:0/3416890034 shutdown_connections 2023-10-18T19:35:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6da41c6150 0x7f6da40b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6da40cb780 0x7f6da40bce30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 --2- 172.21.15.88:0/3416890034 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6da41c56d0 0x7f6da41c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 -- 172.21.15.88:0/3416890034 >> 172.21.15.88:0/3416890034 conn(0x7f6da40bda30 msgr2=0x7f6da411fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.613 7f6da999d700 1 -- 172.21.15.88:0/3416890034 shutdown_connections 2023-10-18T19:35:16.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:16.614 7f6da999d700 1 -- 172.21.15.88:0/3416890034 wait complete. 2023-10-18T19:35:16.618 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 13 2023-10-18T19:35:16.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:34:56.029383', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4180, 'mds_1': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4186': {'gid': 4186, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:stopping', 'state_seq': 5, 'addr': '172.21.15.88:6819/159784871', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6819', 'nonce': 159784871}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:16.934 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4186:up:stopping 2023-10-18T19:35:17.735 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-10-18T19:35:17.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.138 7fadeb59e700 1 Processor -- start 2023-10-18T19:35:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.138 7fadeb59e700 1 -- start start 2023-10-18T19:35:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fadeb59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fadec0f7eb0 0x7fadec0f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fadeb59e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fadeb59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0ab160 con 0x7fadec1b27b0 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fadeb59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0f8bb0 con 0x7fadec0f7eb0 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fadeb59e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadec118190 con 0x7fadec0f8300 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fade3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fade8dfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fadec0f7eb0 0x7fadec0f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fade3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48286/0 (socket says 172.21.15.88:48286) 2023-10-18T19:35:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.139 7fade3fff700 1 -- 172.21.15.88:0/2034735373 learned_addr learned my addr 172.21.15.88:0/2034735373 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade8dfe700 1 -- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 msgr2=0x7fadec0f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade8dfe700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade8dfe700 1 -- 172.21.15.88:0/2034735373 >> v1:172.21.15.88:6789/0 conn(0x7fadec1b27b0 legacy=0x7fadec1b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade8dfe700 1 -- 172.21.15.88:0/2034735373 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0f1ee0 con 0x7fadec0f7eb0 2023-10-18T19:35:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade3fff700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade8dfe700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec0f7eb0 0x7fadec0f0c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fadec116050 tx=0x7faddc00ba20).ready entity=mon.0 client_cookie=f21dde33c55aa185 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade37fe700 1 -- 172.21.15.88:0/2034735373 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadec0f1ee0 con 0x7fadec0f7eb0 2023-10-18T19:35:18.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade37fe700 1 -- 172.21.15.88:0/2034735373 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00d5c0 con 0x7fadec0f7eb0 2023-10-18T19:35:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fade37fe700 1 -- 172.21.15.88:0/2034735373 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7faddc00d9e0 con 0x7fadec0f7eb0 2023-10-18T19:35:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fadeb59e700 1 -- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec0f7eb0 msgr2=0x7fadec0f0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.140 7fadeb59e700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec0f7eb0 0x7fadec0f0c70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fadec116050 tx=0x7faddc00ba20).stop 2023-10-18T19:35:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 -- 172.21.15.88:0/2034735373 shutdown_connections 2023-10-18T19:35:18.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec0f7eb0 0x7fadec0f0c70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 --2- 172.21.15.88:0/2034735373 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec0f8300 0x7fadec0f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 -- 172.21.15.88:0/2034735373 >> 172.21.15.88:0/2034735373 conn(0x7fadec125b00 msgr2=0x7fadec125f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:18.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 -- 172.21.15.88:0/2034735373 shutdown_connections 2023-10-18T19:35:18.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.141 7fadeb59e700 1 -- 172.21.15.88:0/2034735373 wait complete. 2023-10-18T19:35:18.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.165 7fadeb59e700 1 Processor -- start 2023-10-18T19:35:18.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.165 7fadeb59e700 1 -- start start 2023-10-18T19:35:18.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 0x7fadec1c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0e2620 con 0x7fadec1c6420 2023-10-18T19:35:18.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0d30b0 con 0x7fadec0d6f60 2023-10-18T19:35:18.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fadeb59e700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0d33b0 con 0x7fadec1c6870 2023-10-18T19:35:18.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade95ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade8dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 0x7fadec1c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34204/0 (socket says 172.21.15.88:34204) 2023-10-18T19:35:18.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 -- 172.21.15.88:0/1783442534 learned_addr learned my addr 172.21.15.88:0/1783442534 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade95ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48300/0 (socket says 172.21.15.88:48300) 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade8dfe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 0x7fadec1c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42468/0 (socket says 172.21.15.88:42468) 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 -- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 msgr2=0x7fadec0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 -- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 msgr2=0x7fadec1c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 0x7fadec1c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade3fff700 1 -- 172.21.15.88:0/1783442534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0d73b0 con 0x7fadec1c6420 2023-10-18T19:35:18.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.166 7fade95ff700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:18.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fade3fff700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fadec0d8590 tx=0x7fadd400ed30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:18.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadec0d73b0 con 0x7fadec1c6420 2023-10-18T19:35:18.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400c7b0 con 0x7fadec1c6420 2023-10-18T19:35:18.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec0b75d0 con 0x7fadec1c6420 2023-10-18T19:35:18.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fadd400f040 con 0x7fadec1c6420 2023-10-18T19:35:18.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.167 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec0b5f50 con 0x7fadec1c6420 2023-10-18T19:35:18.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.168 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fadd4022060 con 0x7fadec1c6420 2023-10-18T19:35:18.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.168 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fadd4010040 con 0x7fadec1c6420 2023-10-18T19:35:18.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.168 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec0f0550 con 0x7fadec1c6420 2023-10-18T19:35:18.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.171 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fadd400c5a0 con 0x7fadec1c6420 2023-10-18T19:35:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.290 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadec116920 con 0x7fadec1c6420 2023-10-18T19:35:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.291 7fade1ffb700 1 -- 172.21.15.88:0/1783442534 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1980 (secure 0 0 0) 0x7fadd4000c30 con 0x7fadec1c6420 2023-10-18T19:35:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:18.293 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:35:17.635104","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 >> v1:172.21.15.88:6800/107321 conn(0x7fadd001c1b0 legacy=0x7fadd001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 msgr2=0x7fadec0b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fadec0d8590 tx=0x7fadd400ed30).stop 2023-10-18T19:35:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 shutdown_connections 2023-10-18T19:35:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fadec1c6870 0x7fadec0b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadec0d6f60 0x7fadec1c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 --2- 172.21.15.88:0/1783442534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadec1c6420 0x7fadec0b52f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 >> 172.21.15.88:0/1783442534 conn(0x7fadec0f4100 msgr2=0x7fadec121c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 shutdown_connections 2023-10-18T19:35:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.292 7fadeb59e700 1 -- 172.21.15.88:0/1783442534 wait complete. 2023-10-18T19:35:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-10-18T19:35:18.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:35:17.635104', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:18.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T19:35:18.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: skipping max_mds check 2023-10-18T19:35:18.614 DEBUG:tasks.cephfs.filesystem:deactivating rank 0 2023-10-18T19:35:18.614 INFO:tasks.cephfs.filesystem:Error: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/cephfs/filesystem.py", line 588, in reach_max_mds self.deactivate(target['rank']) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/cephfs/filesystem.py", line 570, in deactivate raise RuntimeError("cannot deactivate rank 0") RuntimeError: cannot deactivate rank 0 2023-10-18T19:35:18.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:35:18.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.815 7fa383fff700 1 Processor -- start 2023-10-18T19:35:18.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 -- start start 2023-10-18T19:35:18.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 0x7fa37c1ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37c0ab280 con 0x7fa37c0f67f0 2023-10-18T19:35:18.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37c0f2520 con 0x7fa37c1b7c40 2023-10-18T19:35:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa383fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1120a0 con 0x7fa37c0f6c40 2023-10-18T19:35:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa373fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.816 7fa380dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 0x7fa37c1ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48314/0 (socket says 172.21.15.88:48314) 2023-10-18T19:35:18.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 -- 172.21.15.88:0/35123527 learned_addr learned my addr 172.21.15.88:0/35123527 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 -- 172.21.15.88:0/35123527 >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 msgr2=0x7fa37c1ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 --2- 172.21.15.88:0/35123527 >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 0x7fa37c1ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 -- 172.21.15.88:0/35123527 >> v1:172.21.15.88:6789/0 conn(0x7fa37c0f67f0 legacy=0x7fa37c0f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 -- 172.21.15.88:0/35123527 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c10cf80 con 0x7fa37c0f6c40 2023-10-18T19:35:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa380dff700 1 --2- 172.21.15.88:0/35123527 >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 0x7fa37c1ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa373fff700 1 --2- 172.21.15.88:0/35123527 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa364002f70 tx=0x7fa3640099d0).ready entity=mon.2 client_cookie=778872545ff40cc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa37b7fe700 1 -- 172.21.15.88:0/35123527 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa37c10cf80 con 0x7fa37c0f6c40 2023-10-18T19:35:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa37b7fe700 1 -- 172.21.15.88:0/35123527 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36400f510 con 0x7fa37c0f6c40 2023-10-18T19:35:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa37b7fe700 1 -- 172.21.15.88:0/35123527 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa36400f6f0 con 0x7fa37c0f6c40 2023-10-18T19:35:18.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa383fff700 1 -- 172.21.15.88:0/35123527 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 msgr2=0x7fa37c0f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.817 7fa383fff700 1 --2- 172.21.15.88:0/35123527 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa364002f70 tx=0x7fa3640099d0).stop 2023-10-18T19:35:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 -- 172.21.15.88:0/35123527 shutdown_connections 2023-10-18T19:35:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 --2- 172.21.15.88:0/35123527 >> v2:172.21.15.88:3300/0 conn(0x7fa37c1b7c40 0x7fa37c1ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 --2- 172.21.15.88:0/35123527 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0f6c40 0x7fa37c0f1ef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 -- 172.21.15.88:0/35123527 >> 172.21.15.88:0/35123527 conn(0x7fa37c1175a0 msgr2=0x7fa37c0f2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 -- 172.21.15.88:0/35123527 shutdown_connections 2023-10-18T19:35:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.818 7fa383fff700 1 -- 172.21.15.88:0/35123527 wait complete. 2023-10-18T19:35:18.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.843 7fa383fff700 1 Processor -- start 2023-10-18T19:35:18.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.843 7fa383fff700 1 -- start start 2023-10-18T19:35:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa37c0b1e40 0x7fa37c0bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa37c1c6260 0x7fa37c1c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:18.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1c0340 con 0x7fa37c1c6260 2023-10-18T19:35:18.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0b26a0 con 0x7fa37c0b1e40 2023-10-18T19:35:18.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa383fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c0cea50 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa373fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa373fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48318/0 (socket says 172.21.15.88:48318) 2023-10-18T19:35:18.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa373fff700 1 -- 172.21.15.88:0/2962255540 learned_addr learned my addr 172.21.15.88:0/2962255540 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:18.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa37bfff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa37c0b1e40 0x7fa37c0bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.844 7fa380dff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa37c1c6260 0x7fa37c1c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:18.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 -- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa37c0b1e40 msgr2=0x7fa37c0bb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa37c0b1e40 0x7fa37c0bb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 -- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa37c1c6260 msgr2=0x7fa37c1c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa37c1c6260 0x7fa37c1c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 -- 172.21.15.88:0/2962255540 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0ced10 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa373fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa36400ffc0 tx=0x7fa3640068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:18.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa37c0ced10 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36401c720 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa36401caf0 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa383fff700 1 -- 172.21.15.88:0/2962255540 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c1c3850 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.845 7fa383fff700 1 -- 172.21.15.88:0/2962255540 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c0cf010 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.846 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fa364019030 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.846 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fa364018040 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.846 7fa383fff700 1 -- 172.21.15.88:0/2962255540 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c0f0740 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.849 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fa36400f300 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.968 7fa383fff700 1 -- 172.21.15.88:0/2962255540 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa37c0efe10 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.969 7fa379ffb700 1 -- 172.21.15.88:0/2962255540 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1980 (secure 0 0 0) 0x7fa3640357d0 con 0x7fa37c0bb7d0 2023-10-18T19:35:18.971 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:35:18.971 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18 19:34:21.213099","modified":"2023-10-18 19:35:17.635104","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:35:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 >> v1:172.21.15.88:6800/107321 conn(0x7fa36001c1b0 legacy=0x7fa36001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 msgr2=0x7fa37c1c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa36400ffc0 tx=0x7fa3640068c0).stop 2023-10-18T19:35:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 shutdown_connections 2023-10-18T19:35:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa37c1c6260 0x7fa37c1c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa37c0b1e40 0x7fa37c0bb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 --2- 172.21.15.88:0/2962255540 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa37c0bb7d0 0x7fa37c1c5c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:18.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 >> 172.21.15.88:0/2962255540 conn(0x7fa37c0e09a0 msgr2=0x7fa37c0d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:18.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 shutdown_connections 2023-10-18T19:35:18.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:18.970 7fa383fff700 1 -- 172.21.15.88:0/2962255540 wait complete. 2023-10-18T19:35:18.975 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2023-10-18T19:35:19.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18 19:34:21.213099', 'modified': '2023-10-18 19:35:17.635104', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:35:19.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T19:35:19.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T19:35:19.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.492 7ff75ffff700 1 Processor -- start 2023-10-18T19:35:19.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.492 7ff75ffff700 1 -- start start 2023-10-18T19:35:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 0x7ff7600f1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 0x7ff7601b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600f2300 con 0x7ff76010cc10 2023-10-18T19:35:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff760111e90 con 0x7ff7600f1eb0 2023-10-18T19:35:19.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601117a0 con 0x7ff7600f1430 2023-10-18T19:35:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75d7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff76010cc10 0x7ff7600f6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35288/0 (socket says 172.21.15.88:35288) 2023-10-18T19:35:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75d7fe700 1 -- 172.21.15.88:0/2030708577 learned_addr learned my addr 172.21.15.88:0/2030708577 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:35:19.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75cffd700 1 --2- 172.21.15.88:0/2030708577 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 0x7ff7600f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.493 7ff75dfff700 1 --2- 172.21.15.88:0/2030708577 >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 0x7ff7601b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75cffd700 1 -- 172.21.15.88:0/2030708577 >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 msgr2=0x7ff7601b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff74ffff700 1 -- 172.21.15.88:0/2030708577 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262424335 0 0) 0x7ff750001110 con 0x7ff76010cc10 2023-10-18T19:35:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75cffd700 1 --2- 172.21.15.88:0/2030708577 >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 0x7ff7601b9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75cffd700 1 -- 172.21.15.88:0/2030708577 >> v1:172.21.15.88:6789/0 conn(0x7ff76010cc10 legacy=0x7ff7600f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75cffd700 1 -- 172.21.15.88:0/2030708577 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76010d640 con 0x7ff7600f1430 2023-10-18T19:35:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75dfff700 1 --2- 172.21.15.88:0/2030708577 >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 0x7ff7601b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75cffd700 1 --2- 172.21.15.88:0/2030708577 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 0x7ff7600f1880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff754002f70 tx=0x7ff75400b970).ready entity=mon.2 client_cookie=884ac5eca8e79335 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:19.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff74ffff700 1 -- 172.21.15.88:0/2030708577 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff76010d640 con 0x7ff7600f1430 2023-10-18T19:35:19.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff74ffff700 1 -- 172.21.15.88:0/2030708577 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75400d5c0 con 0x7ff7600f1430 2023-10-18T19:35:19.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff74ffff700 1 -- 172.21.15.88:0/2030708577 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff75400d990 con 0x7ff7600f1430 2023-10-18T19:35:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75ffff700 1 -- 172.21.15.88:0/2030708577 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 msgr2=0x7ff7600f1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.494 7ff75ffff700 1 --2- 172.21.15.88:0/2030708577 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 0x7ff7600f1880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ff754002f70 tx=0x7ff75400b970).stop 2023-10-18T19:35:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 -- 172.21.15.88:0/2030708577 shutdown_connections 2023-10-18T19:35:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 --2- 172.21.15.88:0/2030708577 >> v2:172.21.15.88:3300/0 conn(0x7ff7600f1eb0 0x7ff7601b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 --2- 172.21.15.88:0/2030708577 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7600f1430 0x7ff7600f1880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 -- 172.21.15.88:0/2030708577 >> 172.21.15.88:0/2030708577 conn(0x7ff7601172e0 msgr2=0x7ff7600f2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 -- 172.21.15.88:0/2030708577 shutdown_connections 2023-10-18T19:35:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.495 7ff75ffff700 1 -- 172.21.15.88:0/2030708577 wait complete. 2023-10-18T19:35:19.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.519 7ff75ffff700 1 Processor -- start 2023-10-18T19:35:19.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.520 7ff75ffff700 1 -- start start 2023-10-18T19:35:19.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.520 7ff75ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 0x7ff7600d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 0x7ff7600d4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600f3210 con 0x7ff7601c5e80 2023-10-18T19:35:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75ffff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600d7a90 con 0x7ff7600d3ff0 2023-10-18T19:35:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600cd780 con 0x7ff7601c6900 2023-10-18T19:35:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34234/0 (socket says 172.21.15.88:34234) 2023-10-18T19:35:19.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75cffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 0x7ff7600d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 -- 172.21.15.88:0/160353706 learned_addr learned my addr 172.21.15.88:0/160353706 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:19.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75dfff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 0x7ff7600d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 -- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 msgr2=0x7ff7600d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 0x7ff7600d39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 -- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 msgr2=0x7ff7600d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 0x7ff7600d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75d7fe700 1 -- 172.21.15.88:0/160353706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600d2ca0 con 0x7ff7601c5e80 2023-10-18T19:35:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75cffd700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 0x7ff7600d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.521 7ff75dfff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 0x7ff7600d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:35:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff75d7fe700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff7600b4f10 tx=0x7ff75000c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff74e7fc700 1 -- 172.21.15.88:0/160353706 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7600d2ca0 con 0x7ff7601c5e80 2023-10-18T19:35:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff74e7fc700 1 -- 172.21.15.88:0/160353706 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7500072e0 con 0x7ff7601c5e80 2023-10-18T19:35:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff74e7fc700 1 -- 172.21.15.88:0/160353706 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff750005810 con 0x7ff7601c5e80 2023-10-18T19:35:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff75ffff700 1 -- 172.21.15.88:0/160353706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7600d77f0 con 0x7ff7601c5e80 2023-10-18T19:35:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.522 7ff75ffff700 1 -- 172.21.15.88:0/160353706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600b06b0 con 0x7ff7601c5e80 2023-10-18T19:35:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.523 7ff74e7fc700 1 -- 172.21.15.88:0/160353706 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7ff750005a10 con 0x7ff7601c5e80 2023-10-18T19:35:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.523 7ff74e7fc700 1 -- 172.21.15.88:0/160353706 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ff750028b10 con 0x7ff7601c5e80 2023-10-18T19:35:19.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.526 7ff77e4e7b80 1 Processor -- start 2023-10-18T19:35:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.526 7ff77e4e7b80 1 -- start start 2023-10-18T19:35:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3cebb0 0x55b66d3da960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3daf90 0x55b66d3ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66d2ea440 con 0x55b66d3ce130 2023-10-18T19:35:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b66d119fb0 con 0x55b66d3daf90 2023-10-18T19:35:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b66d2d51b0 con 0x55b66d3cebb0 2023-10-18T19:35:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75cffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3cebb0 0x55b66d3da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34250/0 (socket says 172.21.15.88:34250) 2023-10-18T19:35:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 -- 172.21.15.88:0/294861914 learned_addr learned my addr 172.21.15.88:0/294861914 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75dfff700 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3daf90 0x55b66d3ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 -- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3cebb0 msgr2=0x55b66d3da960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3cebb0 0x55b66d3da960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 -- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3daf90 msgr2=0x55b66d3ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3daf90 0x55b66d3ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 -- 172.21.15.88:0/294861914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b66d387820 con 0x55b66d3ce130 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.527 7ff75d7fe700 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x55b66d3ad420 tx=0x7ff7500141a0).ready entity=mon.0 client_cookie=6d14252456d6222f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff75ffff700 1 -- 172.21.15.88:0/294861914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b66d387820 con 0x55b66d3ce130 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff75ffff700 1 -- 172.21.15.88:0/294861914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750005cf0 con 0x55b66d3ce130 2023-10-18T19:35:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff75ffff700 1 -- 172.21.15.88:0/294861914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff7600b06b0 con 0x55b66d3ce130 2023-10-18T19:35:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 -- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 msgr2=0x55b66d3ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x55b66d3ad420 tx=0x7ff7500141a0).stop 2023-10-18T19:35:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 -- 172.21.15.88:0/294861914 shutdown_connections 2023-10-18T19:35:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3daf90 0x55b66d3ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3ce130 0x55b66d3ce580 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 --2- 172.21.15.88:0/294861914 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3cebb0 0x55b66d3da960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.528 7ff77e4e7b80 1 -- 172.21.15.88:0/294861914 >> 172.21.15.88:0/294861914 conn(0x55b66d3ae570 msgr2=0x55b66d3abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.529 7ff77e4e7b80 1 -- 172.21.15.88:0/294861914 shutdown_connections 2023-10-18T19:35:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.529 7ff77e4e7b80 1 -- 172.21.15.88:0/294861914 wait complete. 2023-10-18T19:35:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.529 7ff77e4e7b80 1 -- start start 2023-10-18T19:35:19.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.529 7ff77e4e7b80 1 Processor -- start 2023-10-18T19:35:19.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3df150 0x55b66d3b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3df8d0 0x55b66d3b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:35:19.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b66d2d1e70 con 0x55b66d3df150 2023-10-18T19:35:19.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b66d3b3c00 con 0x55b66d3df8d0 2023-10-18T19:35:19.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b66d3b3e50 con 0x55b66d3bbe50 2023-10-18T19:35:19.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.530 7ff77e4e7b80 10 client.0 ll_register_callbacks cb 0x55b66d309ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T19:35:19.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:48356/0 (socket says 172.21.15.88:48356) 2023-10-18T19:35:19.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 -- 172.21.15.88:0/1568879143 learned_addr learned my addr 172.21.15.88:0/1568879143 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:35:19.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75dfff700 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3df8d0 0x55b66d3b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75cffd700 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3df150 0x55b66d3b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:35:19.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 -- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3df8d0 msgr2=0x55b66d3b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:19.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3df8d0 0x55b66d3b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 -- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3df150 msgr2=0x55b66d3b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:35:19.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3df150 0x55b66d3b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 -- 172.21.15.88:0/1568879143 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b66d1e2f00 con 0x55b66d3bbe50 2023-10-18T19:35:19.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff75d7fe700 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x55b66d3b43e0 tx=0x7ff75000b040).ready entity=mon.2 client_cookie=8f3af332917f828f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:35:19.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.531 7ff733fff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3302/0 2023-10-18T19:35:19.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55b66d1e2f00 con 0x55b66d3bbe50 2023-10-18T19:35:19.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mon.2 v2:172.21.15.88:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ff7500144b0 con 0x55b66d3bbe50 2023-10-18T19:35:19.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b66d37e500 con 0x55b66d3bbe50 2023-10-18T19:35:19.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff750013aa0 con 0x55b66d3bbe50 2023-10-18T19:35:19.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 10 client.4622 fetch_fsmap learned FSMap version 14 2023-10-18T19:35:19.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b66d3b31d0 con 0x55b66d3bbe50 2023-10-18T19:35:19.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mon.2 v2:172.21.15.88:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b66d37e500 con 0x55b66d3bbe50 2023-10-18T19:35:19.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mon.2 v2:172.21.15.88:3302/0 5 ==== fsmap(e 14) v1 ==== 1181+0+0 (secure 0 0 0) 0x7ff750008040 con 0x55b66d3bbe50 2023-10-18T19:35:19.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 10 client.4622 fetch_fsmap finished waiting for FSMap version 14 2023-10-18T19:35:19.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 10 client.4622 resolve_mds: resolved ID 'b' to GID 4180 2023-10-18T19:35:19.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 20 client.4622 populate_metadata read hostname 'smithi088' 2023-10-18T19:35:19.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 4 client.4622 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T19:35:19.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.532 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 --> v1:172.21.15.88:6817/2557744719 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b66d2f3490 con 0x55b66d3f2830 2023-10-18T19:35:19.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff733fff700 10 client.4622 ms_handle_connect on v1:172.21.15.88:6817/2557744719 2023-10-18T19:35:19.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff733fff700 1 -- 172.21.15.88:0/1568879143 <== mds.0 v1:172.21.15.88:6817/2557744719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55b66d2f3490 con 0x55b66d3f2830 2023-10-18T19:35:19.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff733fff700 10 client.4622 handle_command_reply: tid=0 2023-10-18T19:35:19.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 client.4622 shutdown 2023-10-18T19:35:19.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 msgr2=0x55b66d3cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x55b66d3b43e0 tx=0x7ff75000b040).stop 2023-10-18T19:35:19.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 shutdown_connections 2023-10-18T19:35:19.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x55b66d3df8d0 0x55b66d3b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x55b66d3bbe50 0x55b66d3cc690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 --2- 172.21.15.88:0/1568879143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b66d3df150 0x55b66d3b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 >> 172.21.15.88:0/1568879143 conn(0x55b66d3cd560 msgr2=0x55b66d3c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:19.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff733fff700 0 client.4622 ms_handle_reset on v1:172.21.15.88:6817/2557744719 2023-10-18T19:35:19.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 shutdown_connections 2023-10-18T19:35:19.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 1 -- 172.21.15.88:0/1568879143 wait complete. 2023-10-18T19:35:19.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.533 7ff77e4e7b80 20 client.4622 trim_cache size 0 max 16384 2023-10-18T19:35:19.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 >> v1:172.21.15.88:6800/107321 conn(0x7ff73c01c150 legacy=0x7ff73c01e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 msgr2=0x7ff7601c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:35:19.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ff7600b4f10 tx=0x7ff75000c890).stop 2023-10-18T19:35:19.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 shutdown_connections 2023-10-18T19:35:19.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7600d3ff0 0x7ff7600d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7601c5e80 0x7ff7601c62d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 --2- 172.21.15.88:0/160353706 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff7601c6900 0x7ff7600d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:35:19.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.543 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 >> 172.21.15.88:0/160353706 conn(0x7ff7600b2830 msgr2=0x7ff7600b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:35:19.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.544 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 shutdown_connections 2023-10-18T19:35:19.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18 19:35:19.544 7ff73a3ff700 1 -- 172.21.15.88:0/160353706 wait complete. 2023-10-18T19:35:19.554 INFO:teuthology.orchestra.run.smithi088.stderr:no valid command found; 10 closest matches: 2023-10-18T19:35:19.554 INFO:teuthology.orchestra.run.smithi088.stderr:injectargs [...] 2023-10-18T19:35:19.554 INFO:teuthology.orchestra.run.smithi088.stderr:config set 2023-10-18T19:35:19.554 INFO:teuthology.orchestra.run.smithi088.stderr:config unset 2023-10-18T19:35:19.554 INFO:teuthology.orchestra.run.smithi088.stderr:exit 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:respawn 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:session kill 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:cpu_profiler status|flush 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:session ls { [...]} 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:client ls { [...]} 2023-10-18T19:35:19.555 INFO:teuthology.orchestra.run.smithi088.stderr:session evict { [...]} 2023-10-18T19:35:19.556 INFO:teuthology.orchestra.run.smithi088.stderr:Error EINVAL: invalid command 2023-10-18T19:35:19.560 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-18T19:35:19.561 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:35:19.571 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-18T19:35:19.571 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-18T19:35:19.615 INFO:teuthology.task.install:project ceph config {'mon.a': None, 'mon.b': None} overrides {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T19:35:19.616 WARNING:teuthology.task.install:remote ubuntu@smithi088.front.sepia.ceph.com came up twice (role mon.b) 2023-10-18T19:35:19.616 INFO:teuthology.task.install:remote ubuntu@smithi088.front.sepia.ceph.com config {'flavor': 'default', 'sha1': 'b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5'} 2023-10-18T19:35:19.616 INFO:teuthology.task.install:extra packages: [] 2023-10-18T19:35:19.622 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T19:35:19.622 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-18T19:35:19.623 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-18T19:35:19.678 INFO:teuthology.orchestra.run.smithi088.stdout:14.2.22-0.el8 2023-10-18T19:35:19.679 INFO:teuthology.packaging:The installed version of ceph-common is 14.2.22-0.el8 2023-10-18T19:35:19.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:35:19.902 INFO:teuthology.task.install:Ceph rpm upgrade from 14.2.22-0.el8 to 16.2.14-100.gb4ddd52c 2023-10-18T19:35:19.903 INFO:teuthology.task.install.rpm:Host smithi088 is: centos 8 x86_64 2023-10-18T19:35:19.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:35:20.135 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/centos/8/flavors/default/ 2023-10-18T19:35:20.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-18T19:35:20.580 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-pacific-20231016.091648/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-18T19:35:20.580 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-18T19:35:20.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-18T19:35:20.651 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-18T19:35:20.763 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-18T19:35:20.834 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-18T19:35:20.880 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-10-18T19:35:20.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-10-18T19:35:21.284 INFO:teuthology.orchestra.run.smithi088.stdout:71 files removed 2023-10-18T19:35:21.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-18T19:35:22.508 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 120 kB/s | 76 kB 00:00 2023-10-18T19:35:23.250 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 22 kB/s | 15 kB 00:00 2023-10-18T19:35:23.943 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 2.2 kB/s | 1.4 kB 00:00 2023-10-18T19:35:27.808 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 8.7 MB/s | 33 MB 00:03 2023-10-18T19:35:38.033 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 50 MB 00:03 2023-10-18T19:35:46.216 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-10-18T19:35:46.642 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2023-10-18T19:35:47.201 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - PowerTools 16 MB/s | 6.5 MB 00:00 2023-10-18T19:35:48.953 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-10-18T19:35:50.654 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-18T19:35:55.629 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 78 kB/s | 24 kB 00:00 2023-10-18T19:35:59.992 INFO:teuthology.orchestra.run.smithi088.stderr:Package cephadm available, but not installed. 2023-10-18T19:35:59.993 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: cephadm 2023-10-18T19:35:59.993 INFO:teuthology.orchestra.run.smithi088.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-18T19:35:59.994 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: ceph-immutable-object-cache 2023-10-18T19:35:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:Package ceph-mgr-dashboard available, but not installed. 2023-10-18T19:35:59.997 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: ceph-mgr-dashboard 2023-10-18T19:35:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2023-10-18T19:35:59.998 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: ceph-mgr-diskprediction-local 2023-10-18T19:35:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:Package ceph-mgr-rook available, but not installed. 2023-10-18T19:35:59.999 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: ceph-mgr-rook 2023-10-18T19:35:59.999 INFO:teuthology.orchestra.run.smithi088.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-18T19:35:59.999 INFO:teuthology.orchestra.run.smithi088.stdout:No match for argument: ceph-mgr-cephadm 2023-10-18T19:36:00.295 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-18T19:36:00.300 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:36:00.300 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-18T19:36:00.300 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:36:00.300 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-10-18T19:36:00.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 6.4 k 2023-10-18T19:36:00.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 6.1 M 2023-10-18T19:36:00.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 24 M 2023-10-18T19:36:00.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 912 k 2023-10-18T19:36:00.301 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 2.4 M 2023-10-18T19:36:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 1.6 M 2023-10-18T19:36:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 5.0 M 2023-10-18T19:36:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 18 M 2023-10-18T19:36:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 12 M 2023-10-18T19:36:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 26 k 2023-10-18T19:36:00.303 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 52 M 2023-10-18T19:36:00.303 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 25 k 2023-10-18T19:36:00.303 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 825 k 2023-10-18T19:36:00.303 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 131 k 2023-10-18T19:36:00.303 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 3.7 M 2023-10-18T19:36:00.304 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 494 k 2023-10-18T19:36:00.304 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 4.2 M 2023-10-18T19:36:00.304 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 3.8 M 2023-10-18T19:36:00.304 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 45 k 2023-10-18T19:36:00.304 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 215 k 2023-10-18T19:36:00.305 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 390 k 2023-10-18T19:36:00.305 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 369 k 2023-10-18T19:36:00.305 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 114 k 2023-10-18T19:36:00.305 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 88 k 2023-10-18T19:36:00.305 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 3.7 M 2023-10-18T19:36:00.306 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 173 k 2023-10-18T19:36:00.306 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-18T19:36:00.306 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:16.2.14-100.gb4ddd52c.el8 ceph-noarch 244 k 2023-10-18T19:36:00.306 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 174 k 2023-10-18T19:36:00.306 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:16.2.14-100.gb4ddd52c.el8 ceph 99 k 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout:Install 3 Packages 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 26 Packages 2023-10-18T19:36:00.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:36:00.308 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 140 M 2023-10-18T19:36:00.308 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-18T19:36:00.946 INFO:teuthology.orchestra.run.smithi088.stdout:(1/29): libcephsqlite-16.2.14-100.gb4ddd52c.el8 271 kB/s | 174 kB 00:00 2023-10-18T19:36:00.971 INFO:teuthology.orchestra.run.smithi088.stdout:(2/29): python3-ceph-common-16.2.14-100.gb4ddd5 148 kB/s | 99 kB 00:00 2023-10-18T19:36:01.047 INFO:teuthology.orchestra.run.smithi088.stdout:(3/29): ceph-16.2.14-100.gb4ddd52c.el8.x86_64.r 64 kB/s | 6.4 kB 00:00 2023-10-18T19:36:01.163 INFO:teuthology.orchestra.run.smithi088.stdout:(4/29): ceph-mgr-modules-core-16.2.14-100.gb4dd 285 kB/s | 244 kB 00:00 2023-10-18T19:36:02.522 INFO:teuthology.orchestra.run.smithi088.stdout:(5/29): ceph-fuse-16.2.14-100.gb4ddd52c.el8.x86 671 kB/s | 912 kB 00:01 2023-10-18T19:36:04.306 INFO:teuthology.orchestra.run.smithi088.stdout:(6/29): ceph-base-16.2.14-100.gb4ddd52c.el8.x86 1.8 MB/s | 6.1 MB 00:03 2023-10-18T19:36:04.948 INFO:teuthology.orchestra.run.smithi088.stdout:(7/29): ceph-mgr-16.2.14-100.gb4ddd52c.el8.x86_ 2.5 MB/s | 1.6 MB 00:00 2023-10-18T19:36:05.114 INFO:teuthology.orchestra.run.smithi088.stdout:(8/29): ceph-mds-16.2.14-100.gb4ddd52c.el8.x86_ 965 kB/s | 2.4 MB 00:02 2023-10-18T19:36:06.515 INFO:teuthology.orchestra.run.smithi088.stdout:(9/29): ceph-mon-16.2.14-100.gb4ddd52c.el8.x86_ 3.2 MB/s | 5.0 MB 00:01 2023-10-18T19:36:07.207 INFO:teuthology.orchestra.run.smithi088.stdout:(10/29): ceph-common-16.2.14-100.gb4ddd52c.el8. 3.9 MB/s | 24 MB 00:06 2023-10-18T19:36:07.382 INFO:teuthology.orchestra.run.smithi088.stdout:(11/29): ceph-selinux-16.2.14-100.gb4ddd52c.el8 147 kB/s | 26 kB 00:00 2023-10-18T19:36:09.557 INFO:teuthology.orchestra.run.smithi088.stdout:(12/29): ceph-radosgw-16.2.14-100.gb4ddd52c.el8 3.8 MB/s | 12 MB 00:03 2023-10-18T19:36:09.674 INFO:teuthology.orchestra.run.smithi088.stdout:(13/29): libcephfs-devel-16.2.14-100.gb4ddd52c. 219 kB/s | 25 kB 00:00 2023-10-18T19:36:09.957 INFO:teuthology.orchestra.run.smithi088.stdout:(14/29): libcephfs2-16.2.14-100.gb4ddd52c.el8.x 2.8 MB/s | 825 kB 00:00 2023-10-18T19:36:10.074 INFO:teuthology.orchestra.run.smithi088.stdout:(15/29): librados-devel-16.2.14-100.gb4ddd52c.e 1.1 MB/s | 131 kB 00:00 2023-10-18T19:36:11.058 INFO:teuthology.orchestra.run.smithi088.stdout:(16/29): librados2-16.2.14-100.gb4ddd52c.el8.x8 3.8 MB/s | 3.7 MB 00:00 2023-10-18T19:36:11.300 INFO:teuthology.orchestra.run.smithi088.stdout:(17/29): libradosstriper1-16.2.14-100.gb4ddd52c 2.0 MB/s | 494 kB 00:00 2023-10-18T19:36:12.442 INFO:teuthology.orchestra.run.smithi088.stdout:(18/29): librbd1-16.2.14-100.gb4ddd52c.el8.x86_ 3.7 MB/s | 4.2 MB 00:01 2023-10-18T19:36:13.575 INFO:teuthology.orchestra.run.smithi088.stdout:(19/29): librgw2-16.2.14-100.gb4ddd52c.el8.x86_ 3.3 MB/s | 3.8 MB 00:01 2023-10-18T19:36:13.675 INFO:teuthology.orchestra.run.smithi088.stdout:(20/29): python3-ceph-argparse-16.2.14-100.gb4d 452 kB/s | 45 kB 00:00 2023-10-18T19:36:13.784 INFO:teuthology.orchestra.run.smithi088.stdout:(21/29): python3-cephfs-16.2.14-100.gb4ddd52c.e 1.9 MB/s | 215 kB 00:00 2023-10-18T19:36:13.976 INFO:teuthology.orchestra.run.smithi088.stdout:(22/29): python3-rados-16.2.14-100.gb4ddd52c.el 2.0 MB/s | 390 kB 00:00 2023-10-18T19:36:14.127 INFO:teuthology.orchestra.run.smithi088.stdout:(23/29): python3-rbd-16.2.14-100.gb4ddd52c.el8. 2.4 MB/s | 369 kB 00:00 2023-10-18T19:36:14.227 INFO:teuthology.orchestra.run.smithi088.stdout:(24/29): python3-rgw-16.2.14-100.gb4ddd52c.el8. 1.1 MB/s | 114 kB 00:00 2023-10-18T19:36:14.352 INFO:teuthology.orchestra.run.smithi088.stdout:(25/29): rbd-fuse-16.2.14-100.gb4ddd52c.el8.x86 709 kB/s | 88 kB 00:00 2023-10-18T19:36:15.286 INFO:teuthology.orchestra.run.smithi088.stdout:(26/29): rbd-mirror-16.2.14-100.gb4ddd52c.el8.x 3.9 MB/s | 3.7 MB 00:00 2023-10-18T19:36:15.403 INFO:teuthology.orchestra.run.smithi088.stdout:(27/29): rbd-nbd-16.2.14-100.gb4ddd52c.el8.x86_ 1.5 MB/s | 173 kB 00:00 2023-10-18T19:36:19.220 INFO:teuthology.orchestra.run.smithi088.stdout:(28/29): ceph-test-16.2.14-100.gb4ddd52c.el8.x8 4.4 MB/s | 52 MB 00:11 2023-10-18T19:36:19.762 INFO:teuthology.orchestra.run.smithi088.stdout:(29/29): ceph-osd-16.2.14-100.gb4ddd52c.el8.x86 1.3 MB/s | 18 MB 00:14 2023-10-18T19:36:19.765 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-18T19:36:19.765 INFO:teuthology.orchestra.run.smithi088.stdout:Total 7.2 MB/s | 140 MB 00:19 2023-10-18T19:36:19.766 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-18T19:36:19.835 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-18T19:36:19.835 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-18T19:36:20.517 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-18T19:36:20.521 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-18T19:36:22.466 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-18T19:36:22.843 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.14-100.gb4ddd52c.el8.x86_64 1/1 2023-10-18T19:36:23.016 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:16.2.14-100.gb4ddd52c.el8.x86_64 1/55 2023-10-18T19:36:23.466 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.14-100.gb4ddd52c.el8.x86_64 1/55 2023-10-18T19:36:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:16.2.14-100.gb4ddd52c.el8.x86_64 2/55 2023-10-18T19:36:23.869 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.14-100.gb4ddd52c.el8.x86_64 2/55 2023-10-18T19:36:24.074 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libcephfs2-2:16.2.14-100.gb4ddd52c.el8.x86_64 3/55 2023-10-18T19:36:24.502 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:16.2.14-100.gb4ddd52c.el8.x86_64 3/55 2023-10-18T19:36:24.949 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librgw2-2:16.2.14-100.gb4ddd52c.el8.x86_64 4/55 2023-10-18T19:36:25.068 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:16.2.14-100.gb4ddd52c.el8.x86_64 4/55 2023-10-18T19:36:25.298 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : python3-rados-2:16.2.14-100.gb4ddd52c.el8.x86_64 5/55 2023-10-18T19:36:25.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:16.2.14-100.gb4ddd52c.el8.x86_64 6/55 2023-10-18T19:36:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:16.2.14-100.gb4ddd52c.el8.x86_64 6/55 2023-10-18T19:36:25.840 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libradosstriper1-2:16.2.14-100.gb4ddd52c.el8.x86_6 7/55 2023-10-18T19:36:25.906 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:16.2.14-100.gb4ddd52c.el8.x86_6 7/55 2023-10-18T19:36:26.103 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : python3-ceph-argparse-2:16.2.14-100.gb4ddd52c.el8. 8/55 2023-10-18T19:36:26.348 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:16.2.14-100.gb4ddd52c.el8.x8 9/55 2023-10-18T19:36:26.637 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : python3-cephfs-2:16.2.14-100.gb4ddd52c.el8.x86_64 10/55 2023-10-18T19:36:26.891 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : python3-rbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 11/55 2023-10-18T19:36:27.116 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : python3-rgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 12/55 2023-10-18T19:36:29.335 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 13/55 2023-10-18T19:36:29.557 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 13/55 2023-10-18T19:36:30.426 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 13/55 2023-10-18T19:36:30.723 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-base-2:16.2.14-100.gb4ddd52c.el8.x86_64 14/55 2023-10-18T19:36:30.806 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:16.2.14-100.gb4ddd52c.el8.x86_64 14/55 2023-10-18T19:36:31.014 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-selinux-2:16.2.14-100.gb4ddd52c.el8.x86_64 15/55 2023-10-18T19:36:50.256 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:16.2.14-100.gb4ddd52c.el8.x86_64 15/55 2023-10-18T19:36:50.552 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-mds-2:16.2.14-100.gb4ddd52c.el8.x86_64 16/55 2023-10-18T19:36:51.057 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:16.2.14-100.gb4ddd52c.el8.x86_64 16/55 2023-10-18T19:36:51.244 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-mon-2:16.2.14-100.gb4ddd52c.el8.x86_64 17/55 2023-10-18T19:36:52.895 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:16.2.14-100.gb4ddd52c.el8.x86_64 17/55 2023-10-18T19:36:53.127 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-osd-2:16.2.14-100.gb4ddd52c.el8.x86_64 18/55 2023-10-18T19:36:53.169 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:16.2.14-100.gb4ddd52c.el8.x86_64 18/55 2023-10-18T19:36:53.489 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 19/55 2023-10-18T19:36:53.897 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-100.gb4ddd52c.el8. 20/55 2023-10-18T19:36:54.176 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-mgr-2:16.2.14-100.gb4ddd52c.el8.x86_64 21/55 2023-10-18T19:36:54.193 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:16.2.14-100.gb4ddd52c.el8.x86_64 21/55 2023-10-18T19:36:54.331 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-2:16.2.14-100.gb4ddd52c.el8.x86_64 22/55 2023-10-18T19:36:55.555 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libcephfs-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 23/55 2023-10-18T19:36:55.792 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-radosgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 24/55 2023-10-18T19:36:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 24/55 2023-10-18T19:36:56.526 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : rbd-mirror-2:16.2.14-100.gb4ddd52c.el8.x86_64 25/55 2023-10-18T19:37:01.506 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:16.2.14-100.gb4ddd52c.el8.x86_64 25/55 2023-10-18T19:37:01.783 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-test-2:16.2.14-100.gb4ddd52c.el8.x86_64 26/55 2023-10-18T19:37:02.008 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : rbd-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 27/55 2023-10-18T19:37:02.305 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : rbd-nbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 28/55 2023-10-18T19:37:02.543 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : ceph-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 29/55 2023-10-18T19:37:02.658 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-2:14.2.22-0.el8.x86_64 30/55 2023-10-18T19:37:02.875 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-test-2:14.2.22-0.el8.x86_64 31/55 2023-10-18T19:37:02.892 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2023-10-18T19:37:02.893 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2023-10-18T19:37:03.108 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2023-10-18T19:37:03.258 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libcephfs-devel-2:14.2.22-0.el8.x86_64 33/55 2023-10-18T19:37:03.441 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : rbd-nbd-2:14.2.22-0.el8.x86_64 34/55 2023-10-18T19:37:03.459 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2023-10-18T19:37:03.459 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2023-10-18T19:37:03.667 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2023-10-18T19:37:03.891 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : rbd-fuse-2:14.2.22-0.el8.x86_64 36/55 2023-10-18T19:37:04.084 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados-devel-2:14.2.22-0.el8.x86_64 37/55 2023-10-18T19:37:04.102 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2023-10-18T19:37:04.102 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2023-10-18T19:37:04.293 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2023-10-18T19:37:04.317 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2023-10-18T19:37:04.317 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2023-10-18T19:37:04.542 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2023-10-18T19:37:04.559 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2023-10-18T19:37:04.560 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2023-10-18T19:37:04.734 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2023-10-18T19:37:04.752 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2023-10-18T19:37:04.752 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2023-10-18T19:37:04.949 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2023-10-18T19:37:04.950 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-selinux-2:14.2.22-0.el8.x86_64 42/55 2023-10-18T19:37:05.135 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 42/55 2023-10-18T19:37:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 43/55 2023-10-18T19:37:05.166 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-base-2:14.2.22-0.el8.x86_64 43/55 2023-10-18T19:37:05.486 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 43/55 2023-10-18T19:37:05.486 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-common-2:14.2.22-0.el8.x86_64 44/55 2023-10-18T19:37:05.717 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 44/55 2023-10-18T19:37:05.718 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libradosstriper1-2:14.2.22-0.el8.x86_64 45/55 2023-10-18T19:37:05.967 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 45/55 2023-10-18T19:37:06.166 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : python3-cephfs-2:14.2.22-0.el8.x86_64 46/55 2023-10-18T19:37:06.399 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : python3-rbd-2:14.2.22-0.el8.x86_64 47/55 2023-10-18T19:37:06.400 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:14.2.22-0.el8.x86_64 48/55 2023-10-18T19:37:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 48/55 2023-10-18T19:37:06.853 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : python3-rgw-2:14.2.22-0.el8.x86_64 49/55 2023-10-18T19:37:06.853 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librgw2-2:14.2.22-0.el8.x86_64 50/55 2023-10-18T19:37:07.100 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 50/55 2023-10-18T19:37:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : python3-rados-2:14.2.22-0.el8.x86_64 51/55 2023-10-18T19:37:07.299 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libcephfs2-2:14.2.22-0.el8.x86_64 52/55 2023-10-18T19:37:07.568 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 52/55 2023-10-18T19:37:07.732 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : ceph-fuse-2:14.2.22-0.el8.x86_64 53/55 2023-10-18T19:37:07.858 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 54/55 2023-10-18T19:37:07.858 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:14.2.22-0.el8.x86_64 55/55 2023-10-18T19:37:08.213 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 55/55 2023-10-18T19:37:08.214 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-18T19:37:08.214 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:08.909 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:16.2.14-100.gb4ddd52c.el8.x86_64 1/55 2023-10-18T19:37:08.910 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:16.2.14-100.gb4ddd52c.el8.x8 2/55 2023-10-18T19:37:08.910 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-100.gb4ddd52c.el8. 3/55 2023-10-18T19:37:08.910 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:16.2.14-100.gb4ddd52c.el8.x86_64 4/55 2023-10-18T19:37:08.910 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 5/55 2023-10-18T19:37:08.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:16.2.14-100.gb4ddd52c.el8.x86_64 6/55 2023-10-18T19:37:08.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 7/55 2023-10-18T19:37:08.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 8/55 2023-10-18T19:37:08.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 9/55 2023-10-18T19:37:08.911 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 10/55 2023-10-18T19:37:08.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 11/55 2023-10-18T19:37:08.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:16.2.14-100.gb4ddd52c.el8.x86_64 12/55 2023-10-18T19:37:08.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 13/55 2023-10-18T19:37:08.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:16.2.14-100.gb4ddd52c.el8.x86_64 14/55 2023-10-18T19:37:08.912 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 15/55 2023-10-18T19:37:08.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:16.2.14-100.gb4ddd52c.el8.x86_64 16/55 2023-10-18T19:37:08.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 17/55 2023-10-18T19:37:08.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:16.2.14-100.gb4ddd52c.el8.x86_64 18/55 2023-10-18T19:37:08.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 19/55 2023-10-18T19:37:08.913 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 20/55 2023-10-18T19:37:08.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 21/55 2023-10-18T19:37:08.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:16.2.14-100.gb4ddd52c.el8.x86_64 22/55 2023-10-18T19:37:08.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 23/55 2023-10-18T19:37:08.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:16.2.14-100.gb4ddd52c.el8.x86_64 24/55 2023-10-18T19:37:08.914 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 25/55 2023-10-18T19:37:08.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 26/55 2023-10-18T19:37:08.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 27/55 2023-10-18T19:37:08.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:16.2.14-100.gb4ddd52c.el8.x86_64 28/55 2023-10-18T19:37:08.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 29/55 2023-10-18T19:37:08.915 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 30/55 2023-10-18T19:37:08.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 31/55 2023-10-18T19:37:08.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.14-100.gb4ddd52c.el8.x86_64 32/55 2023-10-18T19:37:08.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 33/55 2023-10-18T19:37:08.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:16.2.14-100.gb4ddd52c.el8.x86_6 34/55 2023-10-18T19:37:08.916 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 35/55 2023-10-18T19:37:08.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.14-100.gb4ddd52c.el8.x86_64 36/55 2023-10-18T19:37:08.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 37/55 2023-10-18T19:37:08.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:16.2.14-100.gb4ddd52c.el8.x86_64 38/55 2023-10-18T19:37:08.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 39/55 2023-10-18T19:37:08.917 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:16.2.14-100.gb4ddd52c.el8. 40/55 2023-10-18T19:37:08.918 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 41/55 2023-10-18T19:37:08.918 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:16.2.14-100.gb4ddd52c.el8.x86_64 42/55 2023-10-18T19:37:08.918 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 43/55 2023-10-18T19:37:08.918 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:16.2.14-100.gb4ddd52c.el8.x86_64 44/55 2023-10-18T19:37:08.918 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 45/55 2023-10-18T19:37:08.919 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 46/55 2023-10-18T19:37:08.919 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 47/55 2023-10-18T19:37:08.919 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 48/55 2023-10-18T19:37:08.919 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 49/55 2023-10-18T19:37:08.919 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 50/55 2023-10-18T19:37:08.920 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 51/55 2023-10-18T19:37:08.920 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:16.2.14-100.gb4ddd52c.el8.x86_64 52/55 2023-10-18T19:37:08.920 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 53/55 2023-10-18T19:37:08.921 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 54/55 2023-10-18T19:37:10.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 55/55 2023-10-18T19:37:10.452 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:10.453 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-10-18T19:37:10.453 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.453 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.453 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.453 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.454 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.455 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.455 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.455 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.455 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.455 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.456 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.456 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.456 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.456 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.456 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.457 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.458 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-18T19:37:10.458 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:16.2.14-100.gb4ddd52c.el8.noarch 2023-10-18T19:37:10.458 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.458 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:16.2.14-100.gb4ddd52c.el8.x86_64 2023-10-18T19:37:10.458 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:10.459 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-18T19:37:10.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5 2023-10-18T19:37:10.894 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-18T19:37:10.950 INFO:teuthology.orchestra.run.smithi088.stdout:16.2.14-100.gb4ddd52c.el8 2023-10-18T19:37:10.951 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-100.gb4ddd52c.el8 2023-10-18T19:37:10.951 INFO:teuthology.task.install:The correct ceph version 16.2.14-100.gb4ddd52c is installed. 2023-10-18T19:37:10.952 INFO:teuthology.run_tasks:Running task print... 2023-10-18T19:37:10.962 INFO:teuthology.task.print:**** done install.upgrade both hosts 2023-10-18T19:37:10.962 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-18T19:37:10.991 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-18T19:37:10.992 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:11.010 INFO:tasks.ceph.mon.a:Stopped 2023-10-18T19:37:11.011 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-18T19:37:11.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-18T19:37:11.055 INFO:tasks.ceph.mon.a:Started 2023-10-18T19:37:11.056 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-18T19:37:11.057 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:11.075 INFO:tasks.ceph.mon.b:Stopped 2023-10-18T19:37:11.076 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-18T19:37:11.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-18T19:37:11.120 INFO:tasks.ceph.mon.b:Started 2023-10-18T19:37:11.120 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-18T19:37:11.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:11.143 INFO:tasks.ceph.mon.c:Stopped 2023-10-18T19:37:11.143 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-18T19:37:11.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-18T19:37:11.188 INFO:tasks.ceph.mon.c:Started 2023-10-18T19:37:11.188 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-18T19:37:11.189 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:11.229 INFO:tasks.ceph.mgr.x:Stopped 2023-10-18T19:37:11.229 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-18T19:37:11.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-18T19:37:11.275 INFO:tasks.ceph.mgr.x:Started 2023-10-18T19:37:11.275 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-18T19:37:11.276 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:11.322 INFO:tasks.ceph.mgr.y:Stopped 2023-10-18T19:37:11.323 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-18T19:37:11.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-18T19:37:11.327 INFO:tasks.ceph.mgr.y:Started 2023-10-18T19:37:11.328 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-18T19:37:11.339 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T19:37:11.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T19:37:11.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T19:37:11.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.553+0000 7feb285ff700 1 Processor -- start 2023-10-18T19:37:11.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.554+0000 7feb285ff700 1 -- start start 2023-10-18T19:37:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.554+0000 7feb285ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.554+0000 7feb285ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb200a4a20 0x7feb20135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb285ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2005ed40 con 0x7feb201361c0 2023-10-18T19:37:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb285ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200a3a70 con 0x7feb200a4a20 2023-10-18T19:37:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb285ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb20136670 con 0x7feb2005e960 2023-10-18T19:37:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb200a4a20 0x7feb20135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb2639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb200a4a20 0x7feb20135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55860/0 (socket says 172.21.15.88:55860) 2023-10-18T19:37:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 -- 172.21.15.88:0/3301538070 learned_addr learned my addr 172.21.15.88:0/3301538070 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb2639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43638/0 (socket says 172.21.15.88:43638) 2023-10-18T19:37:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 -- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 msgr2=0x7feb200a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 -- 172.21.15.88:0/3301538070 >> v1:172.21.15.88:6789/0 conn(0x7feb201361c0 legacy=0x7feb20138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25b9a700 1 -- 172.21.15.88:0/3301538070 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200a2ac0 con 0x7feb200a4a20 2023-10-18T19:37:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb25399700 1 -- 172.21.15.88:0/3301538070 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941792524 0 0) 0x7feb2005ed40 con 0x7feb201361c0 2023-10-18T19:37:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.555+0000 7feb2639b700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb25b9a700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb20135cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7feb10006fd0 tx=0x7feb100090f0).ready entity=mon.0 client_cookie=3f2451d0d65e5d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:11.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb25399700 1 -- 172.21.15.88:0/3301538070 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000b610 con 0x7feb200a4a20 2023-10-18T19:37:11.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb25399700 1 -- 172.21.15.88:0/3301538070 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1000b770 con 0x7feb200a4a20 2023-10-18T19:37:11.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb25399700 1 -- 172.21.15.88:0/3301538070 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000baf0 con 0x7feb200a4a20 2023-10-18T19:37:11.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 -- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 msgr2=0x7feb20135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb20135cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7feb10006fd0 tx=0x7feb100090f0).stop 2023-10-18T19:37:11.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 -- 172.21.15.88:0/3301538070 shutdown_connections 2023-10-18T19:37:11.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 --2- 172.21.15.88:0/3301538070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb20135cd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 -- 172.21.15.88:0/3301538070 >> 172.21.15.88:0/3301538070 conn(0x7feb20064bb0 msgr2=0x7feb2005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:11.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.556+0000 7feb285ff700 1 -- 172.21.15.88:0/3301538070 shutdown_connections 2023-10-18T19:37:11.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.557+0000 7feb285ff700 1 -- 172.21.15.88:0/3301538070 wait complete. 2023-10-18T19:37:11.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.558+0000 7feb285ff700 1 Processor -- start 2023-10-18T19:37:11.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.558+0000 7feb285ff700 1 -- start start 2023-10-18T19:37:11.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb200a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 0x7feb20138800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200a6fd0 con 0x7feb200a4a20 2023-10-18T19:37:11.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb20139830 con 0x7feb201361c0 2023-10-18T19:37:11.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb285ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb201486c0 con 0x7feb2005e960 2023-10-18T19:37:11.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43648/0 (socket says 172.21.15.88:43648) 2023-10-18T19:37:11.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 -- 172.21.15.88:0/3838494595 learned_addr learned my addr 172.21.15.88:0/3838494595 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:11.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb25b9a700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb200a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb26b9c700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 0x7feb20138800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 -- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 msgr2=0x7feb20138800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 0x7feb20138800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 -- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 msgr2=0x7feb200a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb200a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb2639b700 1 -- 172.21.15.88:0/3838494595 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0092a0 con 0x7feb2005e960 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.559+0000 7feb26b9c700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 0x7feb20138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:37:11.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb2639b700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7feb1c00ea20 tx=0x7feb1c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00c850 con 0x7feb2005e960 2023-10-18T19:37:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00c9b0 con 0x7feb2005e960 2023-10-18T19:37:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00cd30 con 0x7feb2005e960 2023-10-18T19:37:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb10009370 con 0x7feb2005e960 2023-10-18T19:37:11.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.560+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb20139400 con 0x7feb2005e960 2023-10-18T19:37:11.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.561+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7feb1c012600 con 0x7feb2005e960 2023-10-18T19:37:11.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.561+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7feb1c02ae00 con 0x7feb2005e960 2023-10-18T19:37:11.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.561+0000 7feb25b9a700 1 -- 172.21.15.88:0/3838494595 >> v1:172.21.15.88:6800/107321 conn(0x7feb0401c910 legacy=0x7feb0401edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:11.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.561+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2005f270 con 0x7feb2005e960 2023-10-18T19:37:11.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.567+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101279 (secure 0 0 0) 0x7feb1c01e120 con 0x7feb2005e960 2023-10-18T19:37:11.643 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:11.640+0000 7f5bb0c28680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T19:37:11.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.690+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7feb200a1100 con 0x7feb2005e960 2023-10-18T19:37:11.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.691+0000 7feb167fc700 1 -- 172.21.15.88:0/3838494595 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+47752 (secure 0 0 0) 0x7feb1c00a0d0 con 0x7feb2005e960 2023-10-18T19:37:11.695 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:11.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 >> v1:172.21.15.88:6800/107321 conn(0x7feb0401c910 legacy=0x7feb0401edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:11.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 msgr2=0x7feb200a7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7feb1c00ea20 tx=0x7feb1c009060).stop 2023-10-18T19:37:11.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 shutdown_connections 2023-10-18T19:37:11.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feb201361c0 0x7feb20138800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feb2005e960 0x7feb200a7460 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 --2- 172.21.15.88:0/3838494595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb200a4a20 0x7feb200a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 >> 172.21.15.88:0/3838494595 conn(0x7feb20064bb0 msgr2=0x7feb20135a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:11.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 shutdown_connections 2023-10-18T19:37:11.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.693+0000 7feb285ff700 1 -- 172.21.15.88:0/3838494595 wait complete. 2023-10-18T19:37:11.714 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":4,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6800","nonce":107321}]},"active_addr":"172.21.15.88:6800/107321","active_change":"2023-10-18T19:34:01.937943+0000","active_mgr_features":0,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":0,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[]} 2023-10-18T19:37:11.717 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T19:37:11.717 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T19:37:11.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:11.737 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:11.735+0000 7f5bb0c28680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T19:37:11.778 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:11.775+0000 7f8d4eb2f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T19:37:11.832 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:11.830+0000 7f5bb0c28680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T19:37:11.860 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:11.858+0000 7f8d4eb2f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T19:37:11.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.913+0000 7fccd49ff700 1 Processor -- start 2023-10-18T19:37:11.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.913+0000 7fccd49ff700 1 -- start start 2023-10-18T19:37:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccd49ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fccd00a1790 0x7fccd01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccd49ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00a4c50 0x7fccd01437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccd49ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00afd50 con 0x7fccd00af970 2023-10-18T19:37:11.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccd49ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd00a47a0 con 0x7fccd00a1790 2023-10-18T19:37:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccd49ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00a3a10 con 0x7fccd00a4c50 2023-10-18T19:37:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fcccdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fccd00a1790 0x7fccd01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fcccdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fccd00a1790 0x7fccd01412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55880/0 (socket says 172.21.15.88:55880) 2023-10-18T19:37:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccce59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fccd00af970 0x7fccd0135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47954/0 (socket says 172.21.15.88:47954) 2023-10-18T19:37:11.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fcccdd9b700 1 -- 172.21.15.88:0/1257569033 learned_addr learned my addr 172.21.15.88:0/1257569033 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:11.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.914+0000 7fccced9d700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00a4c50 0x7fccd01437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccdd9b700 1 -- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00a4c50 msgr2=0x7fccd01437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:11.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccdd9b700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00a4c50 0x7fccd01437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccd59a700 1 -- 172.21.15.88:0/1257569033 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491368610 0 0) 0x7fccd00afd50 con 0x7fccd00af970 2023-10-18T19:37:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccdd9b700 1 -- 172.21.15.88:0/1257569033 >> v1:172.21.15.88:6789/0 conn(0x7fccd00af970 legacy=0x7fccd0135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccdd9b700 1 -- 172.21.15.88:0/1257569033 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00a32d0 con 0x7fccd00a1790 2023-10-18T19:37:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccdd9b700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a1790 0x7fccd01412e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fccc4006fd0 tx=0x7fccc40090f0).ready entity=mon.0 client_cookie=86315dc40d42bbd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:11.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccd59a700 1 -- 172.21.15.88:0/1257569033 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400b580 con 0x7fccd00a1790 2023-10-18T19:37:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccd59a700 1 -- 172.21.15.88:0/1257569033 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400b6e0 con 0x7fccd00a1790 2023-10-18T19:37:11.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.915+0000 7fcccd59a700 1 -- 172.21.15.88:0/1257569033 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400ba60 con 0x7fccd00a1790 2023-10-18T19:37:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 -- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a1790 msgr2=0x7fccd01412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a1790 0x7fccd01412e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fccc4006fd0 tx=0x7fccc40090f0).stop 2023-10-18T19:37:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 -- 172.21.15.88:0/1257569033 shutdown_connections 2023-10-18T19:37:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00a4c50 0x7fccd01437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 --2- 172.21.15.88:0/1257569033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a1790 0x7fccd01412e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 -- 172.21.15.88:0/1257569033 >> 172.21.15.88:0/1257569033 conn(0x7fccd005eb60 msgr2=0x7fccd00af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 -- 172.21.15.88:0/1257569033 shutdown_connections 2023-10-18T19:37:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.916+0000 7fccd49ff700 1 -- 172.21.15.88:0/1257569033 wait complete. 2023-10-18T19:37:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.917+0000 7fccd49ff700 1 Processor -- start 2023-10-18T19:37:11.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 -- start start 2023-10-18T19:37:11.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a4c50 0x7fccd014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 0x7fccd0148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0148950 con 0x7fccd00a4c50 2023-10-18T19:37:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd00a8f20 con 0x7fccd00a1790 2023-10-18T19:37:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.918+0000 7fccd49ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccd014cbd0 con 0x7fccd00af970 2023-10-18T19:37:11.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 0x7fccd0148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccce59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccce59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42738/0 (socket says 172.21.15.88:42738) 2023-10-18T19:37:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccce59c700 1 -- 172.21.15.88:0/2352880607 learned_addr learned my addr 172.21.15.88:0/2352880607 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fcccdd9b700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a4c50 0x7fccd014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:11.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 -- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 msgr2=0x7fccd013c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 -- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a4c50 msgr2=0x7fccd014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a4c50 0x7fccd014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccced9d700 1 -- 172.21.15.88:0/2352880607 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4009370 con 0x7fccd00af970 2023-10-18T19:37:11.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.919+0000 7fccce59c700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:11.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccced9d700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 0x7fccd0148cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fccc8009e20 tx=0x7fccc800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:11.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800cb30 con 0x7fccd00af970 2023-10-18T19:37:11.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc800f040 con 0x7fccd00af970 2023-10-18T19:37:11.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800cea0 con 0x7fccd00af970 2023-10-18T19:37:11.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd00a9c30 con 0x7fccd00af970 2023-10-18T19:37:11.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.920+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd00a6fc0 con 0x7fccd00af970 2023-10-18T19:37:11.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.921+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7fccc8013610 con 0x7fccd00af970 2023-10-18T19:37:11.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.921+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fccc802aea0 con 0x7fccd00af970 2023-10-18T19:37:11.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.921+0000 7fccce59c700 1 -- 172.21.15.88:0/2352880607 >> v1:172.21.15.88:6800/107321 conn(0x7fccb001c910 legacy=0x7fccb001edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:11.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.922+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd00a9e20 con 0x7fccd00af970 2023-10-18T19:37:11.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:11.925+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101279 (secure 0 0 0) 0x7fccc8013e60 con 0x7fccd00af970 2023-10-18T19:37:11.952 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:11.949+0000 7f8d4eb2f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T19:37:12.043 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:12.040+0000 7f5bb0c28680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T19:37:12.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.058+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd005f270 con 0x7fccd00af970 2023-10-18T19:37:12.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.059+0000 7fccbe7fc700 1 -- 172.21.15.88:0/2352880607 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9704 (secure 0 0 0) 0x7fccc8013e60 con 0x7fccd00af970 2023-10-18T19:37:12.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:12.062 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:34:38.270136+0000","last_up_change":"2023-10-18T19:34:06.488799+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:12.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 >> v1:172.21.15.88:6800/107321 conn(0x7fccb001c910 legacy=0x7fccb001edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:12.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 msgr2=0x7fccd0148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 0x7fccd0148cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fccc8009e20 tx=0x7fccc800b040).stop 2023-10-18T19:37:12.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 shutdown_connections 2023-10-18T19:37:12.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fccd00af970 0x7fccd0148cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fccd00a1790 0x7fccd013c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 --2- 172.21.15.88:0/2352880607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fccd00a4c50 0x7fccd014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 >> 172.21.15.88:0/2352880607 conn(0x7fccd005eb60 msgr2=0x7fccd00627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 shutdown_connections 2023-10-18T19:37:12.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.061+0000 7fccd49ff700 1 -- 172.21.15.88:0/2352880607 wait complete. 2023-10-18T19:37:12.082 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T19:37:12.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:12.130 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:12.128+0000 7f8d4eb2f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T19:37:12.250 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:12.248+0000 7f5bb0c28680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T19:37:12.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.314+0000 7fc9837ff700 1 Processor -- start 2023-10-18T19:37:12.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.315+0000 7fc9837ff700 1 -- start start 2023-10-18T19:37:12.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.315+0000 7fc9837ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0af970 0x7fc97c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.315+0000 7fc9837ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 0x7fc97c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc9837ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0afd50 con 0x7fc97c0a4c50 2023-10-18T19:37:12.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc9837ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a47a0 con 0x7fc97c0af970 2023-10-18T19:37:12.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc9837ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a3a10 con 0x7fc97c0a1790 2023-10-18T19:37:12.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc981d9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc97c0a4c50 0x7fc97c13bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47962/0 (socket says 172.21.15.88:47962) 2023-10-18T19:37:12.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc981d9c700 1 -- 172.21.15.88:0/1809039942 learned_addr learned my addr 172.21.15.88:0/1809039942 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:12.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc98159b700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0af970 0x7fc97c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc980d9a700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 0x7fc97c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc973fff700 1 -- 172.21.15.88:0/1809039942 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474891771 0 0) 0x7fc97c0afd50 con 0x7fc97c0a4c50 2023-10-18T19:37:12.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.316+0000 7fc973fff700 1 -- 172.21.15.88:0/1809039942 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9680033f0 con 0x7fc97c0a4c50 2023-10-18T19:37:12.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc980d9a700 1 -- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0af970 msgr2=0x7fc97c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:12.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc980d9a700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0af970 0x7fc97c135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc980d9a700 1 -- 172.21.15.88:0/1809039942 >> v1:172.21.15.88:6789/0 conn(0x7fc97c0a4c50 legacy=0x7fc97c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc980d9a700 1 -- 172.21.15.88:0/1809039942 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0a32d0 con 0x7fc97c0a1790 2023-10-18T19:37:12.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc980d9a700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 0x7fc97c136220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc96c0097c0 tx=0x7fc96c009060).ready entity=mon.2 client_cookie=471778fe0fb442f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc973fff700 1 -- 172.21.15.88:0/1809039942 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00d4a0 con 0x7fc97c0a1790 2023-10-18T19:37:12.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc973fff700 1 -- 172.21.15.88:0/1809039942 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00d600 con 0x7fc97c0a1790 2023-10-18T19:37:12.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.317+0000 7fc973fff700 1 -- 172.21.15.88:0/1809039942 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00d980 con 0x7fc97c0a1790 2023-10-18T19:37:12.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 -- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 msgr2=0x7fc97c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 0x7fc97c136220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc96c0097c0 tx=0x7fc96c009060).stop 2023-10-18T19:37:12.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 -- 172.21.15.88:0/1809039942 shutdown_connections 2023-10-18T19:37:12.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0af970 0x7fc97c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 --2- 172.21.15.88:0/1809039942 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a1790 0x7fc97c136220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 -- 172.21.15.88:0/1809039942 >> 172.21.15.88:0/1809039942 conn(0x7fc97c05eb60 msgr2=0x7fc97c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 -- 172.21.15.88:0/1809039942 shutdown_connections 2023-10-18T19:37:12.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.318+0000 7fc9837ff700 1 -- 172.21.15.88:0/1809039942 wait complete. 2023-10-18T19:37:12.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.319+0000 7fc9837ff700 1 Processor -- start 2023-10-18T19:37:12.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 -- start start 2023-10-18T19:37:12.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 0x7fc97c091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97c0af970 0x7fc97c0a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0aa3d0 con 0x7fc97c0af970 2023-10-18T19:37:12.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ac180 con 0x7fc97c0a1790 2023-10-18T19:37:12.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.320+0000 7fc9837ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c148e90 con 0x7fc97c0a4c50 2023-10-18T19:37:12.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42758/0 (socket says 172.21.15.88:42758) 2023-10-18T19:37:12.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 -- 172.21.15.88:0/2038728575 learned_addr learned my addr 172.21.15.88:0/2038728575 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:12.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc980d9a700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 0x7fc97c091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc981d9c700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97c0af970 0x7fc97c0a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 -- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 msgr2=0x7fc97c091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 0x7fc97c091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 -- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97c0af970 msgr2=0x7fc97c0a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97c0af970 0x7fc97c0a8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 -- 172.21.15.88:0/2038728575 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0092a0 con 0x7fc97c0a1790 2023-10-18T19:37:12.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc980d9a700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 0x7fc97c091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:12.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.321+0000 7fc98159b700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc97800e930 tx=0x7fc978009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.322+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978012600 con 0x7fc97c0a1790 2023-10-18T19:37:12.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.322+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc978012760 con 0x7fc97c0a1790 2023-10-18T19:37:12.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.322+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c149130 con 0x7fc97c0a1790 2023-10-18T19:37:12.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.322+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978012ae0 con 0x7fc97c0a1790 2023-10-18T19:37:12.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.322+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c0af490 con 0x7fc97c0a1790 2023-10-18T19:37:12.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.323+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7fc97801b400 con 0x7fc97c0a1790 2023-10-18T19:37:12.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.323+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc97802ae00 con 0x7fc97c0a1790 2023-10-18T19:37:12.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.323+0000 7fc980d9a700 1 -- 172.21.15.88:0/2038728575 >> v1:172.21.15.88:6800/107321 conn(0x7fc96001c940 legacy=0x7fc96001ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:12.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.323+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c0ac960 con 0x7fc97c0a1790 2023-10-18T19:37:12.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.329+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101279 (secure 0 0 0) 0x7fc97801e120 con 0x7fc97c0a1790 2023-10-18T19:37:12.336 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:12.333+0000 7f8d4eb2f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T19:37:12.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.441+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc97c05f270 con 0x7fc97c0a1790 2023-10-18T19:37:12.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.442+0000 7fc9717fa700 1 -- 172.21.15.88:0/2038728575 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9704 (secure 0 0 0) 0x7fc97800a0d0 con 0x7fc97c0a1790 2023-10-18T19:37:12.445 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:12.445 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:34:38.270136+0000","last_up_change":"2023-10-18T19:34:06.488799+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:12.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 >> v1:172.21.15.88:6800/107321 conn(0x7fc96001c940 legacy=0x7fc96001ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:12.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 msgr2=0x7fc97c0ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc97800e930 tx=0x7fc978009060).stop 2023-10-18T19:37:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 shutdown_connections 2023-10-18T19:37:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc97c0af970 0x7fc97c0a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc97c0a1790 0x7fc97c0ab770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 --2- 172.21.15.88:0/2038728575 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc97c0a4c50 0x7fc97c091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 >> 172.21.15.88:0/2038728575 conn(0x7fc97c05eb60 msgr2=0x7fc97c138f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 shutdown_connections 2023-10-18T19:37:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.444+0000 7fc9837ff700 1 -- 172.21.15.88:0/2038728575 wait complete. 2023-10-18T19:37:12.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T19:37:12.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.707+0000 7f2ba97ff700 1 Processor -- start 2023-10-18T19:37:12.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.708+0000 7f2ba97ff700 1 -- start start 2023-10-18T19:37:12.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ba4138d20 0x7f2ba4135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba41391a0 0x7f2ba41361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40a4070 con 0x7f2ba4138d20 2023-10-18T19:37:12.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4136690 con 0x7f2ba41391a0 2023-10-18T19:37:12.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba97ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40a4e00 con 0x7f2ba405e960 2023-10-18T19:37:12.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba27fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ba4138d20 0x7f2ba4135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba2ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba27fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ba4138d20 0x7f2ba4135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55906/0 (socket says 172.21.15.88:55906) 2023-10-18T19:37:12.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba37fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba41391a0 0x7f2ba41361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba27fc700 1 -- 172.21.15.88:0/3852093738 learned_addr learned my addr 172.21.15.88:0/3852093738 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:12.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.709+0000 7f2ba2ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43700/0 (socket says 172.21.15.88:43700) 2023-10-18T19:37:12.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 -- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 msgr2=0x7f2ba40a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:12.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 -- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba41391a0 msgr2=0x7f2ba41361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:12.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba41391a0 0x7f2ba41361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 -- 172.21.15.88:0/3852093738 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba405ed40 con 0x7f2ba4138d20 2023-10-18T19:37:12.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba2ffd700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:12.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba27fc700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba4138d20 0x7f2ba4135cb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2b98006fd0 tx=0x7f2b980090f0).ready entity=mon.0 client_cookie=797f71c95612c59e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba1ffb700 1 -- 172.21.15.88:0/3852093738 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800f510 con 0x7f2ba4138d20 2023-10-18T19:37:12.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba1ffb700 1 -- 172.21.15.88:0/3852093738 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800f670 con 0x7f2ba4138d20 2023-10-18T19:37:12.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.710+0000 7f2ba1ffb700 1 -- 172.21.15.88:0/3852093738 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800f9f0 con 0x7f2ba4138d20 2023-10-18T19:37:12.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba4138d20 msgr2=0x7f2ba4135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba4138d20 0x7f2ba4135cb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2b98006fd0 tx=0x7f2b980090f0).stop 2023-10-18T19:37:12.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3852093738 shutdown_connections 2023-10-18T19:37:12.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba41391a0 0x7f2ba41361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 --2- 172.21.15.88:0/3852093738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba4138d20 0x7f2ba4135cb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3852093738 >> 172.21.15.88:0/3852093738 conn(0x7f2ba4063460 msgr2=0x7f2ba405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3852093738 shutdown_connections 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.711+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3852093738 wait complete. 2023-10-18T19:37:12.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.713+0000 7f2ba97ff700 1 Processor -- start 2023-10-18T19:37:12.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.713+0000 7f2ba97ff700 1 -- start start 2023-10-18T19:37:12.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba4138d20 0x7f2ba40a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba41391a0 0x7f2ba414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40a6270 con 0x7f2ba41391a0 2023-10-18T19:37:12.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba413ae50 con 0x7f2ba4138d20 2023-10-18T19:37:12.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba97ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba413b080 con 0x7f2ba405e960 2023-10-18T19:37:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba2ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba2ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43712/0 (socket says 172.21.15.88:43712) 2023-10-18T19:37:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba27fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba4138d20 0x7f2ba40a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba2ffd700 1 -- 172.21.15.88:0/3779880337 learned_addr learned my addr 172.21.15.88:0/3779880337 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:12.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.714+0000 7f2ba37fe700 1 --2- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba41391a0 0x7f2ba414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 -- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba4138d20 msgr2=0x7f2ba40a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 --2- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ba4138d20 0x7f2ba40a58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 -- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba41391a0 msgr2=0x7f2ba414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 --2- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ba41391a0 0x7f2ba414b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 -- 172.21.15.88:0/3779880337 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009250 con 0x7f2ba405e960 2023-10-18T19:37:12.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba2ffd700 1 --2- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a7b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2b9400ec80 tx=0x7f2b94006f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94005880 con 0x7f2ba405e960 2023-10-18T19:37:12.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940059e0 con 0x7f2ba405e960 2023-10-18T19:37:12.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98009370 con 0x7f2ba405e960 2023-10-18T19:37:12.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94005d60 con 0x7f2ba405e960 2023-10-18T19:37:12.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.715+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40ac2f0 con 0x7f2ba405e960 2023-10-18T19:37:12.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.716+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7f2b9400ca60 con 0x7f2ba405e960 2023-10-18T19:37:12.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.716+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2b9402a0d0 con 0x7f2ba405e960 2023-10-18T19:37:12.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.716+0000 7f2ba27fc700 1 -- 172.21.15.88:0/3779880337 >> v1:172.21.15.88:6800/107321 conn(0x7f2b9001c910 legacy=0x7f2b9001edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:12.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.716+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 --> v1:172.21.15.88:6801/107950 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ba40a56a0 con 0x7f2ba40a5d90 2023-10-18T19:37:12.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.717+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== osd.0 v1:172.21.15.88:6801/107950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f2ba40a56a0 con 0x7f2ba40a5d90 2023-10-18T19:37:12.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.729+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 --> v1:172.21.15.88:6801/107950 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ba405f270 con 0x7f2ba40a5d90 2023-10-18T19:37:12.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2b8affd700 1 -- 172.21.15.88:0/3779880337 <== osd.0 v1:172.21.15.88:6801/107950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7f2ba405f270 con 0x7f2ba40a5d90 2023-10-18T19:37:12.733 INFO:teuthology.orchestra.run.smithi088.stdout:38654705703 2023-10-18T19:37:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 >> v1:172.21.15.88:6801/107950 conn(0x7f2ba40a5d90 legacy=0x7f2ba414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 >> v1:172.21.15.88:6800/107321 conn(0x7f2b9001c910 legacy=0x7f2b9001edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 msgr2=0x7f2ba40a7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 --2- 172.21.15.88:0/3779880337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ba405e960 0x7f2ba40a7b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2b9400ec80 tx=0x7f2b94006f40).stop 2023-10-18T19:37:12.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba37fe700 1 -- 172.21.15.88:0/3779880337 reap_dead start 2023-10-18T19:37:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 shutdown_connections 2023-10-18T19:37:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.730+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 >> 172.21.15.88:0/3779880337 conn(0x7f2ba4063460 msgr2=0x7f2ba40ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.731+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 shutdown_connections 2023-10-18T19:37:12.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.731+0000 7f2ba97ff700 1 -- 172.21.15.88:0/3779880337 wait complete. 2023-10-18T19:37:12.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T19:37:12.821 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:12.818+0000 7f5bb0c28680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T19:37:12.838 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:12.836+0000 7f8d4eb2f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T19:37:12.949 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:12.946+0000 7f5bb0c28680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T19:37:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.950+0000 7f4ceddff700 1 Processor -- start 2023-10-18T19:37:12.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.950+0000 7f4ceddff700 1 -- start start 2023-10-18T19:37:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.951+0000 7f4ceddff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ce80a4ec0 0x7f4ce8138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.951+0000 7f4ceddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 0x7f4ce8143590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.951+0000 7f4ceddff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce80af9c0 con 0x7f4ce80af5e0 2023-10-18T19:37:12.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.951+0000 7f4ceddff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80a4010 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.951+0000 7f4ceddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8139c20 con 0x7f4ce809fdf0 2023-10-18T19:37:12.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ce80a4ec0 0x7f4ce8138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 0x7f4ce8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ce80a4ec0 0x7f4ce8138d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55926/0 (socket says 172.21.15.88:55926) 2023-10-18T19:37:12.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 -- 172.21.15.88:0/3605151891 learned_addr learned my addr 172.21.15.88:0/3605151891 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:12.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 0x7f4ce8143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43714/0 (socket says 172.21.15.88:43714) 2023-10-18T19:37:12.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 -- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 msgr2=0x7f4ce8143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:12.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 --2- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 0x7f4ce8143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 -- 172.21.15.88:0/3605151891 >> v1:172.21.15.88:6789/0 conn(0x7f4ce80af5e0 legacy=0x7f4ce8139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 -- 172.21.15.88:0/3605151891 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce809f700 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.952+0000 7f4ce6ffd700 1 --2- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce80a4ec0 0x7f4ce8138d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4cdc006fd0 tx=0x7f4cdc0090f0).ready entity=mon.0 client_cookie=cff08d7933f135c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ce67fc700 1 -- 172.21.15.88:0/3605151891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00b580 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ce67fc700 1 -- 172.21.15.88:0/3605151891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00b6e0 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ce67fc700 1 -- 172.21.15.88:0/3605151891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00ba60 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 -- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce80a4ec0 msgr2=0x7f4ce8138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 --2- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce80a4ec0 0x7f4ce8138d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4cdc006fd0 tx=0x7f4cdc0090f0).stop 2023-10-18T19:37:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 -- 172.21.15.88:0/3605151891 shutdown_connections 2023-10-18T19:37:12.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 --2- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce809fdf0 0x7f4ce8143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 --2- 172.21.15.88:0/3605151891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce80a4ec0 0x7f4ce8138d00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 -- 172.21.15.88:0/3605151891 >> 172.21.15.88:0/3605151891 conn(0x7f4ce8062a80 msgr2=0x7f4ce8062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 -- 172.21.15.88:0/3605151891 shutdown_connections 2023-10-18T19:37:12.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.953+0000 7f4ceddff700 1 -- 172.21.15.88:0/3605151891 wait complete. 2023-10-18T19:37:12.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.955+0000 7f4ceddff700 1 Processor -- start 2023-10-18T19:37:12.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.956+0000 7f4ceddff700 1 -- start start 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce809fdf0 0x7f4ce8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce80a4ec0 0x7f4ce80aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ce80af5e0 0x7f4ce80aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80aa400 con 0x7f4ce809fdf0 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80a9ff0 con 0x7f4ce80af5e0 2023-10-18T19:37:12.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ceddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80aa6a0 con 0x7f4ce80a4ec0 2023-10-18T19:37:12.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ce6ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce80a4ec0 0x7f4ce80aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ce7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ce80af5e0 0x7f4ce80aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ce77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce809fdf0 0x7f4ce8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:12.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ce6ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce80a4ec0 0x7f4ce80aa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43726/0 (socket says 172.21.15.88:43726) 2023-10-18T19:37:12.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.957+0000 7f4ce6ffd700 1 -- 172.21.15.88:0/1920435240 learned_addr learned my addr 172.21.15.88:0/1920435240 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 -- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce80a4ec0 msgr2=0x7f4ce80aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 --2- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ce80a4ec0 0x7f4ce80aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 -- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce809fdf0 msgr2=0x7f4ce8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 --2- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce809fdf0 0x7f4ce8148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 -- 172.21.15.88:0/1920435240 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc009370 con 0x7f4ce80af5e0 2023-10-18T19:37:12.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce77fe700 1 --2- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ce809fdf0 0x7f4ce8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:12.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ce7fff700 1 --2- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ce80af5e0 0x7f4ce80aae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4ce0009e50 tx=0x7f4ce000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:12.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000caa0 con 0x7f4ce80af5e0 2023-10-18T19:37:12.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce000f040 con 0x7f4ce80af5e0 2023-10-18T19:37:12.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8091c00 con 0x7f4ce80af5e0 2023-10-18T19:37:12.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.958+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000ce10 con 0x7f4ce80af5e0 2023-10-18T19:37:12.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.959+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce809ec10 con 0x7f4ce80af5e0 2023-10-18T19:37:12.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.959+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7f4ce0013610 con 0x7f4ce80af5e0 2023-10-18T19:37:12.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.959+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f4ce002aea0 con 0x7f4ce80af5e0 2023-10-18T19:37:12.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.959+0000 7f4ce77fe700 1 -- 172.21.15.88:0/1920435240 >> v1:172.21.15.88:6800/107321 conn(0x7f4cd401c940 legacy=0x7f4cd401ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:12.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.960+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 --> v1:172.21.15.88:6813/107952 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ce81495f0 con 0x7f4ce80ac3d0 2023-10-18T19:37:12.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.961+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== osd.1 v1:172.21.15.88:6813/107952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f4ce81495f0 con 0x7f4ce80ac3d0 2023-10-18T19:37:12.969 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:12.967+0000 7f8d4eb2f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T19:37:12.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.967+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 --> v1:172.21.15.88:6813/107952 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ce809f9a0 con 0x7f4ce80ac3d0 2023-10-18T19:37:12.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.968+0000 7f4ccf7fe700 1 -- 172.21.15.88:0/1920435240 <== osd.1 v1:172.21.15.88:6813/107952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7f4ce809f9a0 con 0x7f4ce80ac3d0 2023-10-18T19:37:12.971 INFO:teuthology.orchestra.run.smithi088.stdout:38654705703 2023-10-18T19:37:12.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.968+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 >> v1:172.21.15.88:6813/107952 conn(0x7f4ce80ac3d0 legacy=0x7f4ce805e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.968+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 >> v1:172.21.15.88:6800/107321 conn(0x7f4cd401c940 legacy=0x7f4cd401ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:12.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.968+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ce80af5e0 msgr2=0x7f4ce80aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:12.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.968+0000 7f4ceddff700 1 --2- 172.21.15.88:0/1920435240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ce80af5e0 0x7f4ce80aae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4ce0009e50 tx=0x7f4ce000b040).stop 2023-10-18T19:37:12.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.969+0000 7f4ce7fff700 1 -- 172.21.15.88:0/1920435240 reap_dead start 2023-10-18T19:37:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.969+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 shutdown_connections 2023-10-18T19:37:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.969+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 >> 172.21.15.88:0/1920435240 conn(0x7f4ce8062a80 msgr2=0x7f4ce8136100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.969+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 shutdown_connections 2023-10-18T19:37:12.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:12.969+0000 7f4ceddff700 1 -- 172.21.15.88:0/1920435240 wait complete. 2023-10-18T19:37:12.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T19:37:13.039 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:13.036+0000 7f5bb0c28680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T19:37:13.064 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:13.062+0000 7f8d4eb2f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T19:37:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.199+0000 7f663699d700 1 Processor -- start 2023-10-18T19:37:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.199+0000 7f663699d700 1 -- start start 2023-10-18T19:37:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.200+0000 7f663699d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 0x7f66301393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.200+0000 7f663699d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.200+0000 7f663699d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663005ed40 con 0x7f663005e960 2023-10-18T19:37:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.200+0000 7f663699d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66300a1e70 con 0x7f66300a29f0 2023-10-18T19:37:13.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.200+0000 7f663699d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66300a3840 con 0x7f66300a33d0 2023-10-18T19:37:13.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663519a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 0x7f66301393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43730/0 (socket says 172.21.15.88:43730) 2023-10-18T19:37:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 -- 172.21.15.88:0/977328087 learned_addr learned my addr 172.21.15.88:0/977328087 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663599b700 1 --1- 172.21.15.88:0/977328087 >> v1:172.21.15.88:6789/0 conn(0x7f663005e960 0x7f6630137cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47972/0 (socket says 172.21.15.88:47972) 2023-10-18T19:37:13.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 -- 172.21.15.88:0/977328087 >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 msgr2=0x7f66301393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 --2- 172.21.15.88:0/977328087 >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 0x7f66301393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 -- 172.21.15.88:0/977328087 >> v1:172.21.15.88:6789/0 conn(0x7f663005e960 legacy=0x7f6630137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663619c700 1 -- 172.21.15.88:0/977328087 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300a48f0 con 0x7f66300a33d0 2023-10-18T19:37:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.201+0000 7f663519a700 1 --2- 172.21.15.88:0/977328087 >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 0x7f66301393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:13.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f663619c700 1 --2- 172.21.15.88:0/977328087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6628009f20 tx=0x7f6628009840).ready entity=mon.2 client_cookie=ca558fb5c548caff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f6634999700 1 -- 172.21.15.88:0/977328087 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800e070 con 0x7f66300a33d0 2023-10-18T19:37:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f6634999700 1 -- 172.21.15.88:0/977328087 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800ba60 con 0x7f66300a33d0 2023-10-18T19:37:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f6634999700 1 -- 172.21.15.88:0/977328087 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800bde0 con 0x7f66300a33d0 2023-10-18T19:37:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f663699d700 1 -- 172.21.15.88:0/977328087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 msgr2=0x7f66300a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.202+0000 7f663699d700 1 --2- 172.21.15.88:0/977328087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6628009f20 tx=0x7f6628009840).stop 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 -- 172.21.15.88:0/977328087 shutdown_connections 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 --2- 172.21.15.88:0/977328087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f66300a33d0 0x7f66300a1980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 --2- 172.21.15.88:0/977328087 >> v2:172.21.15.88:3300/0 conn(0x7f66300a29f0 0x7f66301393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 -- 172.21.15.88:0/977328087 >> 172.21.15.88:0/977328087 conn(0x7f6630064ad0 msgr2=0x7f663005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 -- 172.21.15.88:0/977328087 shutdown_connections 2023-10-18T19:37:13.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.203+0000 7f663699d700 1 -- 172.21.15.88:0/977328087 wait complete. 2023-10-18T19:37:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.205+0000 7f663699d700 1 Processor -- start 2023-10-18T19:37:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.205+0000 7f663699d700 1 -- start start 2023-10-18T19:37:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 0x7f663013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66300a29f0 0x7f66300a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66300a33d0 0x7f6630148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66301488f0 con 0x7f66300a29f0 2023-10-18T19:37:13.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6630148b80 con 0x7f66300a33d0 2023-10-18T19:37:13.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663699d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f663013c420 con 0x7f663005e960 2023-10-18T19:37:13.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663599b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 0x7f663013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663599b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 0x7f663013bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43740/0 (socket says 172.21.15.88:43740) 2023-10-18T19:37:13.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663599b700 1 -- 172.21.15.88:0/628083116 learned_addr learned my addr 172.21.15.88:0/628083116 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:13.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663619c700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66300a33d0 0x7f6630148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.206+0000 7f663519a700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66300a29f0 0x7f66300a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 -- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 msgr2=0x7f663013bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 0x7f663013bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 -- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66300a29f0 msgr2=0x7f66300a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66300a29f0 0x7f66300a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 -- 172.21.15.88:0/628083116 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200092a0 con 0x7f66300a33d0 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663599b700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f663005e960 0x7f663013bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663619c700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66300a33d0 0x7f6630148e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6628013000 tx=0x7f66300a44e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628013e20 con 0x7f66300a33d0 2023-10-18T19:37:13.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662801e480 con 0x7f66300a33d0 2023-10-18T19:37:13.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628009ae0 con 0x7f66300a33d0 2023-10-18T19:37:13.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662801e800 con 0x7f66300a33d0 2023-10-18T19:37:13.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.207+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66300a7fa0 con 0x7f66300a33d0 2023-10-18T19:37:13.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.208+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7f662801ebb0 con 0x7f66300a33d0 2023-10-18T19:37:13.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.208+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6628008d60 con 0x7f66300a33d0 2023-10-18T19:37:13.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.208+0000 7f663599b700 1 -- 172.21.15.88:0/628083116 >> v1:172.21.15.88:6800/107321 conn(0x7f661401c910 legacy=0x7f661401edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:13.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.209+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 --> v1:172.21.15.88:6809/107953 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66300a3c40 con 0x7f66300aa9d0 2023-10-18T19:37:13.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.210+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== osd.2 v1:172.21.15.88:6809/107953 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f66300a3c40 con 0x7f66300aa9d0 2023-10-18T19:37:13.218 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:13.212+0000 7f5bb0c28680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T19:37:13.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.216+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 --> v1:172.21.15.88:6809/107953 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f663005e3e0 con 0x7f66300aa9d0 2023-10-18T19:37:13.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.216+0000 7f6625ffb700 1 -- 172.21.15.88:0/628083116 <== osd.2 v1:172.21.15.88:6809/107953 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7f663005e3e0 con 0x7f66300aa9d0 2023-10-18T19:37:13.219 INFO:teuthology.orchestra.run.smithi088.stdout:38654705703 2023-10-18T19:37:13.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.216+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 >> v1:172.21.15.88:6809/107953 conn(0x7f66300aa9d0 legacy=0x7f6630149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 >> v1:172.21.15.88:6800/107321 conn(0x7f661401c910 legacy=0x7f661401edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:13.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66300a33d0 msgr2=0x7f6630148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 --2- 172.21.15.88:0/628083116 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66300a33d0 0x7f6630148e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f6628013000 tx=0x7f66300a44e0).stop 2023-10-18T19:37:13.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663619c700 1 -- 172.21.15.88:0/628083116 reap_dead start 2023-10-18T19:37:13.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 shutdown_connections 2023-10-18T19:37:13.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 >> 172.21.15.88:0/628083116 conn(0x7f6630064ad0 msgr2=0x7f66300af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 shutdown_connections 2023-10-18T19:37:13.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.217+0000 7f663699d700 1 -- 172.21.15.88:0/628083116 wait complete. 2023-10-18T19:37:13.232 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:13.230+0000 7f8d4eb2f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T19:37:13.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T19:37:13.308 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:13.306+0000 7f5bb0c28680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T19:37:13.318 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:13.316+0000 7f8d4eb2f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T19:37:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.476+0000 7f9e9ffff700 1 Processor -- start 2023-10-18T19:37:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.476+0000 7f9e9ffff700 1 -- start start 2023-10-18T19:37:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 0x7f9ea01433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea00a0d10 con 0x7f9ea00af010 2023-10-18T19:37:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9ffff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00a47b0 con 0x7f9ea0140fc0 2023-10-18T19:37:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00af3f0 con 0x7f9ea00a14b0 2023-10-18T19:37:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 0x7f9ea01433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ea00af010 0x7f9ea013c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47974/0 (socket says 172.21.15.88:47974) 2023-10-18T19:37:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.477+0000 7f9e9effd700 1 -- 172.21.15.88:0/336885473 learned_addr learned my addr 172.21.15.88:0/336885473 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9e7fc700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9dffb700 1 -- 172.21.15.88:0/336885473 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027661252 0 0) 0x7f9e90001110 con 0x7f9ea00af010 2023-10-18T19:37:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9f7fe700 1 -- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 msgr2=0x7f9ea00a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:13.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9f7fe700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9f7fe700 1 -- 172.21.15.88:0/336885473 >> v1:172.21.15.88:6789/0 conn(0x7f9ea00af010 legacy=0x7f9ea013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9f7fe700 1 -- 172.21.15.88:0/336885473 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00a49a0 con 0x7f9ea0140fc0 2023-10-18T19:37:13.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.478+0000 7f9e9f7fe700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 0x7f9ea01433b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9e98009e90 tx=0x7f9e98009780).ready entity=mon.1 client_cookie=2b0ecd93057a54f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9dffb700 1 -- 172.21.15.88:0/336885473 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800e070 con 0x7f9ea0140fc0 2023-10-18T19:37:13.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9dffb700 1 -- 172.21.15.88:0/336885473 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800bb60 con 0x7f9ea0140fc0 2023-10-18T19:37:13.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9dffb700 1 -- 172.21.15.88:0/336885473 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98012410 con 0x7f9ea0140fc0 2023-10-18T19:37:13.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9ffff700 1 -- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 msgr2=0x7f9ea01433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9ffff700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 0x7f9ea01433b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9e98009e90 tx=0x7f9e98009780).stop 2023-10-18T19:37:13.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9ffff700 1 -- 172.21.15.88:0/336885473 shutdown_connections 2023-10-18T19:37:13.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.479+0000 7f9e9ffff700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea0140fc0 0x7f9ea01433b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.480+0000 7f9e9ffff700 1 --2- 172.21.15.88:0/336885473 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.480+0000 7f9e9ffff700 1 -- 172.21.15.88:0/336885473 >> 172.21.15.88:0/336885473 conn(0x7f9ea0062910 msgr2=0x7f9ea0062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.480+0000 7f9e9ffff700 1 -- 172.21.15.88:0/336885473 shutdown_connections 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.480+0000 7f9e9ffff700 1 -- 172.21.15.88:0/336885473 wait complete. 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.481+0000 7f9e9ffff700 1 Processor -- start 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.481+0000 7f9e9ffff700 1 -- start start 2023-10-18T19:37:13.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 0x7f9ea00ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ea0140fc0 0x7f9ea00a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00a7400 con 0x7f9ea0140fc0 2023-10-18T19:37:13.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00aaa10 con 0x7f9ea00af010 2023-10-18T19:37:13.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9ffff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00aacd0 con 0x7f9ea00a14b0 2023-10-18T19:37:13.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ea0140fc0 0x7f9ea00a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 0x7f9ea00ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 0x7f9ea00ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42806/0 (socket says 172.21.15.88:42806) 2023-10-18T19:37:13.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.482+0000 7f9e9e7fc700 1 -- 172.21.15.88:0/237652862 learned_addr learned my addr 172.21.15.88:0/237652862 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:13.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 -- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 msgr2=0x7f9ea00a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 --2- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ea00a14b0 0x7f9ea00a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 -- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ea0140fc0 msgr2=0x7f9ea00a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 --2- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ea0140fc0 0x7f9ea00a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 -- 172.21.15.88:0/237652862 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009a20 con 0x7f9ea00af010 2023-10-18T19:37:13.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9e7fc700 1 --2- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 0x7f9ea00ab1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9e9400e930 tx=0x7f9e94009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94012600 con 0x7f9ea00af010 2023-10-18T19:37:13.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94012760 con 0x7f9ea00af010 2023-10-18T19:37:13.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea00a8460 con 0x7f9ea00af010 2023-10-18T19:37:13.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94012ae0 con 0x7f9ea00af010 2023-10-18T19:37:13.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.483+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea00a8a60 con 0x7f9ea00af010 2023-10-18T19:37:13.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.484+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ea00a8ce0 con 0x7f9ea00af010 2023-10-18T19:37:13.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.485+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7f9e9401b400 con 0x7f9ea00af010 2023-10-18T19:37:13.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.485+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9e9402ae00 con 0x7f9ea00af010 2023-10-18T19:37:13.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.485+0000 7f9e9effd700 1 -- 172.21.15.88:0/237652862 >> v1:172.21.15.88:6800/107321 conn(0x7f9e8c01c910 legacy=0x7f9e8c01edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:13.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.485+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 --> v1:172.21.15.88:6805/107951 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e8c0296d0 con 0x7f9e8c025a00 2023-10-18T19:37:13.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.485+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e94001d80 con 0x7f9ea00af010 2023-10-18T19:37:13.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.486+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== osd.3 v1:172.21.15.88:6805/107951 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f9e8c0296d0 con 0x7f9e8c025a00 2023-10-18T19:37:13.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.498+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 --> v1:172.21.15.88:6805/107951 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ea005f200 con 0x7f9e8c025a00 2023-10-18T19:37:13.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.498+0000 7f9e86ffd700 1 -- 172.21.15.88:0/237652862 <== osd.3 v1:172.21.15.88:6805/107951 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 282190808) 0x7f9ea005f200 con 0x7f9e8c025a00 2023-10-18T19:37:13.501 INFO:teuthology.orchestra.run.smithi088.stdout:38654705703 2023-10-18T19:37:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 >> v1:172.21.15.88:6805/107951 conn(0x7f9e8c025a00 legacy=0x7f9e8c027e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 >> v1:172.21.15.88:6800/107321 conn(0x7f9e8c01c910 legacy=0x7f9e8c01edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 msgr2=0x7f9ea00ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 --2- 172.21.15.88:0/237652862 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ea00af010 0x7f9ea00ab1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9e9400e930 tx=0x7f9e94009060).stop 2023-10-18T19:37:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9f7fe700 1 -- 172.21.15.88:0/237652862 reap_dead start 2023-10-18T19:37:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 shutdown_connections 2023-10-18T19:37:13.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 >> 172.21.15.88:0/237652862 conn(0x7f9ea0062910 msgr2=0x7f9ea00ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 shutdown_connections 2023-10-18T19:37:13.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.499+0000 7f9e9ffff700 1 -- 172.21.15.88:0/237652862 wait complete. 2023-10-18T19:37:13.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:37:13.740 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:13.738+0000 7f5bb0c28680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T19:37:13.744 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:13.742+0000 7f8d4eb2f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T19:37:13.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.767+0000 7f36b4bff700 1 Processor -- start 2023-10-18T19:37:13.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.767+0000 7f36b4bff700 1 -- start start 2023-10-18T19:37:13.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36b4bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36b00af5e0 0x7f36b0138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36b4bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00a4ec0 0x7f36b0139510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36b4bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b00af9c0 con 0x7f36b0139a00 2023-10-18T19:37:13.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36b4bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00a4010 con 0x7f36b00af5e0 2023-10-18T19:37:13.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36b4bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00a0500 con 0x7f36b00a4ec0 2023-10-18T19:37:13.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36ae59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36b00af5e0 0x7f36b0138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36aed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f36b0139a00 0x7f36b009fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47986/0 (socket says 172.21.15.88:47986) 2023-10-18T19:37:13.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36aed9d700 1 -- 172.21.15.88:0/41003851 learned_addr learned my addr 172.21.15.88:0/41003851 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:13.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.769+0000 7f36add9b700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00a4ec0 0x7f36b0139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ae59c700 1 -- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00a4ec0 msgr2=0x7f36b0139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:13.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ae59c700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00a4ec0 0x7f36b0139510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ae59c700 1 -- 172.21.15.88:0/41003851 >> v1:172.21.15.88:6789/0 conn(0x7f36b0139a00 legacy=0x7f36b009fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ae59c700 1 -- 172.21.15.88:0/41003851 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b009f700 con 0x7f36b00af5e0 2023-10-18T19:37:13.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ad59a700 1 -- 172.21.15.88:0/41003851 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034087869 0 0) 0x7f36b00af9c0 con 0x7f36b0139a00 2023-10-18T19:37:13.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ae59c700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b00af5e0 0x7f36b0138d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f36a0009760 tx=0x7f36a0009060).ready entity=mon.0 client_cookie=57e73a643bb9af51 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ad59a700 1 -- 172.21.15.88:0/41003851 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000f510 con 0x7f36b00af5e0 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ad59a700 1 -- 172.21.15.88:0/41003851 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000f670 con 0x7f36b00af5e0 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.770+0000 7f36ad59a700 1 -- 172.21.15.88:0/41003851 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000f9f0 con 0x7f36b00af5e0 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 -- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b00af5e0 msgr2=0x7f36b0138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b00af5e0 0x7f36b0138d00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f36a0009760 tx=0x7f36a0009060).stop 2023-10-18T19:37:13.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 -- 172.21.15.88:0/41003851 shutdown_connections 2023-10-18T19:37:13.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b00af5e0 0x7f36b0138d00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 --2- 172.21.15.88:0/41003851 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00a4ec0 0x7f36b0139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 -- 172.21.15.88:0/41003851 >> 172.21.15.88:0/41003851 conn(0x7f36b0062a80 msgr2=0x7f36b0062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 -- 172.21.15.88:0/41003851 shutdown_connections 2023-10-18T19:37:13.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.771+0000 7f36b4bff700 1 -- 172.21.15.88:0/41003851 wait complete. 2023-10-18T19:37:13.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.772+0000 7f36b4bff700 1 Processor -- start 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 -- start start 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 0x7f36b013be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 0x7f36b009e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b013d0a0 con 0x7f36b013b6f0 2023-10-18T19:37:13.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0132db0 con 0x7f36b00af5e0 2023-10-18T19:37:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.773+0000 7f36b4bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b013e000 con 0x7f36b00a4ec0 2023-10-18T19:37:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36aed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 0x7f36b009e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42820/0 (socket says 172.21.15.88:42820) 2023-10-18T19:37:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 -- 172.21.15.88:0/3247983559 learned_addr learned my addr 172.21.15.88:0/3247983559 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36ae59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 0x7f36b013be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 -- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 msgr2=0x7f36b013be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 0x7f36b013be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 -- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 msgr2=0x7f36b009e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 0x7f36b009e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 -- 172.21.15.88:0/3247983559 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00092a0 con 0x7f36b00af5e0 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36aed9d700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 0x7f36b009e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36ae59c700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 0x7f36b013be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.774+0000 7f36add9b700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f36a400e8b0 tx=0x7f36a4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.775+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4012600 con 0x7f36b00af5e0 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.775+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4012760 con 0x7f36b00af5e0 2023-10-18T19:37:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.775+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b013e1b0 con 0x7f36b00af5e0 2023-10-18T19:37:13.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.775+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4012b00 con 0x7f36b00af5e0 2023-10-18T19:37:13.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.775+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b013c810 con 0x7f36b00af5e0 2023-10-18T19:37:13.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.776+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7f36a400c3e0 con 0x7f36b00af5e0 2023-10-18T19:37:13.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.776+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f36a402a0d0 con 0x7f36b00af5e0 2023-10-18T19:37:13.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.776+0000 7f36ae59c700 1 -- 172.21.15.88:0/3247983559 >> v1:172.21.15.88:6800/107321 conn(0x7f369001c910 legacy=0x7f369001edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:13.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.776+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b013c810 con 0x7f36b00af5e0 2023-10-18T19:37:13.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.779+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101279 (secure 0 0 0) 0x7f36b013c810 con 0x7f36b00af5e0 2023-10-18T19:37:13.855 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:13.852+0000 7f5bb0c28680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T19:37:13.856 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:13.853+0000 7f8d4eb2f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T19:37:13.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.886+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36b013c810 con 0x7f36b00af5e0 2023-10-18T19:37:13.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.887+0000 7f369e7fc700 1 -- 172.21.15.88:0/3247983559 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36b013c810 con 0x7f36b00af5e0 2023-10-18T19:37:13.891 INFO:teuthology.orchestra.run.smithi088.stdout:38654705702 2023-10-18T19:37:13.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 >> v1:172.21.15.88:6800/107321 conn(0x7f369001c910 legacy=0x7f369001edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 msgr2=0x7f36b013cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f36a400e8b0 tx=0x7f36a4009060).stop 2023-10-18T19:37:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 shutdown_connections 2023-10-18T19:37:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36b013b6f0 0x7f36b009e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f36b00a4ec0 0x7f36b013be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 --2- 172.21.15.88:0/3247983559 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36b00af5e0 0x7f36b013cbb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 >> 172.21.15.88:0/3247983559 conn(0x7f36b0062a80 msgr2=0x7f36b0142e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 shutdown_connections 2023-10-18T19:37:13.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:13.888+0000 7f36b4bff700 1 -- 172.21.15.88:0/3247983559 wait complete. 2023-10-18T19:37:13.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2023-10-18T19:37:14.251 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:14.249+0000 7f8d4eb2f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T19:37:14.252 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:14.250+0000 7f5bb0c28680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T19:37:14.350 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:14.347+0000 7f8d4eb2f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T19:37:14.350 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:14.348+0000 7f5bb0c28680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T19:37:14.536 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:14.533+0000 7f8d4eb2f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T19:37:14.537 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:14.534+0000 7f5bb0c28680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T19:37:14.625 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:14.623+0000 7f8d4eb2f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T19:37:14.626 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:14.623+0000 7f5bb0c28680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T19:37:14.910 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:37:14.917 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:14.911+0000 7f8d4eb2f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T19:37:14.917 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:14.910+0000 7f5bb0c28680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T19:37:15.049 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.046+0000 7f5bb0c28680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T19:37:15.053 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:15.051+0000 7f8d4eb2f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T19:37:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.109+0000 7ff702dff700 1 Processor -- start 2023-10-18T19:37:15.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.109+0000 7ff702dff700 1 -- start start 2023-10-18T19:37:15.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff702dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6fc062ea0 0x7ff6fc09dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:15.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff702dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:15.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff702dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc063280 con 0x7ff6fc0636e0 2023-10-18T19:37:15.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff702dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc069170 con 0x7ff6fc062ea0 2023-10-18T19:37:15.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff702dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0653a0 con 0x7ff6fc0641d0 2023-10-18T19:37:15.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff70139c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:15.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff700b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6fc062ea0 0x7ff6fc09dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:15.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff70139c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43772/0 (socket says 172.21.15.88:43772) 2023-10-18T19:37:15.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.110+0000 7ff70139c700 1 -- 172.21.15.88:0/1930348301 learned_addr learned my addr 172.21.15.88:0/1930348301 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:15.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff700b9b700 1 -- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 msgr2=0x7ff6fc143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:15.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff700b9b700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff700b9b700 1 -- 172.21.15.88:0/1930348301 >> v1:172.21.15.88:6789/0 conn(0x7ff6fc0636e0 legacy=0x7ff6fc063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff700b9b700 1 -- 172.21.15.88:0/1930348301 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0aa5f0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff6fb7fe700 1 -- 172.21.15.88:0/1930348301 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066599982 0 0) 0x7ff6fc063280 con 0x7ff6fc0636e0 2023-10-18T19:37:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff70139c700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:15.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff700b9b700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc09dde0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff6f0009760 tx=0x7ff6f0009060).ready entity=mon.0 client_cookie=a3d92cf47ecad16f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:15.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff6fb7fe700 1 -- 172.21.15.88:0/1930348301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000f510 con 0x7ff6fc062ea0 2023-10-18T19:37:15.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff6fb7fe700 1 -- 172.21.15.88:0/1930348301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000f670 con 0x7ff6fc062ea0 2023-10-18T19:37:15.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.111+0000 7ff6fb7fe700 1 -- 172.21.15.88:0/1930348301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000f9f0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 -- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 msgr2=0x7ff6fc09dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:15.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc09dde0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff6f0009760 tx=0x7ff6f0009060).stop 2023-10-18T19:37:15.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 -- 172.21.15.88:0/1930348301 shutdown_connections 2023-10-18T19:37:15.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 --2- 172.21.15.88:0/1930348301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc09dde0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 -- 172.21.15.88:0/1930348301 >> 172.21.15.88:0/1930348301 conn(0x7ff6fc067ed0 msgr2=0x7ff6fc0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 -- 172.21.15.88:0/1930348301 shutdown_connections 2023-10-18T19:37:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.112+0000 7ff702dff700 1 -- 172.21.15.88:0/1930348301 wait complete. 2023-10-18T19:37:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.114+0000 7ff702dff700 1 Processor -- start 2023-10-18T19:37:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.114+0000 7ff702dff700 1 -- start start 2023-10-18T19:37:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.114+0000 7ff702dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.114+0000 7ff702dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 0x7ff6fc094da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff702dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff702dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc096750 con 0x7ff6fc062ea0 2023-10-18T19:37:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff702dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc095770 con 0x7ff6fc0636e0 2023-10-18T19:37:15.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff702dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0941e0 con 0x7ff6fc0641d0 2023-10-18T19:37:15.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff700b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:15.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff700b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55998/0 (socket says 172.21.15.88:55998) 2023-10-18T19:37:15.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff700b9b700 1 -- 172.21.15.88:0/3664906087 learned_addr learned my addr 172.21.15.88:0/3664906087 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:15.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff6fbfff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 0x7ff6fc094da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:15.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff70139c700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff700b9b700 1 -- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 msgr2=0x7ff6fc14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.115+0000 7ff700b9b700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff700b9b700 1 -- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 msgr2=0x7ff6fc094da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff700b9b700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 0x7ff6fc094da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff700b9b700 1 -- 172.21.15.88:0/3664906087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009ae0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff6fbfff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 0x7ff6fc094da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:15.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff70139c700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:37:15.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff700b9b700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff6f0009e00 tx=0x7ff6f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:15.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000f7e0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000f940 con 0x7ff6fc062ea0 2023-10-18T19:37:15.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f00092a0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f001b660 con 0x7ff6fc062ea0 2023-10-18T19:37:15.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.116+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc093d70 con 0x7ff6fc062ea0 2023-10-18T19:37:15.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.117+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 22931+0+0 (secure 0 0 0) 0x7ff6f001b9d0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.117+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ff6f001cda0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.117+0000 7ff6fbfff700 1 -- 172.21.15.88:0/3664906087 >> v1:172.21.15.88:6800/107321 conn(0x7ff6e001c8e0 legacy=0x7ff6e001eda0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.88:6800/107321 2023-10-18T19:37:15.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.117+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc05f270 con 0x7ff6fc062ea0 2023-10-18T19:37:15.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.121+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101279 (secure 0 0 0) 0x7ff6f0028a20 con 0x7ff6fc062ea0 2023-10-18T19:37:15.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.228+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff6fc063ea0 con 0x7ff6fc062ea0 2023-10-18T19:37:15.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.228+0000 7ff6f8ff9700 1 -- 172.21.15.88:0/3664906087 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6f001f020 con 0x7ff6fc062ea0 2023-10-18T19:37:15.231 INFO:teuthology.orchestra.run.smithi088.stdout:38654705702 2023-10-18T19:37:15.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 >> v1:172.21.15.88:6800/107321 conn(0x7ff6e001c8e0 legacy=0x7ff6e001eda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-18T19:37:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 msgr2=0x7ff6fc095df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff6f0009e00 tx=0x7ff6f0017000).stop 2023-10-18T19:37:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 shutdown_connections 2023-10-18T19:37:15.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff6fc0641d0 0x7ff6fc14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6fc062ea0 0x7ff6fc095df0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 --2- 172.21.15.88:0/3664906087 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff6fc0636e0 0x7ff6fc094da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 >> 172.21.15.88:0/3664906087 conn(0x7ff6fc067ed0 msgr2=0x7ff6fc09e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 shutdown_connections 2023-10-18T19:37:15.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:15.230+0000 7ff702dff700 1 -- 172.21.15.88:0/3664906087 wait complete. 2023-10-18T19:37:15.241 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.238+0000 7f5bb0c28680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T19:37:15.242 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:15.238+0000 7f8d4eb2f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T19:37:15.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2023-10-18T19:37:15.334 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-18T19:37:15.331+0000 7f8d4eb2f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T19:37:15.335 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.332+0000 7f5bb0c28680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T19:37:15.400 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b6e74d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.400 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b6e74d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.400 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b6e74d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.400 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b6e74d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.401 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b6e74d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.401 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b71753700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.401 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b71753700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.401 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b71753700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.401 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b71753700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:15.402 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:15.397+0000 7f5b71753700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-18T19:37:16.252 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:37:16.360 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:16.358+0000 7f5b86f7e700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-18T19:37:16.361 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:16.359+0000 7f5b86f7e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-18T19:37:16.362 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-10-18T19:37:16.360+0000 7f5b86f7e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-18T19:37:16.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.454+0000 7f64101ff700 1 Processor -- start 2023-10-18T19:37:16.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.454+0000 7f64101ff700 1 -- start start 2023-10-18T19:37:16.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.455+0000 7f64101ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 0x7f64080a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.455+0000 7f64101ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.455+0000 7f64101ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64080a4e00 con 0x7f64081391a0 2023-10-18T19:37:16.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.455+0000 7f64101ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64080a4070 con 0x7f640805e960 2023-10-18T19:37:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.455+0000 7f64101ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640805ed40 con 0x7f6408138d20 2023-10-18T19:37:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640df9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 0x7f64080a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:16.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56132/0 (socket says 172.21.15.88:56132) 2023-10-18T19:37:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640e79c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f64081391a0 0x7f640813c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35128/0 (socket says 172.21.15.88:35128) 2023-10-18T19:37:16.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 -- 172.21.15.88:0/2903970018 learned_addr learned my addr 172.21.15.88:0/2903970018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 -- 172.21.15.88:0/2903970018 >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 msgr2=0x7f64080a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 --2- 172.21.15.88:0/2903970018 >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 0x7f64080a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 -- 172.21.15.88:0/2903970018 >> v1:172.21.15.88:6789/0 conn(0x7f64081391a0 legacy=0x7f640813c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 -- 172.21.15.88:0/2903970018 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080a4bf0 con 0x7f6408138d20 2023-10-18T19:37:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640cf99700 1 -- 172.21.15.88:0/2903970018 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70247686 0 0) 0x7f64080a4e00 con 0x7f64081391a0 2023-10-18T19:37:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640df9b700 1 --2- 172.21.15.88:0/2903970018 >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 0x7f64080a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640d79a700 1 --2- 172.21.15.88:0/2903970018 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f63f8006fd0 tx=0x7f63f80090f0).ready entity=mon.2 client_cookie=a9d680c1dbe8402 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640cf99700 1 -- 172.21.15.88:0/2903970018 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800b580 con 0x7f6408138d20 2023-10-18T19:37:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640cf99700 1 -- 172.21.15.88:0/2903970018 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800b6e0 con 0x7f6408138d20 2023-10-18T19:37:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.456+0000 7f640cf99700 1 -- 172.21.15.88:0/2903970018 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800ba60 con 0x7f6408138d20 2023-10-18T19:37:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 -- 172.21.15.88:0/2903970018 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 msgr2=0x7f6408135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 --2- 172.21.15.88:0/2903970018 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f63f8006fd0 tx=0x7f63f80090f0).stop 2023-10-18T19:37:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 -- 172.21.15.88:0/2903970018 shutdown_connections 2023-10-18T19:37:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 --2- 172.21.15.88:0/2903970018 >> v2:172.21.15.88:3300/0 conn(0x7f640805e960 0x7f64080a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 --2- 172.21.15.88:0/2903970018 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f6408135cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 -- 172.21.15.88:0/2903970018 >> 172.21.15.88:0/2903970018 conn(0x7f6408063460 msgr2=0x7f640805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 -- 172.21.15.88:0/2903970018 shutdown_connections 2023-10-18T19:37:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.457+0000 7f64101ff700 1 -- 172.21.15.88:0/2903970018 wait complete. 2023-10-18T19:37:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 Processor -- start 2023-10-18T19:37:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 -- start start 2023-10-18T19:37:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f64080a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64081391a0 0x7f640814b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64080a75f0 con 0x7f64081391a0 2023-10-18T19:37:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.459+0000 7f64101ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64080a87b0 con 0x7f640805e960 2023-10-18T19:37:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f64101ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64080a89b0 con 0x7f6408138d20 2023-10-18T19:37:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38822/0 (socket says 172.21.15.88:38822) 2023-10-18T19:37:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 -- 172.21.15.88:0/2208348868 learned_addr learned my addr 172.21.15.88:0/2208348868 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640d79a700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f64080a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640e79c700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64081391a0 0x7f640814b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 -- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 msgr2=0x7f64080a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f64080a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 -- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64081391a0 msgr2=0x7f640814b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64081391a0 0x7f640814b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 -- 172.21.15.88:0/2208348868 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009250 con 0x7f640805e960 2023-10-18T19:37:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640d79a700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f64080a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.460+0000 7f640df9b700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f640400ec80 tx=0x7f6404006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.461+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404005880 con 0x7f640805e960 2023-10-18T19:37:16.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.461+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64040059e0 con 0x7f640805e960 2023-10-18T19:37:16.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.461+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f8009370 con 0x7f640805e960 2023-10-18T19:37:16.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.461+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404005d60 con 0x7f640805e960 2023-10-18T19:37:16.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.461+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64080ac610 con 0x7f640805e960 2023-10-18T19:37:16.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.462+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 6) v1 ==== 48378+0+0 (secure 0 0 0) 0x7f640400ca60 con 0x7f640805e960 2023-10-18T19:37:16.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.462+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640805f270 con 0x7f640805e960 2023-10-18T19:37:16.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.462+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3678+0+0 (secure 0 0 0) 0x7f64040554f0 con 0x7f640805e960 2023-10-18T19:37:16.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.467+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6404035cc0 con 0x7f640805e960 2023-10-18T19:37:16.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.612+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f64081396f0 con 0x7f640805e960 2023-10-18T19:37:16.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.613+0000 7f63fdffb700 1 -- 172.21.15.88:0/2208348868 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6404016030 con 0x7f640805e960 2023-10-18T19:37:16.616 INFO:teuthology.orchestra.run.smithi088.stdout:38654705702 2023-10-18T19:37:16.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.614+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 >> v1:172.21.15.88:6800/113625 conn(0x7f63ec041a10 legacy=0x7f63ec043ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 msgr2=0x7f64080a7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:16.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f640400ec80 tx=0x7f6404006f40).stop 2023-10-18T19:37:16.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 shutdown_connections 2023-10-18T19:37:16.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64081391a0 0x7f640814b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f640805e960 0x7f64080a7d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 --2- 172.21.15.88:0/2208348868 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6408138d20 0x7f64080a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:16.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 >> 172.21.15.88:0/2208348868 conn(0x7f6408063460 msgr2=0x7f64080a31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:16.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 shutdown_connections 2023-10-18T19:37:16.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:16.615+0000 7f64101ff700 1 -- 172.21.15.88:0/2208348868 wait complete. 2023-10-18T19:37:16.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.0 2023-10-18T19:37:17.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:37:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.835+0000 7fa494dff700 1 Processor -- start 2023-10-18T19:37:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.835+0000 7fa494dff700 1 -- start start 2023-10-18T19:37:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa494dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa494dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4900a4ec0 0x7fa490139510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa494dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4900af9c0 con 0x7fa490139a00 2023-10-18T19:37:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa494dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900a4010 con 0x7fa4900a4ec0 2023-10-18T19:37:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa494dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900a0500 con 0x7fa4900af5e0 2023-10-18T19:37:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.836+0000 7fa48e59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4900a4ec0 0x7fa490139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56180/0 (socket says 172.21.15.88:56180) 2023-10-18T19:37:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 -- 172.21.15.88:0/1237337943 learned_addr learned my addr 172.21.15.88:0/1237337943 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 -- 172.21.15.88:0/1237337943 >> v2:172.21.15.88:3300/0 conn(0x7fa4900a4ec0 msgr2=0x7fa490139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 --2- 172.21.15.88:0/1237337943 >> v2:172.21.15.88:3300/0 conn(0x7fa4900a4ec0 0x7fa490139510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 -- 172.21.15.88:0/1237337943 >> v1:172.21.15.88:6789/0 conn(0x7fa490139a00 legacy=0x7fa49009fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:17.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 -- 172.21.15.88:0/1237337943 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49009f700 con 0x7fa4900af5e0 2023-10-18T19:37:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48d59a700 1 -- 172.21.15.88:0/1237337943 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320821917 0 0) 0x7fa4900af9c0 con 0x7fa490139a00 2023-10-18T19:37:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48e59c700 1 --2- 172.21.15.88:0/1237337943 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa480006fd0 tx=0x7fa4800090f0).ready entity=mon.2 client_cookie=2fdc43238c0912c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.837+0000 7fa48d59a700 1 -- 172.21.15.88:0/1237337943 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000b580 con 0x7fa4900af5e0 2023-10-18T19:37:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa48d59a700 1 -- 172.21.15.88:0/1237337943 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b6e0 con 0x7fa4900af5e0 2023-10-18T19:37:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa48d59a700 1 -- 172.21.15.88:0/1237337943 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000ba60 con 0x7fa4900af5e0 2023-10-18T19:37:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 -- 172.21.15.88:0/1237337943 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 msgr2=0x7fa490138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 --2- 172.21.15.88:0/1237337943 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa480006fd0 tx=0x7fa4800090f0).stop 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 -- 172.21.15.88:0/1237337943 shutdown_connections 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 --2- 172.21.15.88:0/1237337943 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900af5e0 0x7fa490138d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 --2- 172.21.15.88:0/1237337943 >> v2:172.21.15.88:3300/0 conn(0x7fa4900a4ec0 0x7fa490139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 -- 172.21.15.88:0/1237337943 >> 172.21.15.88:0/1237337943 conn(0x7fa490062a80 msgr2=0x7fa490062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 -- 172.21.15.88:0/1237337943 shutdown_connections 2023-10-18T19:37:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.838+0000 7fa494dff700 1 -- 172.21.15.88:0/1237337943 wait complete. 2023-10-18T19:37:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.840+0000 7fa494dff700 1 Processor -- start 2023-10-18T19:37:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.840+0000 7fa494dff700 1 -- start start 2023-10-18T19:37:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 0x7fa49014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49013ca20 con 0x7fa49013b730 2023-10-18T19:37:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49013dba0 con 0x7fa4900af5e0 2023-10-18T19:37:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa494dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa49013e3c0 con 0x7fa4900a4ec0 2023-10-18T19:37:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48dd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56196/0 (socket says 172.21.15.88:56196) 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48dd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38854/0 (socket says 172.21.15.88:38854) 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 -- 172.21.15.88:0/3234497239 learned_addr learned my addr 172.21.15.88:0/3234497239 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48ed9d700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 0x7fa49014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 -- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 msgr2=0x7fa49013c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 -- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 msgr2=0x7fa49014bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 0x7fa49014bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48e59c700 1 -- 172.21.15.88:0/3234497239 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480009370 con 0x7fa4900a4ec0 2023-10-18T19:37:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48dd9b700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.841+0000 7fa48ed9d700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 0x7fa49014bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa48e59c700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa480009fd0 tx=0x7fa480017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480000bc0 con 0x7fa4900a4ec0 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b850 con 0x7fa4900a4ec0 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49013c760 con 0x7fa4900a4ec0 2023-10-18T19:37:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480000d20 con 0x7fa4900a4ec0 2023-10-18T19:37:17.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.842+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa490136370 con 0x7fa4900a4ec0 2023-10-18T19:37:17.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.843+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 7) v1 ==== 48586+0+0 (secure 0 0 0) 0x7fa48001c900 con 0x7fa4900a4ec0 2023-10-18T19:37:17.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.843+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4900a4b90 con 0x7fa4900a4ec0 2023-10-18T19:37:17.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.844+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fa4800572e0 con 0x7fa4900a4ec0 2023-10-18T19:37:17.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:17.850+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa48000b9c0 con 0x7fa4900a4ec0 2023-10-18T19:37:18.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.006+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa49005f270 con 0x7fa4900a4ec0 2023-10-18T19:37:18.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.007+0000 7fa47e7fc700 1 -- 172.21.15.88:0/3234497239 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa480020030 con 0x7fa4900a4ec0 2023-10-18T19:37:18.010 INFO:teuthology.orchestra.run.smithi088.stdout:38654705704 2023-10-18T19:37:18.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 >> v1:172.21.15.88:6800/113625 conn(0x7fa470041c50 legacy=0x7fa470044110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 msgr2=0x7fa490135b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa480009fd0 tx=0x7fa480017000).stop 2023-10-18T19:37:18.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 shutdown_connections 2023-10-18T19:37:18.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa49013b730 0x7fa49014bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4900a4ec0 0x7fa490135b50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 --2- 172.21.15.88:0/3234497239 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4900af5e0 0x7fa49013c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 >> 172.21.15.88:0/3234497239 conn(0x7fa490062a80 msgr2=0x7fa4900ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 shutdown_connections 2023-10-18T19:37:18.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.009+0000 7fa494dff700 1 -- 172.21.15.88:0/3234497239 wait complete. 2023-10-18T19:37:18.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.0 2023-10-18T19:37:18.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T19:37:18.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.222+0000 7f866adff700 1 Processor -- start 2023-10-18T19:37:18.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.223+0000 7f866adff700 1 -- start start 2023-10-18T19:37:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866adff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f866405e960 0x7f86640a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866adff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86641363c0 0x7f8664143390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866adff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640a4e00 con 0x7f8664138d20 2023-10-18T19:37:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866adff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640a4070 con 0x7f866405e960 2023-10-18T19:37:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866adff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866405ed40 con 0x7f86641363c0 2023-10-18T19:37:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f866405e960 0x7f86640a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f866405e960 0x7f86640a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36376/0 (socket says 172.21.15.88:36376) 2023-10-18T19:37:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 -- 172.21.15.88:0/2594053036 learned_addr learned my addr 172.21.15.88:0/2594053036 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8663fff700 1 --1- 172.21.15.88:0/2594053036 >> v1:172.21.15.88:6789/0 conn(0x7f8664138d20 0x7f8664135cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35142/0 (socket says 172.21.15.88:35142) 2023-10-18T19:37:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f866939c700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86641363c0 0x7f8664143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 -- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86641363c0 msgr2=0x7f8664143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:18.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86641363c0 0x7f8664143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 -- 172.21.15.88:0/2594053036 >> v1:172.21.15.88:6789/0 conn(0x7f8664138d20 legacy=0x7f8664135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.224+0000 7f8668b9b700 1 -- 172.21.15.88:0/2594053036 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640a4bf0 con 0x7f866405e960 2023-10-18T19:37:18.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.225+0000 7f8668b9b700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f866405e960 0x7f86640a4700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8658009810 tx=0x7f8658009060).ready entity=mon.0 client_cookie=fd98a2b6e9668429 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.225+0000 7f86637fe700 1 -- 172.21.15.88:0/2594053036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800f510 con 0x7f866405e960 2023-10-18T19:37:18.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.225+0000 7f86637fe700 1 -- 172.21.15.88:0/2594053036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800f670 con 0x7f866405e960 2023-10-18T19:37:18.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.225+0000 7f86637fe700 1 -- 172.21.15.88:0/2594053036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800f9f0 con 0x7f866405e960 2023-10-18T19:37:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 -- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f866405e960 msgr2=0x7f86640a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f866405e960 0x7f86640a4700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8658009810 tx=0x7f8658009060).stop 2023-10-18T19:37:18.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 -- 172.21.15.88:0/2594053036 shutdown_connections 2023-10-18T19:37:18.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f86641363c0 0x7f8664143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 --2- 172.21.15.88:0/2594053036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f866405e960 0x7f86640a4700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 -- 172.21.15.88:0/2594053036 >> 172.21.15.88:0/2594053036 conn(0x7f8664063460 msgr2=0x7f866405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 -- 172.21.15.88:0/2594053036 shutdown_connections 2023-10-18T19:37:18.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.226+0000 7f866adff700 1 -- 172.21.15.88:0/2594053036 wait complete. 2023-10-18T19:37:18.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.227+0000 7f866adff700 1 Processor -- start 2023-10-18T19:37:18.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.227+0000 7f866adff700 1 -- start start 2023-10-18T19:37:18.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f866405e960 0x7f866413ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8664138d20 0x7f8664133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640a6fe0 con 0x7f86641363c0 2023-10-18T19:37:18.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640a7c90 con 0x7f866405e960 2023-10-18T19:37:18.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866adff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8664140550 con 0x7f8664138d20 2023-10-18T19:37:18.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f8663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f8663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36380/0 (socket says 172.21.15.88:36380) 2023-10-18T19:37:18.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f8663fff700 1 -- 172.21.15.88:0/3701626796 learned_addr learned my addr 172.21.15.88:0/3701626796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:18.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f8668b9b700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f866405e960 0x7f866413ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.228+0000 7f866939c700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8664138d20 0x7f8664133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 -- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8664138d20 msgr2=0x7f8664133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8664138d20 0x7f8664133ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 -- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f866405e960 msgr2=0x7f866413ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f866405e960 0x7f866413ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 -- 172.21.15.88:0/3701626796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009300 con 0x7f86641363c0 2023-10-18T19:37:18.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8663fff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f865000c610 tx=0x7f8650007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.229+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500072e0 con 0x7f86641363c0 2023-10-18T19:37:18.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.230+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650007440 con 0x7f86641363c0 2023-10-18T19:37:18.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.230+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650005910 con 0x7f86641363c0 2023-10-18T19:37:18.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.230+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866413c450 con 0x7f86641363c0 2023-10-18T19:37:18.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.230+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640a6050 con 0x7f86641363c0 2023-10-18T19:37:18.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.231+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640a1060 con 0x7f86641363c0 2023-10-18T19:37:18.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.232+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 48586+0+0 (secure 0 0 0) 0x7f8650005d00 con 0x7f86641363c0 2023-10-18T19:37:18.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.233+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f8650054e30 con 0x7f86641363c0 2023-10-18T19:37:18.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.237+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f8650035350 con 0x7f86641363c0 2023-10-18T19:37:18.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.399+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86640ac840 con 0x7f86641363c0 2023-10-18T19:37:18.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.399+0000 7f8660ff9700 1 -- 172.21.15.88:0/3701626796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86640ac840 con 0x7f86641363c0 2023-10-18T19:37:18.402 INFO:teuthology.orchestra.run.smithi088.stdout:38654705704 2023-10-18T19:37:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 >> v1:172.21.15.88:6800/113625 conn(0x7f8648041c80 legacy=0x7f8648044140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 msgr2=0x7f86640a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f865000c610 tx=0x7f8650007db0).stop 2023-10-18T19:37:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 shutdown_connections 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8664138d20 0x7f8664133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f866405e960 0x7f866413ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 --2- 172.21.15.88:0/3701626796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86641363c0 0x7f86640a6af0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 >> 172.21.15.88:0/3701626796 conn(0x7f8664063460 msgr2=0x7f8664137af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 shutdown_connections 2023-10-18T19:37:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.401+0000 7f866adff700 1 -- 172.21.15.88:0/3701626796 wait complete. 2023-10-18T19:37:18.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.1 2023-10-18T19:37:18.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T19:37:18.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.612+0000 7fa1c4fff700 1 Processor -- start 2023-10-18T19:37:18.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 -- start start 2023-10-18T19:37:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1c005e960 0x7fa1c00a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c01391a0 0x7fa1c01361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c00a4070 con 0x7fa1c005e960 2023-10-18T19:37:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c0136690 con 0x7fa1c0138d20 2023-10-18T19:37:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.613+0000 7fa1c4fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00a4e00 con 0x7fa1c01391a0 2023-10-18T19:37:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1bdd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1c005e960 0x7fa1c00a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1bed9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c01391a0 0x7fa1c01361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1bdd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38900/0 (socket says 172.21.15.88:38900) 2023-10-18T19:37:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1bdd9b700 1 -- 172.21.15.88:0/505245977 learned_addr learned my addr 172.21.15.88:0/505245977 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 -- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c01391a0 msgr2=0x7fa1c01361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c01391a0 0x7fa1c01361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 -- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 msgr2=0x7fa1c0135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:18.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 -- 172.21.15.88:0/505245977 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c005ed40 con 0x7fa1c005e960 2023-10-18T19:37:18.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1bdd9b700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:18.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.614+0000 7fa1be59c700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c005e960 0x7fa1c00a4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa1b0006fd0 tx=0x7fa1b0006f40).ready entity=mon.0 client_cookie=ddfd1527acff09c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1bd59a700 1 -- 172.21.15.88:0/505245977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0005880 con 0x7fa1c005e960 2023-10-18T19:37:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1bd59a700 1 -- 172.21.15.88:0/505245977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00059e0 con 0x7fa1c005e960 2023-10-18T19:37:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1bd59a700 1 -- 172.21.15.88:0/505245977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0005d60 con 0x7fa1c005e960 2023-10-18T19:37:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 -- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c005e960 msgr2=0x7fa1c00a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c005e960 0x7fa1c00a4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa1b0006fd0 tx=0x7fa1b0006f40).stop 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 -- 172.21.15.88:0/505245977 shutdown_connections 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c01391a0 0x7fa1c01361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c005e960 0x7fa1c00a4700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/505245977 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c0138d20 0x7fa1c0135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 -- 172.21.15.88:0/505245977 >> 172.21.15.88:0/505245977 conn(0x7fa1c0063460 msgr2=0x7fa1c005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 -- 172.21.15.88:0/505245977 shutdown_connections 2023-10-18T19:37:18.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.615+0000 7fa1c4fff700 1 -- 172.21.15.88:0/505245977 wait complete. 2023-10-18T19:37:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.617+0000 7fa1c4fff700 1 Processor -- start 2023-10-18T19:37:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.617+0000 7fa1c4fff700 1 -- start start 2023-10-18T19:37:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c0138d20 0x7fa1c00a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 0x7fa1c013be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00a7220 con 0x7fa1c0138d20 2023-10-18T19:37:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00a8000 con 0x7fa1c01391a0 2023-10-18T19:37:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.618+0000 7fa1c4fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c00a84a0 con 0x7fa1c005e960 2023-10-18T19:37:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1bed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 0x7fa1c013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56250/0 (socket says 172.21.15.88:56250) 2023-10-18T19:37:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 -- 172.21.15.88:0/3185199341 learned_addr learned my addr 172.21.15.88:0/3185199341 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1bed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 0x7fa1c013be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38916/0 (socket says 172.21.15.88:38916) 2023-10-18T19:37:18.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1bdd9b700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c0138d20 0x7fa1c00a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 -- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 msgr2=0x7fa1c013be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 0x7fa1c013be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 -- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c0138d20 msgr2=0x7fa1c00a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c0138d20 0x7fa1c00a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 -- 172.21.15.88:0/3185199341 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4009370 con 0x7fa1c005e960 2023-10-18T19:37:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1be59c700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa1b000d260 tx=0x7fa1b0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.619+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0006770 con 0x7fa1c005e960 2023-10-18T19:37:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.620+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b000d6b0 con 0x7fa1c005e960 2023-10-18T19:37:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.620+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000da50 con 0x7fa1c005e960 2023-10-18T19:37:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.620+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b0009250 con 0x7fa1c005e960 2023-10-18T19:37:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.620+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c013ee80 con 0x7fa1c005e960 2023-10-18T19:37:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.621+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 7) v1 ==== 48586+0+0 (secure 0 0 0) 0x7fa1b001e460 con 0x7fa1c005e960 2023-10-18T19:37:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.621+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c00a6540 con 0x7fa1c005e960 2023-10-18T19:37:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.621+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fa1b0056bb0 con 0x7fa1c005e960 2023-10-18T19:37:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.625+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa1c00a6540 con 0x7fa1c005e960 2023-10-18T19:37:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.771+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1c00a6510 con 0x7fa1c005e960 2023-10-18T19:37:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.771+0000 7fa1ae7fc700 1 -- 172.21.15.88:0/3185199341 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1b0023090 con 0x7fa1c005e960 2023-10-18T19:37:18.774 INFO:teuthology.orchestra.run.smithi088.stdout:38654705704 2023-10-18T19:37:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 >> v1:172.21.15.88:6800/113625 conn(0x7fa1a0041c50 legacy=0x7fa1a0044110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 msgr2=0x7fa1c00a8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa1b000d260 tx=0x7fa1b0015000).stop 2023-10-18T19:37:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 shutdown_connections 2023-10-18T19:37:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa1c01391a0 0x7fa1c013be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa1c005e960 0x7fa1c00a8ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 --2- 172.21.15.88:0/3185199341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1c0138d20 0x7fa1c00a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 >> 172.21.15.88:0/3185199341 conn(0x7fa1c0063460 msgr2=0x7fa1c00acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 shutdown_connections 2023-10-18T19:37:18.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.773+0000 7fa1c4fff700 1 -- 172.21.15.88:0/3185199341 wait complete. 2023-10-18T19:37:18.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.2 2023-10-18T19:37:18.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T19:37:18.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.979+0000 7fe54d5ff700 1 Processor -- start 2023-10-18T19:37:18.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.979+0000 7fe54d5ff700 1 -- start start 2023-10-18T19:37:18.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe54d5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 0x7fe5480a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe54d5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe548143390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe54d5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480a4e00 con 0x7fe548138d20 2023-10-18T19:37:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe54d5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480a4070 con 0x7fe54805e960 2023-10-18T19:37:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe54d5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54805ed40 con 0x7fe5481363c0 2023-10-18T19:37:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe546ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 0x7fe5480a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe5467fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe548138d20 0x7fe548135cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35148/0 (socket says 172.21.15.88:35148) 2023-10-18T19:37:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe548143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.980+0000 7fe5467fc700 1 -- 172.21.15.88:0/1008652054 learned_addr learned my addr 172.21.15.88:0/1008652054 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe545ffb700 1 -- 172.21.15.88:0/1008652054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180533261 0 0) 0x7fe5480a4e00 con 0x7fe548138d20 2023-10-18T19:37:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe546ffd700 1 -- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 msgr2=0x7fe548143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:18.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe546ffd700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe548143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe546ffd700 1 -- 172.21.15.88:0/1008652054 >> v1:172.21.15.88:6789/0 conn(0x7fe548138d20 legacy=0x7fe548135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe546ffd700 1 -- 172.21.15.88:0/1008652054 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480a4bf0 con 0x7fe54805e960 2023-10-18T19:37:18.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe5477fe700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe548143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:18.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe546ffd700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 0x7fe5480a4700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe538009760 tx=0x7fe538006f40).ready entity=mon.1 client_cookie=d8d9235b4bdf79df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe545ffb700 1 -- 172.21.15.88:0/1008652054 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538005880 con 0x7fe54805e960 2023-10-18T19:37:18.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe545ffb700 1 -- 172.21.15.88:0/1008652054 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380059e0 con 0x7fe54805e960 2023-10-18T19:37:18.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe545ffb700 1 -- 172.21.15.88:0/1008652054 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538005d60 con 0x7fe54805e960 2023-10-18T19:37:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 msgr2=0x7fe5480a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.981+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 0x7fe5480a4700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe538009760 tx=0x7fe538006f40).stop 2023-10-18T19:37:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1008652054 shutdown_connections 2023-10-18T19:37:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe548143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1008652054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe54805e960 0x7fe5480a4700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1008652054 >> 172.21.15.88:0/1008652054 conn(0x7fe548063460 msgr2=0x7fe54805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:18.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1008652054 shutdown_connections 2023-10-18T19:37:18.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.982+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1008652054 wait complete. 2023-10-18T19:37:18.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.983+0000 7fe54d5ff700 1 Processor -- start 2023-10-18T19:37:18.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.984+0000 7fe54d5ff700 1 -- start start 2023-10-18T19:37:18.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe5480a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe548138d20 0x7fe54814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:18.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480a64e0 con 0x7fe54805e960 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480a6220 con 0x7fe548138d20 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe54d5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54813c980 con 0x7fe5481363c0 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe5467fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe5480a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe548138d20 0x7fe54814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:18.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36410/0 (socket says 172.21.15.88:36410) 2023-10-18T19:37:18.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 -- 172.21.15.88:0/1576556673 learned_addr learned my addr 172.21.15.88:0/1576556673 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:18.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 -- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 msgr2=0x7fe5480a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe5480a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 -- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe548138d20 msgr2=0x7fe54814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:18.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe548138d20 0x7fe54814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe546ffd700 1 -- 172.21.15.88:0/1576556673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540009a20 con 0x7fe54805e960 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.985+0000 7fe5467fc700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe5480a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe546ffd700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe54805fd90 tx=0x7fe538016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800f720 con 0x7fe54805e960 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800f880 con 0x7fe54805e960 2023-10-18T19:37:18.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800fc00 con 0x7fe54805e960 2023-10-18T19:37:18.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe538009250 con 0x7fe54805e960 2023-10-18T19:37:18.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.986+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480a8190 con 0x7fe54805e960 2023-10-18T19:37:18.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.987+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54805f270 con 0x7fe54805e960 2023-10-18T19:37:18.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.987+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 48586+0+0 (secure 0 0 0) 0x7fe538011440 con 0x7fe54805e960 2023-10-18T19:37:18.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.988+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fe538056440 con 0x7fe54805e960 2023-10-18T19:37:18.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:18.991+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe538028d20 con 0x7fe54805e960 2023-10-18T19:37:19.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.139+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5480a1300 con 0x7fe54805e960 2023-10-18T19:37:19.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.140+0000 7fe52effd700 1 -- 172.21.15.88:0/1576556673 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe538021030 con 0x7fe54805e960 2023-10-18T19:37:19.143 INFO:teuthology.orchestra.run.smithi088.stdout:38654705704 2023-10-18T19:37:19.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 >> v1:172.21.15.88:6800/113625 conn(0x7fe534041c50 legacy=0x7fe534044110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 msgr2=0x7fe5480a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe54805fd90 tx=0x7fe538016000).stop 2023-10-18T19:37:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 shutdown_connections 2023-10-18T19:37:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe548138d20 0x7fe54814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe54805e960 0x7fe5480a6b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 --2- 172.21.15.88:0/1576556673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe5481363c0 0x7fe5480a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 >> 172.21.15.88:0/1576556673 conn(0x7fe548063460 msgr2=0x7fe548134cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:19.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 shutdown_connections 2023-10-18T19:37:19.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.142+0000 7fe54d5ff700 1 -- 172.21.15.88:0/1576556673 wait complete. 2023-10-18T19:37:19.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705704 for osd.3 2023-10-18T19:37:19.161 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T19:37:19.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:19.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.346+0000 7fcd847ff700 1 Processor -- start 2023-10-18T19:37:19.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.347+0000 7fcd847ff700 1 -- start start 2023-10-18T19:37:19.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.347+0000 7fcd847ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 0x7fcd7c0a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd847ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 0x7fcd7c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd847ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c05e630 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd847ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a7260 con 0x7fcd7c1413e0 2023-10-18T19:37:19.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd847ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a1a70 con 0x7fcd7c05e250 2023-10-18T19:37:19.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd81d9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcd7c0a6aa0 0x7fcd7c0a8680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35162/0 (socket says 172.21.15.88:35162) 2023-10-18T19:37:19.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd81d9a700 1 -- 172.21.15.88:0/1795820524 learned_addr learned my addr 172.21.15.88:0/1795820524 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:19.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd8259b700 1 --2- 172.21.15.88:0/1795820524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 0x7fcd7c0a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd82d9c700 1 --2- 172.21.15.88:0/1795820524 >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 0x7fcd7c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd81599700 1 -- 172.21.15.88:0/1795820524 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534011752 0 0) 0x7fcd7c05e630 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd81599700 1 -- 172.21.15.88:0/1795820524 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd680033f0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd8259b700 1 -- 172.21.15.88:0/1795820524 >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 msgr2=0x7fcd7c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd8259b700 1 --2- 172.21.15.88:0/1795820524 >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 0x7fcd7c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd8259b700 1 -- 172.21.15.88:0/1795820524 >> v1:172.21.15.88:6789/0 conn(0x7fcd7c0a6aa0 legacy=0x7fcd7c0a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd8259b700 1 -- 172.21.15.88:0/1795820524 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0a8d90 con 0x7fcd7c05e250 2023-10-18T19:37:19.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.348+0000 7fcd82d9c700 1 --2- 172.21.15.88:0/1795820524 >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 0x7fcd7c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:19.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd8259b700 1 --2- 172.21.15.88:0/1795820524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 0x7fcd7c0a1580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcd78009790 tx=0x7fcd78009060).ready entity=mon.1 client_cookie=2d72deceeb3906c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:19.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd81599700 1 -- 172.21.15.88:0/1795820524 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800d4a0 con 0x7fcd7c05e250 2023-10-18T19:37:19.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd81599700 1 -- 172.21.15.88:0/1795820524 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7800d600 con 0x7fcd7c05e250 2023-10-18T19:37:19.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd81599700 1 -- 172.21.15.88:0/1795820524 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800d980 con 0x7fcd7c05e250 2023-10-18T19:37:19.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 -- 172.21.15.88:0/1795820524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 msgr2=0x7fcd7c0a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1795820524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 0x7fcd7c0a1580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcd78009790 tx=0x7fcd78009060).stop 2023-10-18T19:37:19.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 -- 172.21.15.88:0/1795820524 shutdown_connections 2023-10-18T19:37:19.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1795820524 >> v2:172.21.15.88:3300/0 conn(0x7fcd7c1413e0 0x7fcd7c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1795820524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c05e250 0x7fcd7c0a1580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 -- 172.21.15.88:0/1795820524 >> 172.21.15.88:0/1795820524 conn(0x7fcd7c0665a0 msgr2=0x7fcd7c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 -- 172.21.15.88:0/1795820524 shutdown_connections 2023-10-18T19:37:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.349+0000 7fcd847ff700 1 -- 172.21.15.88:0/1795820524 wait complete. 2023-10-18T19:37:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.351+0000 7fcd847ff700 1 Processor -- start 2023-10-18T19:37:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.351+0000 7fcd847ff700 1 -- start start 2023-10-18T19:37:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 0x7fcd7c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a4ad0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0ab130 con 0x7fcd7c1413e0 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd847ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a2c40 con 0x7fcd7c05e250 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd8259b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36420/0 (socket says 172.21.15.88:36420) 2023-10-18T19:37:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 -- 172.21.15.88:0/1005120220 learned_addr learned my addr 172.21.15.88:0/1005120220 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:19.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd8259b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56284/0 (socket says 172.21.15.88:56284) 2023-10-18T19:37:19.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd82d9c700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 0x7fcd7c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 -- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 msgr2=0x7fcd7c0abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 -- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 msgr2=0x7fcd7c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 0x7fcd7c14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd81d9a700 1 -- 172.21.15.88:0/1005120220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74009a20 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd8259b700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.352+0000 7fcd82d9c700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 0x7fcd7c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd81d9a700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcd6c00c4f0 tx=0x7fcd6c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0072e0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c007440 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0057a0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd780092a0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.353+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0ab340 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.354+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c068ac0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.354+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 7) v1 ==== 48586+0+0 (secure 0 0 0) 0x7fcd6c005bd0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.355+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fcd6c054ed0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.358+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fcd6c035540 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.484+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fcd6c034ff0 con 0x7fcd7c0a6aa0 2023-10-18T19:37:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.507+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd7c0a0de0 con 0x7fcd60041c50 2023-10-18T19:37:19.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.518+0000 7fcd727fc700 1 -- 172.21.15.88:0/1005120220 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325971 (unknown 2965378022 0 2983035873) 0x7fcd7c0a0de0 con 0x7fcd60041c50 2023-10-18T19:37:19.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.521+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 >> v1:172.21.15.88:6800/113625 conn(0x7fcd60041c50 legacy=0x7fcd60044110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.521+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 msgr2=0x7fcd7c0a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.521+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcd6c00c4f0 tx=0x7fcd6c007c50).stop 2023-10-18T19:37:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 shutdown_connections 2023-10-18T19:37:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcd7c1413e0 0x7fcd7c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fcd7c05e250 0x7fcd7c0abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 --2- 172.21.15.88:0/1005120220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd7c0a6aa0 0x7fcd7c0a98f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 >> 172.21.15.88:0/1005120220 conn(0x7fcd7c0665a0 msgr2=0x7fcd7c0a83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 shutdown_connections 2023-10-18T19:37:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.522+0000 7fcd847ff700 1 -- 172.21.15.88:0/1005120220 wait complete. 2023-10-18T19:37:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:19.541 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-18T19:37:19.354993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195048,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292312,"statfs":{"total":386547056640,"available":382251327488,"internally_reserved":4294967296,"allocated":729088,"data_stored":201443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993836"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281973+0000","last_change":"2023-10-18T19:34:21.266064+0000","last_active":"2023-10-18T19:34:38.281973+0000","last_peered":"2023-10-18T19:34:38.281973+0000","last_clean":"2023-10-18T19:34:38.281973+0000","last_became_active":"2023-10-18T19:34:21.265745+0000","last_became_peered":"2023-10-18T19:34:21.265745+0000","last_unstale":"2023-10-18T19:34:38.281973+0000","last_undegraded":"2023-10-18T19:34:38.281973+0000","last_fullsized":"2023-10-18T19:34:38.281973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.799504+0000","last_change":"2023-10-18T19:34:20.848544+0000","last_active":"2023-10-18T19:35:01.799504+0000","last_peered":"2023-10-18T19:35:01.799504+0000","last_clean":"2023-10-18T19:35:01.799504+0000","last_became_active":"2023-10-18T19:34:20.848186+0000","last_became_peered":"2023-10-18T19:34:20.848186+0000","last_unstale":"2023-10-18T19:35:01.799504+0000","last_undegraded":"2023-10-18T19:35:01.799504+0000","last_fullsized":"2023-10-18T19:35:01.799504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733305+0000","last_change":"2023-10-18T19:34:21.249452+0000","last_active":"2023-10-18T19:34:38.733305+0000","last_peered":"2023-10-18T19:34:38.733305+0000","last_clean":"2023-10-18T19:34:38.733305+0000","last_became_active":"2023-10-18T19:34:21.249103+0000","last_became_peered":"2023-10-18T19:34:21.249103+0000","last_unstale":"2023-10-18T19:34:38.733305+0000","last_undegraded":"2023-10-18T19:34:38.733305+0000","last_fullsized":"2023-10-18T19:34:38.733305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280902+0000","last_change":"2023-10-18T19:34:20.835459+0000","last_active":"2023-10-18T19:34:38.280902+0000","last_peered":"2023-10-18T19:34:38.280902+0000","last_clean":"2023-10-18T19:34:38.280902+0000","last_became_active":"2023-10-18T19:34:20.835145+0000","last_became_peered":"2023-10-18T19:34:20.835145+0000","last_unstale":"2023-10-18T19:34:38.280902+0000","last_undegraded":"2023-10-18T19:34:38.280902+0000","last_fullsized":"2023-10-18T19:34:38.280902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279296+0000","last_change":"2023-10-18T19:34:21.262486+0000","last_active":"2023-10-18T19:34:38.279296+0000","last_peered":"2023-10-18T19:34:38.279296+0000","last_clean":"2023-10-18T19:34:38.279296+0000","last_became_active":"2023-10-18T19:34:21.261956+0000","last_became_peered":"2023-10-18T19:34:21.261956+0000","last_unstale":"2023-10-18T19:34:38.279296+0000","last_undegraded":"2023-10-18T19:34:38.279296+0000","last_fullsized":"2023-10-18T19:34:38.279296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280144+0000","last_change":"2023-10-18T19:34:20.854649+0000","last_active":"2023-10-18T19:34:38.280144+0000","last_peered":"2023-10-18T19:34:38.280144+0000","last_clean":"2023-10-18T19:34:38.280144+0000","last_became_active":"2023-10-18T19:34:20.854333+0000","last_became_peered":"2023-10-18T19:34:20.854333+0000","last_unstale":"2023-10-18T19:34:38.280144+0000","last_undegraded":"2023-10-18T19:34:38.280144+0000","last_fullsized":"2023-10-18T19:34:38.280144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281669+0000","last_change":"2023-10-18T19:34:21.246025+0000","last_active":"2023-10-18T19:34:38.281669+0000","last_peered":"2023-10-18T19:34:38.281669+0000","last_clean":"2023-10-18T19:34:38.281669+0000","last_became_active":"2023-10-18T19:34:21.245735+0000","last_became_peered":"2023-10-18T19:34:21.245735+0000","last_unstale":"2023-10-18T19:34:38.281669+0000","last_undegraded":"2023-10-18T19:34:38.281669+0000","last_fullsized":"2023-10-18T19:34:38.281669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279099+0000","last_change":"2023-10-18T19:34:20.853312+0000","last_active":"2023-10-18T19:34:38.279099+0000","last_peered":"2023-10-18T19:34:38.279099+0000","last_clean":"2023-10-18T19:34:38.279099+0000","last_became_active":"2023-10-18T19:34:20.852964+0000","last_became_peered":"2023-10-18T19:34:20.852964+0000","last_unstale":"2023-10-18T19:34:38.279099+0000","last_undegraded":"2023-10-18T19:34:38.279099+0000","last_fullsized":"2023-10-18T19:34:38.279099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432978+0000","last_change":"2023-10-18T19:34:21.265408+0000","last_active":"2023-10-18T19:37:15.432978+0000","last_peered":"2023-10-18T19:37:15.432978+0000","last_clean":"2023-10-18T19:37:15.432978+0000","last_became_active":"2023-10-18T19:34:21.265029+0000","last_became_peered":"2023-10-18T19:34:21.265029+0000","last_unstale":"2023-10-18T19:37:15.432978+0000","last_undegraded":"2023-10-18T19:37:15.432978+0000","last_fullsized":"2023-10-18T19:37:15.432978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:11.800534+0000","last_change":"2023-10-18T19:34:20.825709+0000","last_active":"2023-10-18T19:35:11.800534+0000","last_peered":"2023-10-18T19:35:11.800534+0000","last_clean":"2023-10-18T19:35:11.800534+0000","last_became_active":"2023-10-18T19:34:20.825364+0000","last_became_peered":"2023-10-18T19:34:20.825364+0000","last_unstale":"2023-10-18T19:35:11.800534+0000","last_undegraded":"2023-10-18T19:35:11.800534+0000","last_fullsized":"2023-10-18T19:35:11.800534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734181+0000","last_change":"2023-10-18T19:34:21.250032+0000","last_active":"2023-10-18T19:34:38.734181+0000","last_peered":"2023-10-18T19:34:38.734181+0000","last_clean":"2023-10-18T19:34:38.734181+0000","last_became_active":"2023-10-18T19:34:21.245104+0000","last_became_peered":"2023-10-18T19:34:21.245104+0000","last_unstale":"2023-10-18T19:34:38.734181+0000","last_undegraded":"2023-10-18T19:34:38.734181+0000","last_fullsized":"2023-10-18T19:34:38.734181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734258+0000","last_change":"2023-10-18T19:34:20.862583+0000","last_active":"2023-10-18T19:34:38.734258+0000","last_peered":"2023-10-18T19:34:38.734258+0000","last_clean":"2023-10-18T19:34:38.734258+0000","last_became_active":"2023-10-18T19:34:20.862262+0000","last_became_peered":"2023-10-18T19:34:20.862262+0000","last_unstale":"2023-10-18T19:34:38.734258+0000","last_undegraded":"2023-10-18T19:34:38.734258+0000","last_fullsized":"2023-10-18T19:34:38.734258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281992+0000","last_change":"2023-10-18T19:34:21.265750+0000","last_active":"2023-10-18T19:34:38.281992+0000","last_peered":"2023-10-18T19:34:38.281992+0000","last_clean":"2023-10-18T19:34:38.281992+0000","last_became_active":"2023-10-18T19:34:21.265449+0000","last_became_peered":"2023-10-18T19:34:21.265449+0000","last_unstale":"2023-10-18T19:34:38.281992+0000","last_undegraded":"2023-10-18T19:34:38.281992+0000","last_fullsized":"2023-10-18T19:34:38.281992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281687+0000","last_change":"2023-10-18T19:34:20.855201+0000","last_active":"2023-10-18T19:34:38.281687+0000","last_peered":"2023-10-18T19:34:38.281687+0000","last_clean":"2023-10-18T19:34:38.281687+0000","last_became_active":"2023-10-18T19:34:20.854344+0000","last_became_peered":"2023-10-18T19:34:20.854344+0000","last_unstale":"2023-10-18T19:34:38.281687+0000","last_undegraded":"2023-10-18T19:34:38.281687+0000","last_fullsized":"2023-10-18T19:34:38.281687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734008+0000","last_change":"2023-10-18T19:34:21.249688+0000","last_active":"2023-10-18T19:34:38.734008+0000","last_peered":"2023-10-18T19:34:38.734008+0000","last_clean":"2023-10-18T19:34:38.734008+0000","last_became_active":"2023-10-18T19:34:21.246078+0000","last_became_peered":"2023-10-18T19:34:21.246078+0000","last_unstale":"2023-10-18T19:34:38.734008+0000","last_undegraded":"2023-10-18T19:34:38.734008+0000","last_fullsized":"2023-10-18T19:34:38.734008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.434758+0000","last_change":"2023-10-18T19:34:20.857791+0000","last_active":"2023-10-18T19:37:15.434758+0000","last_peered":"2023-10-18T19:37:15.434758+0000","last_clean":"2023-10-18T19:37:15.434758+0000","last_became_active":"2023-10-18T19:34:20.857489+0000","last_became_peered":"2023-10-18T19:34:20.857489+0000","last_unstale":"2023-10-18T19:37:15.434758+0000","last_undegraded":"2023-10-18T19:37:15.434758+0000","last_fullsized":"2023-10-18T19:37:15.434758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733296+0000","last_change":"2023-10-18T19:34:21.245879+0000","last_active":"2023-10-18T19:34:38.733296+0000","last_peered":"2023-10-18T19:34:38.733296+0000","last_clean":"2023-10-18T19:34:38.733296+0000","last_became_active":"2023-10-18T19:34:21.245587+0000","last_became_peered":"2023-10-18T19:34:21.245587+0000","last_unstale":"2023-10-18T19:34:38.733296+0000","last_undegraded":"2023-10-18T19:34:38.733296+0000","last_fullsized":"2023-10-18T19:34:38.733296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733510+0000","last_change":"2023-10-18T19:34:20.857559+0000","last_active":"2023-10-18T19:34:38.733510+0000","last_peered":"2023-10-18T19:34:38.733510+0000","last_clean":"2023-10-18T19:34:38.733510+0000","last_became_active":"2023-10-18T19:34:20.857227+0000","last_became_peered":"2023-10-18T19:34:20.857227+0000","last_unstale":"2023-10-18T19:34:38.733510+0000","last_undegraded":"2023-10-18T19:34:38.733510+0000","last_fullsized":"2023-10-18T19:34:38.733510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281235+0000","last_change":"2023-10-18T19:34:21.258745+0000","last_active":"2023-10-18T19:34:38.281235+0000","last_peered":"2023-10-18T19:34:38.281235+0000","last_clean":"2023-10-18T19:34:38.281235+0000","last_became_active":"2023-10-18T19:34:21.258295+0000","last_became_peered":"2023-10-18T19:34:21.258295+0000","last_unstale":"2023-10-18T19:34:38.281235+0000","last_undegraded":"2023-10-18T19:34:38.281235+0000","last_fullsized":"2023-10-18T19:34:38.281235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281065+0000","last_change":"2023-10-18T19:34:20.836255+0000","last_active":"2023-10-18T19:34:38.281065+0000","last_peered":"2023-10-18T19:34:38.281065+0000","last_clean":"2023-10-18T19:34:38.281065+0000","last_became_active":"2023-10-18T19:34:20.835941+0000","last_became_peered":"2023-10-18T19:34:20.835941+0000","last_unstale":"2023-10-18T19:34:38.281065+0000","last_undegraded":"2023-10-18T19:34:38.281065+0000","last_fullsized":"2023-10-18T19:34:38.281065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281432+0000","last_change":"2023-10-18T19:34:21.253538+0000","last_active":"2023-10-18T19:34:38.281432+0000","last_peered":"2023-10-18T19:34:38.281432+0000","last_clean":"2023-10-18T19:34:38.281432+0000","last_became_active":"2023-10-18T19:34:21.253274+0000","last_became_peered":"2023-10-18T19:34:21.253274+0000","last_unstale":"2023-10-18T19:34:38.281432+0000","last_undegraded":"2023-10-18T19:34:38.281432+0000","last_fullsized":"2023-10-18T19:34:38.281432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733135+0000","last_change":"2023-10-18T19:34:20.857139+0000","last_active":"2023-10-18T19:34:38.733135+0000","last_peered":"2023-10-18T19:34:38.733135+0000","last_clean":"2023-10-18T19:34:38.733135+0000","last_became_active":"2023-10-18T19:34:20.856766+0000","last_became_peered":"2023-10-18T19:34:20.856766+0000","last_unstale":"2023-10-18T19:34:38.733135+0000","last_undegraded":"2023-10-18T19:34:38.733135+0000","last_fullsized":"2023-10-18T19:34:38.733135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280240+0000","last_change":"2023-10-18T19:34:21.272980+0000","last_active":"2023-10-18T19:34:38.280240+0000","last_peered":"2023-10-18T19:34:38.280240+0000","last_clean":"2023-10-18T19:34:38.280240+0000","last_became_active":"2023-10-18T19:34:21.272618+0000","last_became_peered":"2023-10-18T19:34:21.272618+0000","last_unstale":"2023-10-18T19:34:38.280240+0000","last_undegraded":"2023-10-18T19:34:38.280240+0000","last_fullsized":"2023-10-18T19:34:38.280240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430950+0000","last_change":"2023-10-18T19:34:20.828547+0000","last_active":"2023-10-18T19:37:15.430950+0000","last_peered":"2023-10-18T19:37:15.430950+0000","last_clean":"2023-10-18T19:37:15.430950+0000","last_became_active":"2023-10-18T19:34:20.828036+0000","last_became_peered":"2023-10-18T19:34:20.828036+0000","last_unstale":"2023-10-18T19:37:15.430950+0000","last_undegraded":"2023-10-18T19:37:15.430950+0000","last_fullsized":"2023-10-18T19:37:15.430950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432549+0000","last_change":"2023-10-18T19:34:21.265823+0000","last_active":"2023-10-18T19:37:15.432549+0000","last_peered":"2023-10-18T19:37:15.432549+0000","last_clean":"2023-10-18T19:37:15.432549+0000","last_became_active":"2023-10-18T19:34:21.265276+0000","last_became_peered":"2023-10-18T19:34:21.265276+0000","last_unstale":"2023-10-18T19:37:15.432549+0000","last_undegraded":"2023-10-18T19:37:15.432549+0000","last_fullsized":"2023-10-18T19:37:15.432549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734440+0000","last_change":"2023-10-18T19:34:20.856792+0000","last_active":"2023-10-18T19:34:38.734440+0000","last_peered":"2023-10-18T19:34:38.734440+0000","last_clean":"2023-10-18T19:34:38.734440+0000","last_became_active":"2023-10-18T19:34:20.856486+0000","last_became_peered":"2023-10-18T19:34:20.856486+0000","last_unstale":"2023-10-18T19:34:38.734440+0000","last_undegraded":"2023-10-18T19:34:38.734440+0000","last_fullsized":"2023-10-18T19:34:38.734440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734257+0000","last_change":"2023-10-18T19:34:21.265884+0000","last_active":"2023-10-18T19:34:38.734257+0000","last_peered":"2023-10-18T19:34:38.734257+0000","last_clean":"2023-10-18T19:34:38.734257+0000","last_became_active":"2023-10-18T19:34:21.265564+0000","last_became_peered":"2023-10-18T19:34:21.265564+0000","last_unstale":"2023-10-18T19:34:38.734257+0000","last_undegraded":"2023-10-18T19:34:38.734257+0000","last_fullsized":"2023-10-18T19:34:38.734257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432913+0000","last_change":"2023-10-18T19:34:20.858811+0000","last_active":"2023-10-18T19:37:15.432913+0000","last_peered":"2023-10-18T19:37:15.432913+0000","last_clean":"2023-10-18T19:37:15.432913+0000","last_became_active":"2023-10-18T19:34:20.858481+0000","last_became_peered":"2023-10-18T19:34:20.858481+0000","last_unstale":"2023-10-18T19:37:15.432913+0000","last_undegraded":"2023-10-18T19:37:15.432913+0000","last_fullsized":"2023-10-18T19:37:15.432913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733566+0000","last_change":"2023-10-18T19:34:21.246195+0000","last_active":"2023-10-18T19:34:38.733566+0000","last_peered":"2023-10-18T19:34:38.733566+0000","last_clean":"2023-10-18T19:34:38.733566+0000","last_became_active":"2023-10-18T19:34:21.245896+0000","last_became_peered":"2023-10-18T19:34:21.245896+0000","last_unstale":"2023-10-18T19:34:38.733566+0000","last_undegraded":"2023-10-18T19:34:38.733566+0000","last_fullsized":"2023-10-18T19:34:38.733566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281781+0000","last_change":"2023-10-18T19:34:20.855423+0000","last_active":"2023-10-18T19:34:38.281781+0000","last_peered":"2023-10-18T19:34:38.281781+0000","last_clean":"2023-10-18T19:34:38.281781+0000","last_became_active":"2023-10-18T19:34:20.854593+0000","last_became_peered":"2023-10-18T19:34:20.854593+0000","last_unstale":"2023-10-18T19:34:38.281781+0000","last_undegraded":"2023-10-18T19:34:38.281781+0000","last_fullsized":"2023-10-18T19:34:38.281781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282176+0000","last_change":"2023-10-18T19:34:21.256949+0000","last_active":"2023-10-18T19:34:38.282176+0000","last_peered":"2023-10-18T19:34:38.282176+0000","last_clean":"2023-10-18T19:34:38.282176+0000","last_became_active":"2023-10-18T19:34:21.256623+0000","last_became_peered":"2023-10-18T19:34:21.256623+0000","last_unstale":"2023-10-18T19:34:38.282176+0000","last_undegraded":"2023-10-18T19:34:38.282176+0000","last_fullsized":"2023-10-18T19:34:38.282176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433109+0000","last_change":"2023-10-18T19:34:20.846802+0000","last_active":"2023-10-18T19:37:15.433109+0000","last_peered":"2023-10-18T19:37:15.433109+0000","last_clean":"2023-10-18T19:37:15.433109+0000","last_became_active":"2023-10-18T19:34:20.846249+0000","last_became_peered":"2023-10-18T19:34:20.846249+0000","last_unstale":"2023-10-18T19:37:15.433109+0000","last_undegraded":"2023-10-18T19:37:15.433109+0000","last_fullsized":"2023-10-18T19:37:15.433109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280549+0000","last_change":"2023-10-18T19:34:21.258895+0000","last_active":"2023-10-18T19:34:38.280549+0000","last_peered":"2023-10-18T19:34:38.280549+0000","last_clean":"2023-10-18T19:34:38.280549+0000","last_became_active":"2023-10-18T19:34:21.256384+0000","last_became_peered":"2023-10-18T19:34:21.256384+0000","last_unstale":"2023-10-18T19:34:38.280549+0000","last_undegraded":"2023-10-18T19:34:38.280549+0000","last_fullsized":"2023-10-18T19:34:38.280549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280964+0000","last_change":"2023-10-18T19:34:20.850016+0000","last_active":"2023-10-18T19:34:38.280964+0000","last_peered":"2023-10-18T19:34:38.280964+0000","last_clean":"2023-10-18T19:34:38.280964+0000","last_became_active":"2023-10-18T19:34:20.849501+0000","last_became_peered":"2023-10-18T19:34:20.849501+0000","last_unstale":"2023-10-18T19:34:38.280964+0000","last_undegraded":"2023-10-18T19:34:38.280964+0000","last_fullsized":"2023-10-18T19:34:38.280964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281151+0000","last_change":"2023-10-18T19:34:21.258646+0000","last_active":"2023-10-18T19:34:38.281151+0000","last_peered":"2023-10-18T19:34:38.281151+0000","last_clean":"2023-10-18T19:34:38.281151+0000","last_became_active":"2023-10-18T19:34:21.257999+0000","last_became_peered":"2023-10-18T19:34:21.257999+0000","last_unstale":"2023-10-18T19:34:38.281151+0000","last_undegraded":"2023-10-18T19:34:38.281151+0000","last_fullsized":"2023-10-18T19:34:38.281151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281871+0000","last_change":"2023-10-18T19:34:20.856264+0000","last_active":"2023-10-18T19:34:38.281871+0000","last_peered":"2023-10-18T19:34:38.281871+0000","last_clean":"2023-10-18T19:34:38.281871+0000","last_became_active":"2023-10-18T19:34:20.856072+0000","last_became_peered":"2023-10-18T19:34:20.856072+0000","last_unstale":"2023-10-18T19:34:38.281871+0000","last_undegraded":"2023-10-18T19:34:38.281871+0000","last_fullsized":"2023-10-18T19:34:38.281871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279415+0000","last_change":"2023-10-18T19:34:21.242536+0000","last_active":"2023-10-18T19:34:38.279415+0000","last_peered":"2023-10-18T19:34:38.279415+0000","last_clean":"2023-10-18T19:34:38.279415+0000","last_became_active":"2023-10-18T19:34:21.242187+0000","last_became_peered":"2023-10-18T19:34:21.242187+0000","last_unstale":"2023-10-18T19:34:38.279415+0000","last_undegraded":"2023-10-18T19:34:38.279415+0000","last_fullsized":"2023-10-18T19:34:38.279415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281401+0000","last_change":"2023-10-18T19:34:20.844847+0000","last_active":"2023-10-18T19:34:38.281401+0000","last_peered":"2023-10-18T19:34:38.281401+0000","last_clean":"2023-10-18T19:34:38.281401+0000","last_became_active":"2023-10-18T19:34:20.844528+0000","last_became_peered":"2023-10-18T19:34:20.844528+0000","last_unstale":"2023-10-18T19:34:38.281401+0000","last_undegraded":"2023-10-18T19:34:38.281401+0000","last_fullsized":"2023-10-18T19:34:38.281401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280217+0000","last_change":"2023-10-18T19:34:21.272824+0000","last_active":"2023-10-18T19:34:38.280217+0000","last_peered":"2023-10-18T19:34:38.280217+0000","last_clean":"2023-10-18T19:34:38.280217+0000","last_became_active":"2023-10-18T19:34:21.272631+0000","last_became_peered":"2023-10-18T19:34:21.272631+0000","last_unstale":"2023-10-18T19:34:38.280217+0000","last_undegraded":"2023-10-18T19:34:38.280217+0000","last_fullsized":"2023-10-18T19:34:38.280217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732827+0000","last_change":"2023-10-18T19:34:20.833452+0000","last_active":"2023-10-18T19:34:38.732827+0000","last_peered":"2023-10-18T19:34:38.732827+0000","last_clean":"2023-10-18T19:34:38.732827+0000","last_became_active":"2023-10-18T19:34:20.832840+0000","last_became_peered":"2023-10-18T19:34:20.832840+0000","last_unstale":"2023-10-18T19:34:38.732827+0000","last_undegraded":"2023-10-18T19:34:38.732827+0000","last_fullsized":"2023-10-18T19:34:38.732827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-18T19:37:16.342037+0000","last_change":"2023-10-18T19:37:16.342037+0000","last_active":"2023-10-18T19:37:16.342037+0000","last_peered":"2023-10-18T19:37:16.342037+0000","last_clean":"2023-10-18T19:37:16.342037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-18T19:37:16.342037+0000","last_undegraded":"2023-10-18T19:37:16.342037+0000","last_fullsized":"2023-10-18T19:37:16.342037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282848+0000","last_change":"2023-10-18T19:34:21.255174+0000","last_active":"2023-10-18T19:34:38.282848+0000","last_peered":"2023-10-18T19:34:38.282848+0000","last_clean":"2023-10-18T19:34:38.282848+0000","last_became_active":"2023-10-18T19:34:21.252377+0000","last_became_peered":"2023-10-18T19:34:21.252377+0000","last_unstale":"2023-10-18T19:34:38.282848+0000","last_undegraded":"2023-10-18T19:34:38.282848+0000","last_fullsized":"2023-10-18T19:34:38.282848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432775+0000","last_change":"2023-10-18T19:34:11.535715+0000","last_active":"2023-10-18T19:37:15.432775+0000","last_peered":"2023-10-18T19:37:15.432775+0000","last_clean":"2023-10-18T19:37:15.432775+0000","last_became_active":"2023-10-18T19:34:11.534518+0000","last_became_peered":"2023-10-18T19:34:11.534518+0000","last_unstale":"2023-10-18T19:37:15.432775+0000","last_undegraded":"2023-10-18T19:37:15.432775+0000","last_fullsized":"2023-10-18T19:37:15.432775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282276+0000","last_change":"2023-10-18T19:34:20.857782+0000","last_active":"2023-10-18T19:34:38.282276+0000","last_peered":"2023-10-18T19:34:38.282276+0000","last_clean":"2023-10-18T19:34:38.282276+0000","last_became_active":"2023-10-18T19:34:20.853192+0000","last_became_peered":"2023-10-18T19:34:20.853192+0000","last_unstale":"2023-10-18T19:34:38.282276+0000","last_undegraded":"2023-10-18T19:34:38.282276+0000","last_fullsized":"2023-10-18T19:34:38.282276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734825+0000","last_change":"2023-10-18T19:34:21.257423+0000","last_active":"2023-10-18T19:34:38.734825+0000","last_peered":"2023-10-18T19:34:38.734825+0000","last_clean":"2023-10-18T19:34:38.734825+0000","last_became_active":"2023-10-18T19:34:21.256448+0000","last_became_peered":"2023-10-18T19:34:21.256448+0000","last_unstale":"2023-10-18T19:34:38.734825+0000","last_undegraded":"2023-10-18T19:34:38.734825+0000","last_fullsized":"2023-10-18T19:34:38.734825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282069+0000","last_change":"2023-10-18T19:34:11.532756+0000","last_active":"2023-10-18T19:34:38.282069+0000","last_peered":"2023-10-18T19:34:38.282069+0000","last_clean":"2023-10-18T19:34:38.282069+0000","last_became_active":"2023-10-18T19:34:11.532425+0000","last_became_peered":"2023-10-18T19:34:11.532425+0000","last_unstale":"2023-10-18T19:34:38.282069+0000","last_undegraded":"2023-10-18T19:34:38.282069+0000","last_fullsized":"2023-10-18T19:34:38.282069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.852964+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.852642+0000","last_became_peered":"2023-10-18T19:34:20.852642+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281876+0000","last_change":"2023-10-18T19:34:11.534856+0000","last_active":"2023-10-18T19:34:38.281876+0000","last_peered":"2023-10-18T19:34:38.281876+0000","last_clean":"2023-10-18T19:34:38.281876+0000","last_became_active":"2023-10-18T19:34:11.534541+0000","last_became_peered":"2023-10-18T19:34:11.534541+0000","last_unstale":"2023-10-18T19:34:38.281876+0000","last_undegraded":"2023-10-18T19:34:38.281876+0000","last_fullsized":"2023-10-18T19:34:38.281876+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279117+0000","last_change":"2023-10-18T19:34:20.847678+0000","last_active":"2023-10-18T19:34:38.279117+0000","last_peered":"2023-10-18T19:34:38.279117+0000","last_clean":"2023-10-18T19:34:38.279117+0000","last_became_active":"2023-10-18T19:34:20.847107+0000","last_became_peered":"2023-10-18T19:34:20.847107+0000","last_unstale":"2023-10-18T19:34:38.279117+0000","last_undegraded":"2023-10-18T19:34:38.279117+0000","last_fullsized":"2023-10-18T19:34:38.279117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733124+0000","last_change":"2023-10-18T19:34:21.255564+0000","last_active":"2023-10-18T19:34:38.733124+0000","last_peered":"2023-10-18T19:34:38.733124+0000","last_clean":"2023-10-18T19:34:38.733124+0000","last_became_active":"2023-10-18T19:34:21.255230+0000","last_became_peered":"2023-10-18T19:34:21.255230+0000","last_unstale":"2023-10-18T19:34:38.733124+0000","last_undegraded":"2023-10-18T19:34:38.733124+0000","last_fullsized":"2023-10-18T19:34:38.733124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733197+0000","last_change":"2023-10-18T19:34:11.535128+0000","last_active":"2023-10-18T19:34:38.733197+0000","last_peered":"2023-10-18T19:34:38.733197+0000","last_clean":"2023-10-18T19:34:38.733197+0000","last_became_active":"2023-10-18T19:34:11.534248+0000","last_became_peered":"2023-10-18T19:34:11.534248+0000","last_unstale":"2023-10-18T19:34:38.733197+0000","last_undegraded":"2023-10-18T19:34:38.733197+0000","last_fullsized":"2023-10-18T19:34:38.733197+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431228+0000","last_change":"2023-10-18T19:34:20.855194+0000","last_active":"2023-10-18T19:37:15.431228+0000","last_peered":"2023-10-18T19:37:15.431228+0000","last_clean":"2023-10-18T19:37:15.431228+0000","last_became_active":"2023-10-18T19:34:20.854897+0000","last_became_peered":"2023-10-18T19:34:20.854897+0000","last_unstale":"2023-10-18T19:37:15.431228+0000","last_undegraded":"2023-10-18T19:37:15.431228+0000","last_fullsized":"2023-10-18T19:37:15.431228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281390+0000","last_change":"2023-10-18T19:34:21.270017+0000","last_active":"2023-10-18T19:34:38.281390+0000","last_peered":"2023-10-18T19:34:38.281390+0000","last_clean":"2023-10-18T19:34:38.281390+0000","last_became_active":"2023-10-18T19:34:21.269485+0000","last_became_peered":"2023-10-18T19:34:21.269485+0000","last_unstale":"2023-10-18T19:34:38.281390+0000","last_undegraded":"2023-10-18T19:34:38.281390+0000","last_fullsized":"2023-10-18T19:34:38.281390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281541+0000","last_change":"2023-10-18T19:34:11.532872+0000","last_active":"2023-10-18T19:34:38.281541+0000","last_peered":"2023-10-18T19:34:38.281541+0000","last_clean":"2023-10-18T19:34:38.281541+0000","last_became_active":"2023-10-18T19:34:11.531562+0000","last_became_peered":"2023-10-18T19:34:11.531562+0000","last_unstale":"2023-10-18T19:34:38.281541+0000","last_undegraded":"2023-10-18T19:34:38.281541+0000","last_fullsized":"2023-10-18T19:34:38.281541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:06.799201+0000","last_change":"2023-10-18T19:34:20.852891+0000","last_active":"2023-10-18T19:35:06.799201+0000","last_peered":"2023-10-18T19:35:06.799201+0000","last_clean":"2023-10-18T19:35:06.799201+0000","last_became_active":"2023-10-18T19:34:20.852426+0000","last_became_peered":"2023-10-18T19:34:20.852426+0000","last_unstale":"2023-10-18T19:35:06.799201+0000","last_undegraded":"2023-10-18T19:35:06.799201+0000","last_fullsized":"2023-10-18T19:35:06.799201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280643+0000","last_change":"2023-10-18T19:34:21.266390+0000","last_active":"2023-10-18T19:34:38.280643+0000","last_peered":"2023-10-18T19:34:38.280643+0000","last_clean":"2023-10-18T19:34:38.280643+0000","last_became_active":"2023-10-18T19:34:21.266089+0000","last_became_peered":"2023-10-18T19:34:21.266089+0000","last_unstale":"2023-10-18T19:34:38.280643+0000","last_undegraded":"2023-10-18T19:34:38.280643+0000","last_fullsized":"2023-10-18T19:34:38.280643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279963+0000","last_change":"2023-10-18T19:34:11.532565+0000","last_active":"2023-10-18T19:34:38.279963+0000","last_peered":"2023-10-18T19:34:38.279963+0000","last_clean":"2023-10-18T19:34:38.279963+0000","last_became_active":"2023-10-18T19:34:11.532168+0000","last_became_peered":"2023-10-18T19:34:11.532168+0000","last_unstale":"2023-10-18T19:34:38.279963+0000","last_undegraded":"2023-10-18T19:34:38.279963+0000","last_fullsized":"2023-10-18T19:34:38.279963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280817+0000","last_change":"2023-10-18T19:34:20.852330+0000","last_active":"2023-10-18T19:34:38.280817+0000","last_peered":"2023-10-18T19:34:38.280817+0000","last_clean":"2023-10-18T19:34:38.280817+0000","last_became_active":"2023-10-18T19:34:20.851992+0000","last_became_peered":"2023-10-18T19:34:20.851992+0000","last_unstale":"2023-10-18T19:34:38.280817+0000","last_undegraded":"2023-10-18T19:34:38.280817+0000","last_fullsized":"2023-10-18T19:34:38.280817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733604+0000","last_change":"2023-10-18T19:34:21.264314+0000","last_active":"2023-10-18T19:34:38.733604+0000","last_peered":"2023-10-18T19:34:38.733604+0000","last_clean":"2023-10-18T19:34:38.733604+0000","last_became_active":"2023-10-18T19:34:21.263937+0000","last_became_peered":"2023-10-18T19:34:21.263937+0000","last_unstale":"2023-10-18T19:34:38.733604+0000","last_undegraded":"2023-10-18T19:34:38.733604+0000","last_fullsized":"2023-10-18T19:34:38.733604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282680+0000","last_change":"2023-10-18T19:34:11.533453+0000","last_active":"2023-10-18T19:34:38.282680+0000","last_peered":"2023-10-18T19:34:38.282680+0000","last_clean":"2023-10-18T19:34:38.282680+0000","last_became_active":"2023-10-18T19:34:11.532769+0000","last_became_peered":"2023-10-18T19:34:11.532769+0000","last_unstale":"2023-10-18T19:34:38.282680+0000","last_undegraded":"2023-10-18T19:34:38.282680+0000","last_fullsized":"2023-10-18T19:34:38.282680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282101+0000","last_change":"2023-10-18T19:34:20.853145+0000","last_active":"2023-10-18T19:34:38.282101+0000","last_peered":"2023-10-18T19:34:38.282101+0000","last_clean":"2023-10-18T19:34:38.282101+0000","last_became_active":"2023-10-18T19:34:20.852683+0000","last_became_peered":"2023-10-18T19:34:20.852683+0000","last_unstale":"2023-10-18T19:34:38.282101+0000","last_undegraded":"2023-10-18T19:34:38.282101+0000","last_fullsized":"2023-10-18T19:34:38.282101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282182+0000","last_change":"2023-10-18T19:34:21.266346+0000","last_active":"2023-10-18T19:34:38.282182+0000","last_peered":"2023-10-18T19:34:38.282182+0000","last_clean":"2023-10-18T19:34:38.282182+0000","last_became_active":"2023-10-18T19:34:21.265950+0000","last_became_peered":"2023-10-18T19:34:21.265950+0000","last_unstale":"2023-10-18T19:34:38.282182+0000","last_undegraded":"2023-10-18T19:34:38.282182+0000","last_fullsized":"2023-10-18T19:34:38.282182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282658+0000","last_change":"2023-10-18T19:34:11.533454+0000","last_active":"2023-10-18T19:34:38.282658+0000","last_peered":"2023-10-18T19:34:38.282658+0000","last_clean":"2023-10-18T19:34:38.282658+0000","last_became_active":"2023-10-18T19:34:11.533123+0000","last_became_peered":"2023-10-18T19:34:11.533123+0000","last_unstale":"2023-10-18T19:34:38.282658+0000","last_undegraded":"2023-10-18T19:34:38.282658+0000","last_fullsized":"2023-10-18T19:34:38.282658+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281898+0000","last_change":"2023-10-18T19:34:20.844955+0000","last_active":"2023-10-18T19:34:38.281898+0000","last_peered":"2023-10-18T19:34:38.281898+0000","last_clean":"2023-10-18T19:34:38.281898+0000","last_became_active":"2023-10-18T19:34:20.844711+0000","last_became_peered":"2023-10-18T19:34:20.844711+0000","last_unstale":"2023-10-18T19:34:38.281898+0000","last_undegraded":"2023-10-18T19:34:38.281898+0000","last_fullsized":"2023-10-18T19:34:38.281898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431387+0000","last_change":"2023-10-18T19:34:21.256370+0000","last_active":"2023-10-18T19:37:15.431387+0000","last_peered":"2023-10-18T19:37:15.431387+0000","last_clean":"2023-10-18T19:37:15.431387+0000","last_became_active":"2023-10-18T19:34:21.256084+0000","last_became_peered":"2023-10-18T19:34:21.256084+0000","last_unstale":"2023-10-18T19:37:15.431387+0000","last_undegraded":"2023-10-18T19:37:15.431387+0000","last_fullsized":"2023-10-18T19:37:15.431387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282545+0000","last_change":"2023-10-18T19:34:21.253778+0000","last_active":"2023-10-18T19:34:38.282545+0000","last_peered":"2023-10-18T19:34:38.282545+0000","last_clean":"2023-10-18T19:34:38.282545+0000","last_became_active":"2023-10-18T19:34:21.251946+0000","last_became_peered":"2023-10-18T19:34:21.251946+0000","last_unstale":"2023-10-18T19:34:38.282545+0000","last_undegraded":"2023-10-18T19:34:38.282545+0000","last_fullsized":"2023-10-18T19:34:38.282545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733900+0000","last_change":"2023-10-18T19:34:20.862585+0000","last_active":"2023-10-18T19:34:38.733900+0000","last_peered":"2023-10-18T19:34:38.733900+0000","last_clean":"2023-10-18T19:34:38.733900+0000","last_became_active":"2023-10-18T19:34:20.862326+0000","last_became_peered":"2023-10-18T19:34:20.862326+0000","last_unstale":"2023-10-18T19:34:38.733900+0000","last_undegraded":"2023-10-18T19:34:38.733900+0000","last_fullsized":"2023-10-18T19:34:38.733900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281804+0000","last_change":"2023-10-18T19:34:21.259196+0000","last_active":"2023-10-18T19:34:38.281804+0000","last_peered":"2023-10-18T19:34:38.281804+0000","last_clean":"2023-10-18T19:34:38.281804+0000","last_became_active":"2023-10-18T19:34:21.258884+0000","last_became_peered":"2023-10-18T19:34:21.258884+0000","last_unstale":"2023-10-18T19:34:38.281804+0000","last_undegraded":"2023-10-18T19:34:38.281804+0000","last_fullsized":"2023-10-18T19:34:38.281804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733897+0000","last_change":"2023-10-18T19:34:20.863893+0000","last_active":"2023-10-18T19:34:38.733897+0000","last_peered":"2023-10-18T19:34:38.733897+0000","last_clean":"2023-10-18T19:34:38.733897+0000","last_became_active":"2023-10-18T19:34:20.863549+0000","last_became_peered":"2023-10-18T19:34:20.863549+0000","last_unstale":"2023-10-18T19:34:38.733897+0000","last_undegraded":"2023-10-18T19:34:38.733897+0000","last_fullsized":"2023-10-18T19:34:38.733897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734602+0000","last_change":"2023-10-18T19:34:21.261264+0000","last_active":"2023-10-18T19:34:38.734602+0000","last_peered":"2023-10-18T19:34:38.734602+0000","last_clean":"2023-10-18T19:34:38.734602+0000","last_became_active":"2023-10-18T19:34:21.260951+0000","last_became_peered":"2023-10-18T19:34:21.260951+0000","last_unstale":"2023-10-18T19:34:38.734602+0000","last_undegraded":"2023-10-18T19:34:38.734602+0000","last_fullsized":"2023-10-18T19:34:38.734602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.853421+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.853091+0000","last_became_peered":"2023-10-18T19:34:20.853091+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282564+0000","last_change":"2023-10-18T19:34:21.274214+0000","last_active":"2023-10-18T19:34:38.282564+0000","last_peered":"2023-10-18T19:34:38.282564+0000","last_clean":"2023-10-18T19:34:38.282564+0000","last_became_active":"2023-10-18T19:34:21.273899+0000","last_became_peered":"2023-10-18T19:34:21.273899+0000","last_unstale":"2023-10-18T19:34:38.282564+0000","last_undegraded":"2023-10-18T19:34:38.282564+0000","last_fullsized":"2023-10-18T19:34:38.282564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734358+0000","last_change":"2023-10-18T19:34:20.860150+0000","last_active":"2023-10-18T19:34:38.734358+0000","last_peered":"2023-10-18T19:34:38.734358+0000","last_clean":"2023-10-18T19:34:38.734358+0000","last_became_active":"2023-10-18T19:34:20.859836+0000","last_became_peered":"2023-10-18T19:34:20.859836+0000","last_unstale":"2023-10-18T19:34:38.734358+0000","last_undegraded":"2023-10-18T19:34:38.734358+0000","last_fullsized":"2023-10-18T19:34:38.734358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432488+0000","last_change":"2023-10-18T19:34:21.260022+0000","last_active":"2023-10-18T19:37:15.432488+0000","last_peered":"2023-10-18T19:37:15.432488+0000","last_clean":"2023-10-18T19:37:15.432488+0000","last_became_active":"2023-10-18T19:34:21.259630+0000","last_became_peered":"2023-10-18T19:34:21.259630+0000","last_unstale":"2023-10-18T19:37:15.432488+0000","last_undegraded":"2023-10-18T19:37:15.432488+0000","last_fullsized":"2023-10-18T19:37:15.432488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279207+0000","last_change":"2023-10-18T19:34:20.832124+0000","last_active":"2023-10-18T19:34:38.279207+0000","last_peered":"2023-10-18T19:34:38.279207+0000","last_clean":"2023-10-18T19:34:38.279207+0000","last_became_active":"2023-10-18T19:34:20.831830+0000","last_became_peered":"2023-10-18T19:34:20.831830+0000","last_unstale":"2023-10-18T19:34:38.279207+0000","last_undegraded":"2023-10-18T19:34:38.279207+0000","last_fullsized":"2023-10-18T19:34:38.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430926+0000","last_change":"2023-10-18T19:34:21.263372+0000","last_active":"2023-10-18T19:37:15.430926+0000","last_peered":"2023-10-18T19:37:15.430926+0000","last_clean":"2023-10-18T19:37:15.430926+0000","last_became_active":"2023-10-18T19:34:21.256876+0000","last_became_peered":"2023-10-18T19:34:21.256876+0000","last_unstale":"2023-10-18T19:37:15.430926+0000","last_undegraded":"2023-10-18T19:37:15.430926+0000","last_fullsized":"2023-10-18T19:37:15.430926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431460+0000","last_change":"2023-10-18T19:34:20.846546+0000","last_active":"2023-10-18T19:37:15.431460+0000","last_peered":"2023-10-18T19:37:15.431460+0000","last_clean":"2023-10-18T19:37:15.431460+0000","last_became_active":"2023-10-18T19:34:20.846229+0000","last_became_peered":"2023-10-18T19:34:20.846229+0000","last_unstale":"2023-10-18T19:37:15.431460+0000","last_undegraded":"2023-10-18T19:37:15.431460+0000","last_fullsized":"2023-10-18T19:37:15.431460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733497+0000","last_change":"2023-10-18T19:34:21.248032+0000","last_active":"2023-10-18T19:34:38.733497+0000","last_peered":"2023-10-18T19:34:38.733497+0000","last_clean":"2023-10-18T19:34:38.733497+0000","last_became_active":"2023-10-18T19:34:21.247196+0000","last_became_peered":"2023-10-18T19:34:21.247196+0000","last_unstale":"2023-10-18T19:34:38.733497+0000","last_undegraded":"2023-10-18T19:34:38.733497+0000","last_fullsized":"2023-10-18T19:34:38.733497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280987+0000","last_change":"2023-10-18T19:34:20.847408+0000","last_active":"2023-10-18T19:34:38.280987+0000","last_peered":"2023-10-18T19:34:38.280987+0000","last_clean":"2023-10-18T19:34:38.280987+0000","last_became_active":"2023-10-18T19:34:20.847100+0000","last_became_peered":"2023-10-18T19:34:20.847100+0000","last_unstale":"2023-10-18T19:34:38.280987+0000","last_undegraded":"2023-10-18T19:34:38.280987+0000","last_fullsized":"2023-10-18T19:34:38.280987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280644+0000","last_change":"2023-10-18T19:34:21.256724+0000","last_active":"2023-10-18T19:34:38.280644+0000","last_peered":"2023-10-18T19:34:38.280644+0000","last_clean":"2023-10-18T19:34:38.280644+0000","last_became_active":"2023-10-18T19:34:21.256252+0000","last_became_peered":"2023-10-18T19:34:21.256252+0000","last_unstale":"2023-10-18T19:34:38.280644+0000","last_undegraded":"2023-10-18T19:34:38.280644+0000","last_fullsized":"2023-10-18T19:34:38.280644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281329+0000","last_change":"2023-10-18T19:34:20.846959+0000","last_active":"2023-10-18T19:34:38.281329+0000","last_peered":"2023-10-18T19:34:38.281329+0000","last_clean":"2023-10-18T19:34:38.281329+0000","last_became_active":"2023-10-18T19:34:20.846541+0000","last_became_peered":"2023-10-18T19:34:20.846541+0000","last_unstale":"2023-10-18T19:34:38.281329+0000","last_undegraded":"2023-10-18T19:34:38.281329+0000","last_fullsized":"2023-10-18T19:34:38.281329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282350+0000","last_change":"2023-10-18T19:34:21.251998+0000","last_active":"2023-10-18T19:34:38.282350+0000","last_peered":"2023-10-18T19:34:38.282350+0000","last_clean":"2023-10-18T19:34:38.282350+0000","last_became_active":"2023-10-18T19:34:21.251641+0000","last_became_peered":"2023-10-18T19:34:21.251641+0000","last_unstale":"2023-10-18T19:34:38.282350+0000","last_undegraded":"2023-10-18T19:34:38.282350+0000","last_fullsized":"2023-10-18T19:34:38.282350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281984+0000","last_change":"2023-10-18T19:34:20.844433+0000","last_active":"2023-10-18T19:34:38.281984+0000","last_peered":"2023-10-18T19:34:38.281984+0000","last_clean":"2023-10-18T19:34:38.281984+0000","last_became_active":"2023-10-18T19:34:20.843767+0000","last_became_peered":"2023-10-18T19:34:20.843767+0000","last_unstale":"2023-10-18T19:34:38.281984+0000","last_undegraded":"2023-10-18T19:34:38.281984+0000","last_fullsized":"2023-10-18T19:34:38.281984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282148+0000","last_change":"2023-10-18T19:34:21.259590+0000","last_active":"2023-10-18T19:34:38.282148+0000","last_peered":"2023-10-18T19:34:38.282148+0000","last_clean":"2023-10-18T19:34:38.282148+0000","last_became_active":"2023-10-18T19:34:21.257762+0000","last_became_peered":"2023-10-18T19:34:21.257762+0000","last_unstale":"2023-10-18T19:34:38.282148+0000","last_undegraded":"2023-10-18T19:34:38.282148+0000","last_fullsized":"2023-10-18T19:34:38.282148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432829+0000","last_change":"2023-10-18T19:34:20.845853+0000","last_active":"2023-10-18T19:37:15.432829+0000","last_peered":"2023-10-18T19:37:15.432829+0000","last_clean":"2023-10-18T19:37:15.432829+0000","last_became_active":"2023-10-18T19:34:20.845487+0000","last_became_peered":"2023-10-18T19:34:20.845487+0000","last_unstale":"2023-10-18T19:37:15.432829+0000","last_undegraded":"2023-10-18T19:37:15.432829+0000","last_fullsized":"2023-10-18T19:37:15.432829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282909+0000","last_change":"2023-10-18T19:34:21.255163+0000","last_active":"2023-10-18T19:34:38.282909+0000","last_peered":"2023-10-18T19:34:38.282909+0000","last_clean":"2023-10-18T19:34:38.282909+0000","last_became_active":"2023-10-18T19:34:21.252262+0000","last_became_peered":"2023-10-18T19:34:21.252262+0000","last_unstale":"2023-10-18T19:34:38.282909+0000","last_undegraded":"2023-10-18T19:34:38.282909+0000","last_fullsized":"2023-10-18T19:34:38.282909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:56.775862+0000","last_change":"2023-10-18T19:34:20.861998+0000","last_active":"2023-10-18T19:34:56.775862+0000","last_peered":"2023-10-18T19:34:56.775862+0000","last_clean":"2023-10-18T19:34:56.775862+0000","last_became_active":"2023-10-18T19:34:20.860333+0000","last_became_peered":"2023-10-18T19:34:20.860333+0000","last_unstale":"2023-10-18T19:34:56.775862+0000","last_undegraded":"2023-10-18T19:34:56.775862+0000","last_fullsized":"2023-10-18T19:34:56.775862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433015+0000","last_change":"2023-10-18T19:34:21.258083+0000","last_active":"2023-10-18T19:37:15.433015+0000","last_peered":"2023-10-18T19:37:15.433015+0000","last_clean":"2023-10-18T19:37:15.433015+0000","last_became_active":"2023-10-18T19:34:21.257626+0000","last_became_peered":"2023-10-18T19:34:21.257626+0000","last_unstale":"2023-10-18T19:37:15.433015+0000","last_undegraded":"2023-10-18T19:37:15.433015+0000","last_fullsized":"2023-10-18T19:37:15.433015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282770+0000","last_change":"2023-10-18T19:34:20.855980+0000","last_active":"2023-10-18T19:34:38.282770+0000","last_peered":"2023-10-18T19:34:38.282770+0000","last_clean":"2023-10-18T19:34:38.282770+0000","last_became_active":"2023-10-18T19:34:20.855446+0000","last_became_peered":"2023-10-18T19:34:20.855446+0000","last_unstale":"2023-10-18T19:34:38.282770+0000","last_undegraded":"2023-10-18T19:34:38.282770+0000","last_fullsized":"2023-10-18T19:34:38.282770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280057+0000","last_change":"2023-10-18T19:34:21.267157+0000","last_active":"2023-10-18T19:34:38.280057+0000","last_peered":"2023-10-18T19:34:38.280057+0000","last_clean":"2023-10-18T19:34:38.280057+0000","last_became_active":"2023-10-18T19:34:21.266854+0000","last_became_peered":"2023-10-18T19:34:21.266854+0000","last_unstale":"2023-10-18T19:34:38.280057+0000","last_undegraded":"2023-10-18T19:34:38.280057+0000","last_fullsized":"2023-10-18T19:34:38.280057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279385+0000","last_change":"2023-10-18T19:34:20.847879+0000","last_active":"2023-10-18T19:34:38.279385+0000","last_peered":"2023-10-18T19:34:38.279385+0000","last_clean":"2023-10-18T19:34:38.279385+0000","last_became_active":"2023-10-18T19:34:20.847368+0000","last_became_peered":"2023-10-18T19:34:20.847368+0000","last_unstale":"2023-10-18T19:34:38.279385+0000","last_undegraded":"2023-10-18T19:34:38.279385+0000","last_fullsized":"2023-10-18T19:34:38.279385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279012+0000","last_change":"2023-10-18T19:34:21.271229+0000","last_active":"2023-10-18T19:34:38.279012+0000","last_peered":"2023-10-18T19:34:38.279012+0000","last_clean":"2023-10-18T19:34:38.279012+0000","last_became_active":"2023-10-18T19:34:21.270946+0000","last_became_peered":"2023-10-18T19:34:21.270946+0000","last_unstale":"2023-10-18T19:34:38.279012+0000","last_undegraded":"2023-10-18T19:34:38.279012+0000","last_fullsized":"2023-10-18T19:34:38.279012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281579+0000","last_change":"2023-10-18T19:34:20.857540+0000","last_active":"2023-10-18T19:34:38.281579+0000","last_peered":"2023-10-18T19:34:38.281579+0000","last_clean":"2023-10-18T19:34:38.281579+0000","last_became_active":"2023-10-18T19:34:20.857056+0000","last_became_peered":"2023-10-18T19:34:20.857056+0000","last_unstale":"2023-10-18T19:34:38.281579+0000","last_undegraded":"2023-10-18T19:34:38.281579+0000","last_fullsized":"2023-10-18T19:34:38.281579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733162+0000","last_change":"2023-10-18T19:34:21.264597+0000","last_active":"2023-10-18T19:34:38.733162+0000","last_peered":"2023-10-18T19:34:38.733162+0000","last_clean":"2023-10-18T19:34:38.733162+0000","last_became_active":"2023-10-18T19:34:21.264304+0000","last_became_peered":"2023-10-18T19:34:21.264304+0000","last_unstale":"2023-10-18T19:34:38.733162+0000","last_undegraded":"2023-10-18T19:34:38.733162+0000","last_fullsized":"2023-10-18T19:34:38.733162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.798950+0000","last_change":"2023-10-18T19:34:20.830160+0000","last_active":"2023-10-18T19:35:01.798950+0000","last_peered":"2023-10-18T19:35:01.798950+0000","last_clean":"2023-10-18T19:35:01.798950+0000","last_became_active":"2023-10-18T19:34:20.829821+0000","last_became_peered":"2023-10-18T19:34:20.829821+0000","last_unstale":"2023-10-18T19:35:01.798950+0000","last_undegraded":"2023-10-18T19:35:01.798950+0000","last_fullsized":"2023-10-18T19:35:01.798950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282061+0000","last_change":"2023-10-18T19:34:21.250388+0000","last_active":"2023-10-18T19:34:38.282061+0000","last_peered":"2023-10-18T19:34:38.282061+0000","last_clean":"2023-10-18T19:34:38.282061+0000","last_became_active":"2023-10-18T19:34:21.250098+0000","last_became_peered":"2023-10-18T19:34:21.250098+0000","last_unstale":"2023-10-18T19:34:38.282061+0000","last_undegraded":"2023-10-18T19:34:38.282061+0000","last_fullsized":"2023-10-18T19:34:38.282061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431970+0000","last_change":"2023-10-18T19:34:20.857726+0000","last_active":"2023-10-18T19:37:15.431970+0000","last_peered":"2023-10-18T19:37:15.431970+0000","last_clean":"2023-10-18T19:37:15.431970+0000","last_became_active":"2023-10-18T19:34:20.856983+0000","last_became_peered":"2023-10-18T19:34:20.856983+0000","last_unstale":"2023-10-18T19:37:15.431970+0000","last_undegraded":"2023-10-18T19:37:15.431970+0000","last_fullsized":"2023-10-18T19:37:15.431970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282838+0000","last_change":"2023-10-18T19:34:21.270485+0000","last_active":"2023-10-18T19:34:38.282838+0000","last_peered":"2023-10-18T19:34:38.282838+0000","last_clean":"2023-10-18T19:34:38.282838+0000","last_became_active":"2023-10-18T19:34:21.270140+0000","last_became_peered":"2023-10-18T19:34:21.270140+0000","last_unstale":"2023-10-18T19:34:38.282838+0000","last_undegraded":"2023-10-18T19:34:38.282838+0000","last_fullsized":"2023-10-18T19:34:38.282838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432509+0000","last_change":"2023-10-18T19:34:20.847009+0000","last_active":"2023-10-18T19:37:15.432509+0000","last_peered":"2023-10-18T19:37:15.432509+0000","last_clean":"2023-10-18T19:37:15.432509+0000","last_became_active":"2023-10-18T19:34:20.846481+0000","last_became_peered":"2023-10-18T19:34:20.846481+0000","last_unstale":"2023-10-18T19:37:15.432509+0000","last_undegraded":"2023-10-18T19:37:15.432509+0000","last_fullsized":"2023-10-18T19:37:15.432509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733909+0000","last_change":"2023-10-18T19:34:21.256060+0000","last_active":"2023-10-18T19:34:38.733909+0000","last_peered":"2023-10-18T19:34:38.733909+0000","last_clean":"2023-10-18T19:34:38.733909+0000","last_became_active":"2023-10-18T19:34:21.255703+0000","last_became_peered":"2023-10-18T19:34:21.255703+0000","last_unstale":"2023-10-18T19:34:38.733909+0000","last_undegraded":"2023-10-18T19:34:38.733909+0000","last_fullsized":"2023-10-18T19:34:38.733909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282443+0000","last_change":"2023-10-18T19:34:20.849799+0000","last_active":"2023-10-18T19:34:38.282443+0000","last_peered":"2023-10-18T19:34:38.282443+0000","last_clean":"2023-10-18T19:34:38.282443+0000","last_became_active":"2023-10-18T19:34:20.849488+0000","last_became_peered":"2023-10-18T19:34:20.849488+0000","last_unstale":"2023-10-18T19:34:38.282443+0000","last_undegraded":"2023-10-18T19:34:38.282443+0000","last_fullsized":"2023-10-18T19:34:38.282443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282561+0000","last_change":"2023-10-18T19:34:21.260006+0000","last_active":"2023-10-18T19:34:38.282561+0000","last_peered":"2023-10-18T19:34:38.282561+0000","last_clean":"2023-10-18T19:34:38.282561+0000","last_became_active":"2023-10-18T19:34:21.259689+0000","last_became_peered":"2023-10-18T19:34:21.259689+0000","last_unstale":"2023-10-18T19:34:38.282561+0000","last_undegraded":"2023-10-18T19:34:38.282561+0000","last_fullsized":"2023-10-18T19:34:38.282561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282357+0000","last_change":"2023-10-18T19:34:20.858108+0000","last_active":"2023-10-18T19:34:38.282357+0000","last_peered":"2023-10-18T19:34:38.282357+0000","last_clean":"2023-10-18T19:34:38.282357+0000","last_became_active":"2023-10-18T19:34:20.854784+0000","last_became_peered":"2023-10-18T19:34:20.854784+0000","last_unstale":"2023-10-18T19:34:38.282357+0000","last_undegraded":"2023-10-18T19:34:38.282357+0000","last_fullsized":"2023-10-18T19:34:38.282357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433066+0000","last_change":"2023-10-18T19:34:21.257919+0000","last_active":"2023-10-18T19:37:15.433066+0000","last_peered":"2023-10-18T19:37:15.433066+0000","last_clean":"2023-10-18T19:37:15.433066+0000","last_became_active":"2023-10-18T19:34:21.257409+0000","last_became_peered":"2023-10-18T19:34:21.257409+0000","last_unstale":"2023-10-18T19:37:15.433066+0000","last_undegraded":"2023-10-18T19:37:15.433066+0000","last_fullsized":"2023-10-18T19:37:15.433066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282854+0000","last_change":"2023-10-18T19:34:20.847577+0000","last_active":"2023-10-18T19:34:38.282854+0000","last_peered":"2023-10-18T19:34:38.282854+0000","last_clean":"2023-10-18T19:34:38.282854+0000","last_became_active":"2023-10-18T19:34:20.842013+0000","last_became_peered":"2023-10-18T19:34:20.842013+0000","last_unstale":"2023-10-18T19:34:38.282854+0000","last_undegraded":"2023-10-18T19:34:38.282854+0000","last_fullsized":"2023-10-18T19:34:38.282854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281875+0000","last_change":"2023-10-18T19:34:21.251747+0000","last_active":"2023-10-18T19:34:38.281875+0000","last_peered":"2023-10-18T19:34:38.281875+0000","last_clean":"2023-10-18T19:34:38.281875+0000","last_became_active":"2023-10-18T19:34:21.251325+0000","last_became_peered":"2023-10-18T19:34:21.251325+0000","last_unstale":"2023-10-18T19:34:38.281875+0000","last_undegraded":"2023-10-18T19:34:38.281875+0000","last_fullsized":"2023-10-18T19:34:38.281875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732897+0000","last_change":"2023-10-18T19:34:20.832572+0000","last_active":"2023-10-18T19:34:38.732897+0000","last_peered":"2023-10-18T19:34:38.732897+0000","last_clean":"2023-10-18T19:34:38.732897+0000","last_became_active":"2023-10-18T19:34:20.832216+0000","last_became_peered":"2023-10-18T19:34:20.832216+0000","last_unstale":"2023-10-18T19:34:38.732897+0000","last_undegraded":"2023-10-18T19:34:38.732897+0000","last_fullsized":"2023-10-18T19:34:38.732897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279223+0000","last_change":"2023-10-18T19:34:21.272247+0000","last_active":"2023-10-18T19:34:38.279223+0000","last_peered":"2023-10-18T19:34:38.279223+0000","last_clean":"2023-10-18T19:34:38.279223+0000","last_became_active":"2023-10-18T19:34:21.271930+0000","last_became_peered":"2023-10-18T19:34:21.271930+0000","last_unstale":"2023-10-18T19:34:38.279223+0000","last_undegraded":"2023-10-18T19:34:38.279223+0000","last_fullsized":"2023-10-18T19:34:38.279223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733403+0000","last_change":"2023-10-18T19:34:20.840841+0000","last_active":"2023-10-18T19:34:38.733403+0000","last_peered":"2023-10-18T19:34:38.733403+0000","last_clean":"2023-10-18T19:34:38.733403+0000","last_became_active":"2023-10-18T19:34:20.840351+0000","last_became_peered":"2023-10-18T19:34:20.840351+0000","last_unstale":"2023-10-18T19:34:38.733403+0000","last_undegraded":"2023-10-18T19:34:38.733403+0000","last_fullsized":"2023-10-18T19:34:38.733403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281107+0000","last_change":"2023-10-18T19:34:21.258445+0000","last_active":"2023-10-18T19:34:38.281107+0000","last_peered":"2023-10-18T19:34:38.281107+0000","last_clean":"2023-10-18T19:34:38.281107+0000","last_became_active":"2023-10-18T19:34:21.257747+0000","last_became_peered":"2023-10-18T19:34:21.257747+0000","last_unstale":"2023-10-18T19:34:38.281107+0000","last_undegraded":"2023-10-18T19:34:38.281107+0000","last_fullsized":"2023-10-18T19:34:38.281107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431681+0000","last_change":"2023-10-18T19:34:20.856638+0000","last_active":"2023-10-18T19:37:15.431681+0000","last_peered":"2023-10-18T19:37:15.431681+0000","last_clean":"2023-10-18T19:37:15.431681+0000","last_became_active":"2023-10-18T19:34:20.856094+0000","last_became_peered":"2023-10-18T19:34:20.856094+0000","last_unstale":"2023-10-18T19:37:15.431681+0000","last_undegraded":"2023-10-18T19:37:15.431681+0000","last_fullsized":"2023-10-18T19:37:15.431681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733334+0000","last_change":"2023-10-18T19:34:21.249180+0000","last_active":"2023-10-18T19:34:38.733334+0000","last_peered":"2023-10-18T19:34:38.733334+0000","last_clean":"2023-10-18T19:34:38.733334+0000","last_became_active":"2023-10-18T19:34:21.245370+0000","last_became_peered":"2023-10-18T19:34:21.245370+0000","last_unstale":"2023-10-18T19:34:38.733334+0000","last_undegraded":"2023-10-18T19:34:38.733334+0000","last_fullsized":"2023-10-18T19:34:38.733334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281765+0000","last_change":"2023-10-18T19:34:20.823278+0000","last_active":"2023-10-18T19:34:38.281765+0000","last_peered":"2023-10-18T19:34:38.281765+0000","last_clean":"2023-10-18T19:34:38.281765+0000","last_became_active":"2023-10-18T19:34:20.823003+0000","last_became_peered":"2023-10-18T19:34:20.823003+0000","last_unstale":"2023-10-18T19:34:38.281765+0000","last_undegraded":"2023-10-18T19:34:38.281765+0000","last_fullsized":"2023-10-18T19:34:38.281765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734049+0000","last_change":"2023-10-18T19:34:21.246335+0000","last_active":"2023-10-18T19:34:38.734049+0000","last_peered":"2023-10-18T19:34:38.734049+0000","last_clean":"2023-10-18T19:34:38.734049+0000","last_became_active":"2023-10-18T19:34:21.246040+0000","last_became_peered":"2023-10-18T19:34:21.246040+0000","last_unstale":"2023-10-18T19:34:38.734049+0000","last_undegraded":"2023-10-18T19:34:38.734049+0000","last_fullsized":"2023-10-18T19:34:38.734049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.404885+0000","last_change":"2023-10-18T19:34:20.855032+0000","last_active":"2023-10-18T19:37:15.404885+0000","last_peered":"2023-10-18T19:37:15.404885+0000","last_clean":"2023-10-18T19:37:15.404885+0000","last_became_active":"2023-10-18T19:34:20.854673+0000","last_became_peered":"2023-10-18T19:34:20.854673+0000","last_unstale":"2023-10-18T19:37:15.404885+0000","last_undegraded":"2023-10-18T19:37:15.404885+0000","last_fullsized":"2023-10-18T19:37:15.404885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734255+0000","last_change":"2023-10-18T19:34:21.254232+0000","last_active":"2023-10-18T19:34:38.734255+0000","last_peered":"2023-10-18T19:34:38.734255+0000","last_clean":"2023-10-18T19:34:38.734255+0000","last_became_active":"2023-10-18T19:34:21.253932+0000","last_became_peered":"2023-10-18T19:34:21.253932+0000","last_unstale":"2023-10-18T19:34:38.734255+0000","last_undegraded":"2023-10-18T19:34:38.734255+0000","last_fullsized":"2023-10-18T19:34:38.734255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282242+0000","last_change":"2023-10-18T19:34:20.855559+0000","last_active":"2023-10-18T19:34:38.282242+0000","last_peered":"2023-10-18T19:34:38.282242+0000","last_clean":"2023-10-18T19:34:38.282242+0000","last_became_active":"2023-10-18T19:34:20.854845+0000","last_became_peered":"2023-10-18T19:34:20.854845+0000","last_unstale":"2023-10-18T19:34:38.282242+0000","last_undegraded":"2023-10-18T19:34:38.282242+0000","last_fullsized":"2023-10-18T19:34:38.282242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282827+0000","last_change":"2023-10-18T19:34:21.248190+0000","last_active":"2023-10-18T19:34:38.282827+0000","last_peered":"2023-10-18T19:34:38.282827+0000","last_clean":"2023-10-18T19:34:38.282827+0000","last_became_active":"2023-10-18T19:34:21.247102+0000","last_became_peered":"2023-10-18T19:34:21.247102+0000","last_unstale":"2023-10-18T19:34:38.282827+0000","last_undegraded":"2023-10-18T19:34:38.282827+0000","last_fullsized":"2023-10-18T19:34:38.282827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282185+0000","last_change":"2023-10-18T19:34:20.857956+0000","last_active":"2023-10-18T19:34:38.282185+0000","last_peered":"2023-10-18T19:34:38.282185+0000","last_clean":"2023-10-18T19:34:38.282185+0000","last_became_active":"2023-10-18T19:34:20.855051+0000","last_became_peered":"2023-10-18T19:34:20.855051+0000","last_unstale":"2023-10-18T19:34:38.282185+0000","last_undegraded":"2023-10-18T19:34:38.282185+0000","last_fullsized":"2023-10-18T19:34:38.282185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734496+0000","last_change":"2023-10-18T19:34:21.266700+0000","last_active":"2023-10-18T19:34:38.734496+0000","last_peered":"2023-10-18T19:34:38.734496+0000","last_clean":"2023-10-18T19:34:38.734496+0000","last_became_active":"2023-10-18T19:34:21.266409+0000","last_became_peered":"2023-10-18T19:34:21.266409+0000","last_unstale":"2023-10-18T19:34:38.734496+0000","last_undegraded":"2023-10-18T19:34:38.734496+0000","last_fullsized":"2023-10-18T19:34:38.734496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734439+0000","last_change":"2023-10-18T19:34:20.851465+0000","last_active":"2023-10-18T19:34:38.734439+0000","last_peered":"2023-10-18T19:34:38.734439+0000","last_clean":"2023-10-18T19:34:38.734439+0000","last_became_active":"2023-10-18T19:34:20.851166+0000","last_became_peered":"2023-10-18T19:34:20.851166+0000","last_unstale":"2023-10-18T19:34:38.734439+0000","last_undegraded":"2023-10-18T19:34:38.734439+0000","last_fullsized":"2023-10-18T19:34:38.734439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733028+0000","last_change":"2023-10-18T19:34:21.245529+0000","last_active":"2023-10-18T19:34:38.733028+0000","last_peered":"2023-10-18T19:34:38.733028+0000","last_clean":"2023-10-18T19:34:38.733028+0000","last_became_active":"2023-10-18T19:34:21.245217+0000","last_became_peered":"2023-10-18T19:34:21.245217+0000","last_unstale":"2023-10-18T19:34:38.733028+0000","last_undegraded":"2023-10-18T19:34:38.733028+0000","last_fullsized":"2023-10-18T19:34:38.733028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732935+0000","last_change":"2023-10-18T19:34:20.837517+0000","last_active":"2023-10-18T19:34:38.732935+0000","last_peered":"2023-10-18T19:34:38.732935+0000","last_clean":"2023-10-18T19:34:38.732935+0000","last_became_active":"2023-10-18T19:34:20.837192+0000","last_became_peered":"2023-10-18T19:34:20.837192+0000","last_unstale":"2023-10-18T19:34:38.732935+0000","last_undegraded":"2023-10-18T19:34:38.732935+0000","last_fullsized":"2023-10-18T19:34:38.732935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279330+0000","last_change":"2023-10-18T19:34:21.262649+0000","last_active":"2023-10-18T19:34:38.279330+0000","last_peered":"2023-10-18T19:34:38.279330+0000","last_clean":"2023-10-18T19:34:38.279330+0000","last_became_active":"2023-10-18T19:34:21.262175+0000","last_became_peered":"2023-10-18T19:34:21.262175+0000","last_unstale":"2023-10-18T19:34:38.279330+0000","last_undegraded":"2023-10-18T19:34:38.279330+0000","last_fullsized":"2023-10-18T19:34:38.279330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281496+0000","last_change":"2023-10-18T19:34:20.821558+0000","last_active":"2023-10-18T19:34:38.281496+0000","last_peered":"2023-10-18T19:34:38.281496+0000","last_clean":"2023-10-18T19:34:38.281496+0000","last_became_active":"2023-10-18T19:34:20.821225+0000","last_became_peered":"2023-10-18T19:34:20.821225+0000","last_unstale":"2023-10-18T19:34:38.281496+0000","last_undegraded":"2023-10-18T19:34:38.281496+0000","last_fullsized":"2023-10-18T19:34:38.281496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733138+0000","last_change":"2023-10-18T19:34:21.268630+0000","last_active":"2023-10-18T19:34:38.733138+0000","last_peered":"2023-10-18T19:34:38.733138+0000","last_clean":"2023-10-18T19:34:38.733138+0000","last_became_active":"2023-10-18T19:34:21.268347+0000","last_became_peered":"2023-10-18T19:34:21.268347+0000","last_unstale":"2023-10-18T19:34:38.733138+0000","last_undegraded":"2023-10-18T19:34:38.733138+0000","last_fullsized":"2023-10-18T19:34:38.733138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431765+0000","last_change":"2023-10-18T19:34:20.856427+0000","last_active":"2023-10-18T19:37:15.431765+0000","last_peered":"2023-10-18T19:37:15.431765+0000","last_clean":"2023-10-18T19:37:15.431765+0000","last_became_active":"2023-10-18T19:34:20.855877+0000","last_became_peered":"2023-10-18T19:34:20.855877+0000","last_unstale":"2023-10-18T19:37:15.431765+0000","last_undegraded":"2023-10-18T19:37:15.431765+0000","last_fullsized":"2023-10-18T19:37:15.431765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431545+0000","last_change":"2023-10-18T19:34:21.259142+0000","last_active":"2023-10-18T19:37:15.431545+0000","last_peered":"2023-10-18T19:37:15.431545+0000","last_clean":"2023-10-18T19:37:15.431545+0000","last_became_active":"2023-10-18T19:34:21.258709+0000","last_became_peered":"2023-10-18T19:34:21.258709+0000","last_unstale":"2023-10-18T19:37:15.431545+0000","last_undegraded":"2023-10-18T19:37:15.431545+0000","last_fullsized":"2023-10-18T19:37:15.431545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733304+0000","last_change":"2023-10-18T19:34:20.861616+0000","last_active":"2023-10-18T19:34:38.733304+0000","last_peered":"2023-10-18T19:34:38.733304+0000","last_clean":"2023-10-18T19:34:38.733304+0000","last_became_active":"2023-10-18T19:34:20.861363+0000","last_became_peered":"2023-10-18T19:34:20.861363+0000","last_unstale":"2023-10-18T19:34:38.733304+0000","last_undegraded":"2023-10-18T19:34:38.733304+0000","last_fullsized":"2023-10-18T19:34:38.733304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733725+0000","last_change":"2023-10-18T19:34:21.267981+0000","last_active":"2023-10-18T19:34:38.733725+0000","last_peered":"2023-10-18T19:34:38.733725+0000","last_clean":"2023-10-18T19:34:38.733725+0000","last_became_active":"2023-10-18T19:34:21.267584+0000","last_became_peered":"2023-10-18T19:34:21.267584+0000","last_unstale":"2023-10-18T19:34:38.733725+0000","last_undegraded":"2023-10-18T19:34:38.733725+0000","last_fullsized":"2023-10-18T19:34:38.733725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734167+0000","last_change":"2023-10-18T19:34:20.855045+0000","last_active":"2023-10-18T19:34:38.734167+0000","last_peered":"2023-10-18T19:34:38.734167+0000","last_clean":"2023-10-18T19:34:38.734167+0000","last_became_active":"2023-10-18T19:34:20.854724+0000","last_became_peered":"2023-10-18T19:34:20.854724+0000","last_unstale":"2023-10-18T19:34:38.734167+0000","last_undegraded":"2023-10-18T19:34:38.734167+0000","last_fullsized":"2023-10-18T19:34:38.734167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432660+0000","last_change":"2023-10-18T19:34:21.262741+0000","last_active":"2023-10-18T19:37:15.432660+0000","last_peered":"2023-10-18T19:37:15.432660+0000","last_clean":"2023-10-18T19:37:15.432660+0000","last_became_active":"2023-10-18T19:34:21.262435+0000","last_became_peered":"2023-10-18T19:34:21.262435+0000","last_unstale":"2023-10-18T19:37:15.432660+0000","last_undegraded":"2023-10-18T19:37:15.432660+0000","last_fullsized":"2023-10-18T19:37:15.432660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282043+0000","last_change":"2023-10-18T19:34:20.850195+0000","last_active":"2023-10-18T19:34:38.282043+0000","last_peered":"2023-10-18T19:34:38.282043+0000","last_clean":"2023-10-18T19:34:38.282043+0000","last_became_active":"2023-10-18T19:34:20.849885+0000","last_became_peered":"2023-10-18T19:34:20.849885+0000","last_unstale":"2023-10-18T19:34:38.282043+0000","last_undegraded":"2023-10-18T19:34:38.282043+0000","last_fullsized":"2023-10-18T19:34:38.282043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734093+0000","last_change":"2023-10-18T19:34:21.248730+0000","last_active":"2023-10-18T19:34:38.734093+0000","last_peered":"2023-10-18T19:34:38.734093+0000","last_clean":"2023-10-18T19:34:38.734093+0000","last_became_active":"2023-10-18T19:34:21.248420+0000","last_became_peered":"2023-10-18T19:34:21.248420+0000","last_unstale":"2023-10-18T19:34:38.734093+0000","last_undegraded":"2023-10-18T19:34:38.734093+0000","last_fullsized":"2023-10-18T19:34:38.734093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734685+0000","last_change":"2023-10-18T19:34:20.862008+0000","last_active":"2023-10-18T19:34:38.734685+0000","last_peered":"2023-10-18T19:34:38.734685+0000","last_clean":"2023-10-18T19:34:38.734685+0000","last_became_active":"2023-10-18T19:34:20.858973+0000","last_became_peered":"2023-10-18T19:34:20.858973+0000","last_unstale":"2023-10-18T19:34:38.734685+0000","last_undegraded":"2023-10-18T19:34:38.734685+0000","last_fullsized":"2023-10-18T19:34:38.734685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282092+0000","last_change":"2023-10-18T19:34:21.259920+0000","last_active":"2023-10-18T19:34:38.282092+0000","last_peered":"2023-10-18T19:34:38.282092+0000","last_clean":"2023-10-18T19:34:38.282092+0000","last_became_active":"2023-10-18T19:34:21.259474+0000","last_became_peered":"2023-10-18T19:34:21.259474+0000","last_unstale":"2023-10-18T19:34:38.282092+0000","last_undegraded":"2023-10-18T19:34:38.282092+0000","last_fullsized":"2023-10-18T19:34:38.282092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282747+0000","last_change":"2023-10-18T19:34:20.842664+0000","last_active":"2023-10-18T19:34:38.282747+0000","last_peered":"2023-10-18T19:34:38.282747+0000","last_clean":"2023-10-18T19:34:38.282747+0000","last_became_active":"2023-10-18T19:34:20.842341+0000","last_became_peered":"2023-10-18T19:34:20.842341+0000","last_unstale":"2023-10-18T19:34:38.282747+0000","last_undegraded":"2023-10-18T19:34:38.282747+0000","last_fullsized":"2023-10-18T19:34:38.282747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":54653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35999999999999999,"15min":0.376},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.48099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.41799999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39400000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.377},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.45300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40200000000000002}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.375},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.43099999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":44912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56699999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:19.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.767+0000 7f4abe1ff700 1 Processor -- start 2023-10-18T19:37:19.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.767+0000 7f4abe1ff700 1 -- start start 2023-10-18T19:37:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.768+0000 7f4abe1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.768+0000 7f4abe1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 0x7f4ab81437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.768+0000 7f4abe1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80afd50 con 0x7f4ab80af970 2023-10-18T19:37:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.768+0000 7f4abe1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80a47a0 con 0x7f4ab80a1790 2023-10-18T19:37:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.768+0000 7f4abe1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80a3a10 con 0x7f4ab80a4c50 2023-10-18T19:37:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36422/0 (socket says 172.21.15.88:36422) 2023-10-18T19:37:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab6ffd700 1 -- 172.21.15.88:0/655430171 learned_addr learned my addr 172.21.15.88:0/655430171 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab77fe700 1 --1- 172.21.15.88:0/655430171 >> v1:172.21.15.88:6789/0 conn(0x7f4ab80af970 0x7f4ab8135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35170/0 (socket says 172.21.15.88:35170) 2023-10-18T19:37:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 --2- 172.21.15.88:0/655430171 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 0x7f4ab81437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab67fc700 1 -- 172.21.15.88:0/655430171 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853046157 0 0) 0x7f4ab80afd50 con 0x7f4ab80af970 2023-10-18T19:37:19.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 -- 172.21.15.88:0/655430171 >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 msgr2=0x7f4ab81412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 --2- 172.21.15.88:0/655430171 >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 -- 172.21.15.88:0/655430171 >> v1:172.21.15.88:6789/0 conn(0x7f4ab80af970 legacy=0x7f4ab8135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 -- 172.21.15.88:0/655430171 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80a32d0 con 0x7f4ab80a4c50 2023-10-18T19:37:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab6ffd700 1 --2- 172.21.15.88:0/655430171 >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:19.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.769+0000 7f4ab7fff700 1 --2- 172.21.15.88:0/655430171 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 0x7f4ab81437e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4ab0009e60 tx=0x7f4ab0009780).ready entity=mon.2 client_cookie=e76117ad11321e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4ab67fc700 1 -- 172.21.15.88:0/655430171 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000e070 con 0x7f4ab80a4c50 2023-10-18T19:37:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4ab67fc700 1 -- 172.21.15.88:0/655430171 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000bb60 con 0x7f4ab80a4c50 2023-10-18T19:37:19.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4ab67fc700 1 -- 172.21.15.88:0/655430171 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0012410 con 0x7f4ab80a4c50 2023-10-18T19:37:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 -- 172.21.15.88:0/655430171 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 msgr2=0x7f4ab81437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/655430171 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 0x7f4ab81437e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4ab0009e60 tx=0x7f4ab0009780).stop 2023-10-18T19:37:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 -- 172.21.15.88:0/655430171 shutdown_connections 2023-10-18T19:37:19.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/655430171 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80a4c50 0x7f4ab81437e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/655430171 >> v2:172.21.15.88:3300/0 conn(0x7f4ab80a1790 0x7f4ab81412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 -- 172.21.15.88:0/655430171 >> 172.21.15.88:0/655430171 conn(0x7f4ab805eb60 msgr2=0x7f4ab80af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 -- 172.21.15.88:0/655430171 shutdown_connections 2023-10-18T19:37:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.770+0000 7f4abe1ff700 1 -- 172.21.15.88:0/655430171 wait complete. 2023-10-18T19:37:19.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.772+0000 7f4abe1ff700 1 Processor -- start 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.772+0000 7f4abe1ff700 1 -- start start 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.772+0000 7f4abe1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ab80a1790 0x7f4ab80aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.772+0000 7f4abe1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4abe1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4abe1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80abfe0 con 0x7f4ab80a4c50 2023-10-18T19:37:19.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4abe1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab814c370 con 0x7f4ab80a1790 2023-10-18T19:37:19.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4abe1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab814cd00 con 0x7f4ab80af970 2023-10-18T19:37:19.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ab80a1790 0x7f4ab80aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36436/0 (socket says 172.21.15.88:36436) 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56310/0 (socket says 172.21.15.88:56310) 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 -- 172.21.15.88:0/1673309396 learned_addr learned my addr 172.21.15.88:0/1673309396 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 -- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 msgr2=0x7f4ab8091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 -- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ab80a1790 msgr2=0x7f4ab80aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ab80a1790 0x7f4ab80aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 -- 172.21.15.88:0/1673309396 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009370 con 0x7f4ab80a4c50 2023-10-18T19:37:19.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab7fff700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:19.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.773+0000 7f4ab6ffd700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4aac00ec80 tx=0x7f4aac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:19.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.774+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac009670 con 0x7f4ab80a4c50 2023-10-18T19:37:19.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.774+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00c850 con 0x7f4ab80a4c50 2023-10-18T19:37:19.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.774+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab0009a20 con 0x7f4ab80a4c50 2023-10-18T19:37:19.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.774+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00cbd0 con 0x7f4ab80a4c50 2023-10-18T19:37:19.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.774+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80a8d10 con 0x7f4ab80a4c50 2023-10-18T19:37:19.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.775+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab805f270 con 0x7f4ab80a4c50 2023-10-18T19:37:19.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.775+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f4aac01b400 con 0x7f4ab80a4c50 2023-10-18T19:37:19.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.776+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f4aac055ca0 con 0x7f4ab80a4c50 2023-10-18T19:37:19.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.780+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f4aac05a070 con 0x7f4ab80a4c50 2023-10-18T19:37:19.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.920+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ab80a0ce0 con 0x7f4aa4041ce0 2023-10-18T19:37:19.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.928+0000 7f4a9f7fe700 1 -- 172.21.15.88:0/1673309396 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325971 (unknown 2965378022 0 2983035873) 0x7f4ab80a0ce0 con 0x7f4aa4041ce0 2023-10-18T19:37:19.935 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:19.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 >> v1:172.21.15.88:6800/113625 conn(0x7f4aa4041ce0 legacy=0x7f4aa40441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 msgr2=0x7f4ab814c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:19.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4aac00ec80 tx=0x7f4aac0090f0).stop 2023-10-18T19:37:19.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 shutdown_connections 2023-10-18T19:37:19.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4ab80af970 0x7f4ab8091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4ab80a1790 0x7f4ab80aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 --2- 172.21.15.88:0/1673309396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ab80a4c50 0x7f4ab814c810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 >> 172.21.15.88:0/1673309396 conn(0x7f4ab805eb60 msgr2=0x7f4ab80ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 shutdown_connections 2023-10-18T19:37:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:19.932+0000 7f4abe1ff700 1 -- 172.21.15.88:0/1673309396 wait complete. 2023-10-18T19:37:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:19.952 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-18T19:37:19.354993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195048,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292312,"statfs":{"total":386547056640,"available":382251327488,"internally_reserved":4294967296,"allocated":729088,"data_stored":201443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993836"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281973+0000","last_change":"2023-10-18T19:34:21.266064+0000","last_active":"2023-10-18T19:34:38.281973+0000","last_peered":"2023-10-18T19:34:38.281973+0000","last_clean":"2023-10-18T19:34:38.281973+0000","last_became_active":"2023-10-18T19:34:21.265745+0000","last_became_peered":"2023-10-18T19:34:21.265745+0000","last_unstale":"2023-10-18T19:34:38.281973+0000","last_undegraded":"2023-10-18T19:34:38.281973+0000","last_fullsized":"2023-10-18T19:34:38.281973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.799504+0000","last_change":"2023-10-18T19:34:20.848544+0000","last_active":"2023-10-18T19:35:01.799504+0000","last_peered":"2023-10-18T19:35:01.799504+0000","last_clean":"2023-10-18T19:35:01.799504+0000","last_became_active":"2023-10-18T19:34:20.848186+0000","last_became_peered":"2023-10-18T19:34:20.848186+0000","last_unstale":"2023-10-18T19:35:01.799504+0000","last_undegraded":"2023-10-18T19:35:01.799504+0000","last_fullsized":"2023-10-18T19:35:01.799504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733305+0000","last_change":"2023-10-18T19:34:21.249452+0000","last_active":"2023-10-18T19:34:38.733305+0000","last_peered":"2023-10-18T19:34:38.733305+0000","last_clean":"2023-10-18T19:34:38.733305+0000","last_became_active":"2023-10-18T19:34:21.249103+0000","last_became_peered":"2023-10-18T19:34:21.249103+0000","last_unstale":"2023-10-18T19:34:38.733305+0000","last_undegraded":"2023-10-18T19:34:38.733305+0000","last_fullsized":"2023-10-18T19:34:38.733305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280902+0000","last_change":"2023-10-18T19:34:20.835459+0000","last_active":"2023-10-18T19:34:38.280902+0000","last_peered":"2023-10-18T19:34:38.280902+0000","last_clean":"2023-10-18T19:34:38.280902+0000","last_became_active":"2023-10-18T19:34:20.835145+0000","last_became_peered":"2023-10-18T19:34:20.835145+0000","last_unstale":"2023-10-18T19:34:38.280902+0000","last_undegraded":"2023-10-18T19:34:38.280902+0000","last_fullsized":"2023-10-18T19:34:38.280902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279296+0000","last_change":"2023-10-18T19:34:21.262486+0000","last_active":"2023-10-18T19:34:38.279296+0000","last_peered":"2023-10-18T19:34:38.279296+0000","last_clean":"2023-10-18T19:34:38.279296+0000","last_became_active":"2023-10-18T19:34:21.261956+0000","last_became_peered":"2023-10-18T19:34:21.261956+0000","last_unstale":"2023-10-18T19:34:38.279296+0000","last_undegraded":"2023-10-18T19:34:38.279296+0000","last_fullsized":"2023-10-18T19:34:38.279296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280144+0000","last_change":"2023-10-18T19:34:20.854649+0000","last_active":"2023-10-18T19:34:38.280144+0000","last_peered":"2023-10-18T19:34:38.280144+0000","last_clean":"2023-10-18T19:34:38.280144+0000","last_became_active":"2023-10-18T19:34:20.854333+0000","last_became_peered":"2023-10-18T19:34:20.854333+0000","last_unstale":"2023-10-18T19:34:38.280144+0000","last_undegraded":"2023-10-18T19:34:38.280144+0000","last_fullsized":"2023-10-18T19:34:38.280144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281669+0000","last_change":"2023-10-18T19:34:21.246025+0000","last_active":"2023-10-18T19:34:38.281669+0000","last_peered":"2023-10-18T19:34:38.281669+0000","last_clean":"2023-10-18T19:34:38.281669+0000","last_became_active":"2023-10-18T19:34:21.245735+0000","last_became_peered":"2023-10-18T19:34:21.245735+0000","last_unstale":"2023-10-18T19:34:38.281669+0000","last_undegraded":"2023-10-18T19:34:38.281669+0000","last_fullsized":"2023-10-18T19:34:38.281669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279099+0000","last_change":"2023-10-18T19:34:20.853312+0000","last_active":"2023-10-18T19:34:38.279099+0000","last_peered":"2023-10-18T19:34:38.279099+0000","last_clean":"2023-10-18T19:34:38.279099+0000","last_became_active":"2023-10-18T19:34:20.852964+0000","last_became_peered":"2023-10-18T19:34:20.852964+0000","last_unstale":"2023-10-18T19:34:38.279099+0000","last_undegraded":"2023-10-18T19:34:38.279099+0000","last_fullsized":"2023-10-18T19:34:38.279099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432978+0000","last_change":"2023-10-18T19:34:21.265408+0000","last_active":"2023-10-18T19:37:15.432978+0000","last_peered":"2023-10-18T19:37:15.432978+0000","last_clean":"2023-10-18T19:37:15.432978+0000","last_became_active":"2023-10-18T19:34:21.265029+0000","last_became_peered":"2023-10-18T19:34:21.265029+0000","last_unstale":"2023-10-18T19:37:15.432978+0000","last_undegraded":"2023-10-18T19:37:15.432978+0000","last_fullsized":"2023-10-18T19:37:15.432978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:11.800534+0000","last_change":"2023-10-18T19:34:20.825709+0000","last_active":"2023-10-18T19:35:11.800534+0000","last_peered":"2023-10-18T19:35:11.800534+0000","last_clean":"2023-10-18T19:35:11.800534+0000","last_became_active":"2023-10-18T19:34:20.825364+0000","last_became_peered":"2023-10-18T19:34:20.825364+0000","last_unstale":"2023-10-18T19:35:11.800534+0000","last_undegraded":"2023-10-18T19:35:11.800534+0000","last_fullsized":"2023-10-18T19:35:11.800534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734181+0000","last_change":"2023-10-18T19:34:21.250032+0000","last_active":"2023-10-18T19:34:38.734181+0000","last_peered":"2023-10-18T19:34:38.734181+0000","last_clean":"2023-10-18T19:34:38.734181+0000","last_became_active":"2023-10-18T19:34:21.245104+0000","last_became_peered":"2023-10-18T19:34:21.245104+0000","last_unstale":"2023-10-18T19:34:38.734181+0000","last_undegraded":"2023-10-18T19:34:38.734181+0000","last_fullsized":"2023-10-18T19:34:38.734181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734258+0000","last_change":"2023-10-18T19:34:20.862583+0000","last_active":"2023-10-18T19:34:38.734258+0000","last_peered":"2023-10-18T19:34:38.734258+0000","last_clean":"2023-10-18T19:34:38.734258+0000","last_became_active":"2023-10-18T19:34:20.862262+0000","last_became_peered":"2023-10-18T19:34:20.862262+0000","last_unstale":"2023-10-18T19:34:38.734258+0000","last_undegraded":"2023-10-18T19:34:38.734258+0000","last_fullsized":"2023-10-18T19:34:38.734258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281992+0000","last_change":"2023-10-18T19:34:21.265750+0000","last_active":"2023-10-18T19:34:38.281992+0000","last_peered":"2023-10-18T19:34:38.281992+0000","last_clean":"2023-10-18T19:34:38.281992+0000","last_became_active":"2023-10-18T19:34:21.265449+0000","last_became_peered":"2023-10-18T19:34:21.265449+0000","last_unstale":"2023-10-18T19:34:38.281992+0000","last_undegraded":"2023-10-18T19:34:38.281992+0000","last_fullsized":"2023-10-18T19:34:38.281992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281687+0000","last_change":"2023-10-18T19:34:20.855201+0000","last_active":"2023-10-18T19:34:38.281687+0000","last_peered":"2023-10-18T19:34:38.281687+0000","last_clean":"2023-10-18T19:34:38.281687+0000","last_became_active":"2023-10-18T19:34:20.854344+0000","last_became_peered":"2023-10-18T19:34:20.854344+0000","last_unstale":"2023-10-18T19:34:38.281687+0000","last_undegraded":"2023-10-18T19:34:38.281687+0000","last_fullsized":"2023-10-18T19:34:38.281687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734008+0000","last_change":"2023-10-18T19:34:21.249688+0000","last_active":"2023-10-18T19:34:38.734008+0000","last_peered":"2023-10-18T19:34:38.734008+0000","last_clean":"2023-10-18T19:34:38.734008+0000","last_became_active":"2023-10-18T19:34:21.246078+0000","last_became_peered":"2023-10-18T19:34:21.246078+0000","last_unstale":"2023-10-18T19:34:38.734008+0000","last_undegraded":"2023-10-18T19:34:38.734008+0000","last_fullsized":"2023-10-18T19:34:38.734008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.434758+0000","last_change":"2023-10-18T19:34:20.857791+0000","last_active":"2023-10-18T19:37:15.434758+0000","last_peered":"2023-10-18T19:37:15.434758+0000","last_clean":"2023-10-18T19:37:15.434758+0000","last_became_active":"2023-10-18T19:34:20.857489+0000","last_became_peered":"2023-10-18T19:34:20.857489+0000","last_unstale":"2023-10-18T19:37:15.434758+0000","last_undegraded":"2023-10-18T19:37:15.434758+0000","last_fullsized":"2023-10-18T19:37:15.434758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733296+0000","last_change":"2023-10-18T19:34:21.245879+0000","last_active":"2023-10-18T19:34:38.733296+0000","last_peered":"2023-10-18T19:34:38.733296+0000","last_clean":"2023-10-18T19:34:38.733296+0000","last_became_active":"2023-10-18T19:34:21.245587+0000","last_became_peered":"2023-10-18T19:34:21.245587+0000","last_unstale":"2023-10-18T19:34:38.733296+0000","last_undegraded":"2023-10-18T19:34:38.733296+0000","last_fullsized":"2023-10-18T19:34:38.733296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733510+0000","last_change":"2023-10-18T19:34:20.857559+0000","last_active":"2023-10-18T19:34:38.733510+0000","last_peered":"2023-10-18T19:34:38.733510+0000","last_clean":"2023-10-18T19:34:38.733510+0000","last_became_active":"2023-10-18T19:34:20.857227+0000","last_became_peered":"2023-10-18T19:34:20.857227+0000","last_unstale":"2023-10-18T19:34:38.733510+0000","last_undegraded":"2023-10-18T19:34:38.733510+0000","last_fullsized":"2023-10-18T19:34:38.733510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281235+0000","last_change":"2023-10-18T19:34:21.258745+0000","last_active":"2023-10-18T19:34:38.281235+0000","last_peered":"2023-10-18T19:34:38.281235+0000","last_clean":"2023-10-18T19:34:38.281235+0000","last_became_active":"2023-10-18T19:34:21.258295+0000","last_became_peered":"2023-10-18T19:34:21.258295+0000","last_unstale":"2023-10-18T19:34:38.281235+0000","last_undegraded":"2023-10-18T19:34:38.281235+0000","last_fullsized":"2023-10-18T19:34:38.281235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281065+0000","last_change":"2023-10-18T19:34:20.836255+0000","last_active":"2023-10-18T19:34:38.281065+0000","last_peered":"2023-10-18T19:34:38.281065+0000","last_clean":"2023-10-18T19:34:38.281065+0000","last_became_active":"2023-10-18T19:34:20.835941+0000","last_became_peered":"2023-10-18T19:34:20.835941+0000","last_unstale":"2023-10-18T19:34:38.281065+0000","last_undegraded":"2023-10-18T19:34:38.281065+0000","last_fullsized":"2023-10-18T19:34:38.281065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281432+0000","last_change":"2023-10-18T19:34:21.253538+0000","last_active":"2023-10-18T19:34:38.281432+0000","last_peered":"2023-10-18T19:34:38.281432+0000","last_clean":"2023-10-18T19:34:38.281432+0000","last_became_active":"2023-10-18T19:34:21.253274+0000","last_became_peered":"2023-10-18T19:34:21.253274+0000","last_unstale":"2023-10-18T19:34:38.281432+0000","last_undegraded":"2023-10-18T19:34:38.281432+0000","last_fullsized":"2023-10-18T19:34:38.281432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733135+0000","last_change":"2023-10-18T19:34:20.857139+0000","last_active":"2023-10-18T19:34:38.733135+0000","last_peered":"2023-10-18T19:34:38.733135+0000","last_clean":"2023-10-18T19:34:38.733135+0000","last_became_active":"2023-10-18T19:34:20.856766+0000","last_became_peered":"2023-10-18T19:34:20.856766+0000","last_unstale":"2023-10-18T19:34:38.733135+0000","last_undegraded":"2023-10-18T19:34:38.733135+0000","last_fullsized":"2023-10-18T19:34:38.733135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280240+0000","last_change":"2023-10-18T19:34:21.272980+0000","last_active":"2023-10-18T19:34:38.280240+0000","last_peered":"2023-10-18T19:34:38.280240+0000","last_clean":"2023-10-18T19:34:38.280240+0000","last_became_active":"2023-10-18T19:34:21.272618+0000","last_became_peered":"2023-10-18T19:34:21.272618+0000","last_unstale":"2023-10-18T19:34:38.280240+0000","last_undegraded":"2023-10-18T19:34:38.280240+0000","last_fullsized":"2023-10-18T19:34:38.280240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430950+0000","last_change":"2023-10-18T19:34:20.828547+0000","last_active":"2023-10-18T19:37:15.430950+0000","last_peered":"2023-10-18T19:37:15.430950+0000","last_clean":"2023-10-18T19:37:15.430950+0000","last_became_active":"2023-10-18T19:34:20.828036+0000","last_became_peered":"2023-10-18T19:34:20.828036+0000","last_unstale":"2023-10-18T19:37:15.430950+0000","last_undegraded":"2023-10-18T19:37:15.430950+0000","last_fullsized":"2023-10-18T19:37:15.430950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432549+0000","last_change":"2023-10-18T19:34:21.265823+0000","last_active":"2023-10-18T19:37:15.432549+0000","last_peered":"2023-10-18T19:37:15.432549+0000","last_clean":"2023-10-18T19:37:15.432549+0000","last_became_active":"2023-10-18T19:34:21.265276+0000","last_became_peered":"2023-10-18T19:34:21.265276+0000","last_unstale":"2023-10-18T19:37:15.432549+0000","last_undegraded":"2023-10-18T19:37:15.432549+0000","last_fullsized":"2023-10-18T19:37:15.432549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734440+0000","last_change":"2023-10-18T19:34:20.856792+0000","last_active":"2023-10-18T19:34:38.734440+0000","last_peered":"2023-10-18T19:34:38.734440+0000","last_clean":"2023-10-18T19:34:38.734440+0000","last_became_active":"2023-10-18T19:34:20.856486+0000","last_became_peered":"2023-10-18T19:34:20.856486+0000","last_unstale":"2023-10-18T19:34:38.734440+0000","last_undegraded":"2023-10-18T19:34:38.734440+0000","last_fullsized":"2023-10-18T19:34:38.734440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734257+0000","last_change":"2023-10-18T19:34:21.265884+0000","last_active":"2023-10-18T19:34:38.734257+0000","last_peered":"2023-10-18T19:34:38.734257+0000","last_clean":"2023-10-18T19:34:38.734257+0000","last_became_active":"2023-10-18T19:34:21.265564+0000","last_became_peered":"2023-10-18T19:34:21.265564+0000","last_unstale":"2023-10-18T19:34:38.734257+0000","last_undegraded":"2023-10-18T19:34:38.734257+0000","last_fullsized":"2023-10-18T19:34:38.734257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432913+0000","last_change":"2023-10-18T19:34:20.858811+0000","last_active":"2023-10-18T19:37:15.432913+0000","last_peered":"2023-10-18T19:37:15.432913+0000","last_clean":"2023-10-18T19:37:15.432913+0000","last_became_active":"2023-10-18T19:34:20.858481+0000","last_became_peered":"2023-10-18T19:34:20.858481+0000","last_unstale":"2023-10-18T19:37:15.432913+0000","last_undegraded":"2023-10-18T19:37:15.432913+0000","last_fullsized":"2023-10-18T19:37:15.432913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733566+0000","last_change":"2023-10-18T19:34:21.246195+0000","last_active":"2023-10-18T19:34:38.733566+0000","last_peered":"2023-10-18T19:34:38.733566+0000","last_clean":"2023-10-18T19:34:38.733566+0000","last_became_active":"2023-10-18T19:34:21.245896+0000","last_became_peered":"2023-10-18T19:34:21.245896+0000","last_unstale":"2023-10-18T19:34:38.733566+0000","last_undegraded":"2023-10-18T19:34:38.733566+0000","last_fullsized":"2023-10-18T19:34:38.733566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281781+0000","last_change":"2023-10-18T19:34:20.855423+0000","last_active":"2023-10-18T19:34:38.281781+0000","last_peered":"2023-10-18T19:34:38.281781+0000","last_clean":"2023-10-18T19:34:38.281781+0000","last_became_active":"2023-10-18T19:34:20.854593+0000","last_became_peered":"2023-10-18T19:34:20.854593+0000","last_unstale":"2023-10-18T19:34:38.281781+0000","last_undegraded":"2023-10-18T19:34:38.281781+0000","last_fullsized":"2023-10-18T19:34:38.281781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282176+0000","last_change":"2023-10-18T19:34:21.256949+0000","last_active":"2023-10-18T19:34:38.282176+0000","last_peered":"2023-10-18T19:34:38.282176+0000","last_clean":"2023-10-18T19:34:38.282176+0000","last_became_active":"2023-10-18T19:34:21.256623+0000","last_became_peered":"2023-10-18T19:34:21.256623+0000","last_unstale":"2023-10-18T19:34:38.282176+0000","last_undegraded":"2023-10-18T19:34:38.282176+0000","last_fullsized":"2023-10-18T19:34:38.282176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433109+0000","last_change":"2023-10-18T19:34:20.846802+0000","last_active":"2023-10-18T19:37:15.433109+0000","last_peered":"2023-10-18T19:37:15.433109+0000","last_clean":"2023-10-18T19:37:15.433109+0000","last_became_active":"2023-10-18T19:34:20.846249+0000","last_became_peered":"2023-10-18T19:34:20.846249+0000","last_unstale":"2023-10-18T19:37:15.433109+0000","last_undegraded":"2023-10-18T19:37:15.433109+0000","last_fullsized":"2023-10-18T19:37:15.433109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280549+0000","last_change":"2023-10-18T19:34:21.258895+0000","last_active":"2023-10-18T19:34:38.280549+0000","last_peered":"2023-10-18T19:34:38.280549+0000","last_clean":"2023-10-18T19:34:38.280549+0000","last_became_active":"2023-10-18T19:34:21.256384+0000","last_became_peered":"2023-10-18T19:34:21.256384+0000","last_unstale":"2023-10-18T19:34:38.280549+0000","last_undegraded":"2023-10-18T19:34:38.280549+0000","last_fullsized":"2023-10-18T19:34:38.280549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280964+0000","last_change":"2023-10-18T19:34:20.850016+0000","last_active":"2023-10-18T19:34:38.280964+0000","last_peered":"2023-10-18T19:34:38.280964+0000","last_clean":"2023-10-18T19:34:38.280964+0000","last_became_active":"2023-10-18T19:34:20.849501+0000","last_became_peered":"2023-10-18T19:34:20.849501+0000","last_unstale":"2023-10-18T19:34:38.280964+0000","last_undegraded":"2023-10-18T19:34:38.280964+0000","last_fullsized":"2023-10-18T19:34:38.280964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281151+0000","last_change":"2023-10-18T19:34:21.258646+0000","last_active":"2023-10-18T19:34:38.281151+0000","last_peered":"2023-10-18T19:34:38.281151+0000","last_clean":"2023-10-18T19:34:38.281151+0000","last_became_active":"2023-10-18T19:34:21.257999+0000","last_became_peered":"2023-10-18T19:34:21.257999+0000","last_unstale":"2023-10-18T19:34:38.281151+0000","last_undegraded":"2023-10-18T19:34:38.281151+0000","last_fullsized":"2023-10-18T19:34:38.281151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281871+0000","last_change":"2023-10-18T19:34:20.856264+0000","last_active":"2023-10-18T19:34:38.281871+0000","last_peered":"2023-10-18T19:34:38.281871+0000","last_clean":"2023-10-18T19:34:38.281871+0000","last_became_active":"2023-10-18T19:34:20.856072+0000","last_became_peered":"2023-10-18T19:34:20.856072+0000","last_unstale":"2023-10-18T19:34:38.281871+0000","last_undegraded":"2023-10-18T19:34:38.281871+0000","last_fullsized":"2023-10-18T19:34:38.281871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279415+0000","last_change":"2023-10-18T19:34:21.242536+0000","last_active":"2023-10-18T19:34:38.279415+0000","last_peered":"2023-10-18T19:34:38.279415+0000","last_clean":"2023-10-18T19:34:38.279415+0000","last_became_active":"2023-10-18T19:34:21.242187+0000","last_became_peered":"2023-10-18T19:34:21.242187+0000","last_unstale":"2023-10-18T19:34:38.279415+0000","last_undegraded":"2023-10-18T19:34:38.279415+0000","last_fullsized":"2023-10-18T19:34:38.279415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281401+0000","last_change":"2023-10-18T19:34:20.844847+0000","last_active":"2023-10-18T19:34:38.281401+0000","last_peered":"2023-10-18T19:34:38.281401+0000","last_clean":"2023-10-18T19:34:38.281401+0000","last_became_active":"2023-10-18T19:34:20.844528+0000","last_became_peered":"2023-10-18T19:34:20.844528+0000","last_unstale":"2023-10-18T19:34:38.281401+0000","last_undegraded":"2023-10-18T19:34:38.281401+0000","last_fullsized":"2023-10-18T19:34:38.281401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280217+0000","last_change":"2023-10-18T19:34:21.272824+0000","last_active":"2023-10-18T19:34:38.280217+0000","last_peered":"2023-10-18T19:34:38.280217+0000","last_clean":"2023-10-18T19:34:38.280217+0000","last_became_active":"2023-10-18T19:34:21.272631+0000","last_became_peered":"2023-10-18T19:34:21.272631+0000","last_unstale":"2023-10-18T19:34:38.280217+0000","last_undegraded":"2023-10-18T19:34:38.280217+0000","last_fullsized":"2023-10-18T19:34:38.280217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732827+0000","last_change":"2023-10-18T19:34:20.833452+0000","last_active":"2023-10-18T19:34:38.732827+0000","last_peered":"2023-10-18T19:34:38.732827+0000","last_clean":"2023-10-18T19:34:38.732827+0000","last_became_active":"2023-10-18T19:34:20.832840+0000","last_became_peered":"2023-10-18T19:34:20.832840+0000","last_unstale":"2023-10-18T19:34:38.732827+0000","last_undegraded":"2023-10-18T19:34:38.732827+0000","last_fullsized":"2023-10-18T19:34:38.732827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-18T19:37:16.342037+0000","last_change":"2023-10-18T19:37:16.342037+0000","last_active":"2023-10-18T19:37:16.342037+0000","last_peered":"2023-10-18T19:37:16.342037+0000","last_clean":"2023-10-18T19:37:16.342037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-18T19:37:16.342037+0000","last_undegraded":"2023-10-18T19:37:16.342037+0000","last_fullsized":"2023-10-18T19:37:16.342037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282848+0000","last_change":"2023-10-18T19:34:21.255174+0000","last_active":"2023-10-18T19:34:38.282848+0000","last_peered":"2023-10-18T19:34:38.282848+0000","last_clean":"2023-10-18T19:34:38.282848+0000","last_became_active":"2023-10-18T19:34:21.252377+0000","last_became_peered":"2023-10-18T19:34:21.252377+0000","last_unstale":"2023-10-18T19:34:38.282848+0000","last_undegraded":"2023-10-18T19:34:38.282848+0000","last_fullsized":"2023-10-18T19:34:38.282848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432775+0000","last_change":"2023-10-18T19:34:11.535715+0000","last_active":"2023-10-18T19:37:15.432775+0000","last_peered":"2023-10-18T19:37:15.432775+0000","last_clean":"2023-10-18T19:37:15.432775+0000","last_became_active":"2023-10-18T19:34:11.534518+0000","last_became_peered":"2023-10-18T19:34:11.534518+0000","last_unstale":"2023-10-18T19:37:15.432775+0000","last_undegraded":"2023-10-18T19:37:15.432775+0000","last_fullsized":"2023-10-18T19:37:15.432775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282276+0000","last_change":"2023-10-18T19:34:20.857782+0000","last_active":"2023-10-18T19:34:38.282276+0000","last_peered":"2023-10-18T19:34:38.282276+0000","last_clean":"2023-10-18T19:34:38.282276+0000","last_became_active":"2023-10-18T19:34:20.853192+0000","last_became_peered":"2023-10-18T19:34:20.853192+0000","last_unstale":"2023-10-18T19:34:38.282276+0000","last_undegraded":"2023-10-18T19:34:38.282276+0000","last_fullsized":"2023-10-18T19:34:38.282276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734825+0000","last_change":"2023-10-18T19:34:21.257423+0000","last_active":"2023-10-18T19:34:38.734825+0000","last_peered":"2023-10-18T19:34:38.734825+0000","last_clean":"2023-10-18T19:34:38.734825+0000","last_became_active":"2023-10-18T19:34:21.256448+0000","last_became_peered":"2023-10-18T19:34:21.256448+0000","last_unstale":"2023-10-18T19:34:38.734825+0000","last_undegraded":"2023-10-18T19:34:38.734825+0000","last_fullsized":"2023-10-18T19:34:38.734825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282069+0000","last_change":"2023-10-18T19:34:11.532756+0000","last_active":"2023-10-18T19:34:38.282069+0000","last_peered":"2023-10-18T19:34:38.282069+0000","last_clean":"2023-10-18T19:34:38.282069+0000","last_became_active":"2023-10-18T19:34:11.532425+0000","last_became_peered":"2023-10-18T19:34:11.532425+0000","last_unstale":"2023-10-18T19:34:38.282069+0000","last_undegraded":"2023-10-18T19:34:38.282069+0000","last_fullsized":"2023-10-18T19:34:38.282069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.852964+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.852642+0000","last_became_peered":"2023-10-18T19:34:20.852642+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281876+0000","last_change":"2023-10-18T19:34:11.534856+0000","last_active":"2023-10-18T19:34:38.281876+0000","last_peered":"2023-10-18T19:34:38.281876+0000","last_clean":"2023-10-18T19:34:38.281876+0000","last_became_active":"2023-10-18T19:34:11.534541+0000","last_became_peered":"2023-10-18T19:34:11.534541+0000","last_unstale":"2023-10-18T19:34:38.281876+0000","last_undegraded":"2023-10-18T19:34:38.281876+0000","last_fullsized":"2023-10-18T19:34:38.281876+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279117+0000","last_change":"2023-10-18T19:34:20.847678+0000","last_active":"2023-10-18T19:34:38.279117+0000","last_peered":"2023-10-18T19:34:38.279117+0000","last_clean":"2023-10-18T19:34:38.279117+0000","last_became_active":"2023-10-18T19:34:20.847107+0000","last_became_peered":"2023-10-18T19:34:20.847107+0000","last_unstale":"2023-10-18T19:34:38.279117+0000","last_undegraded":"2023-10-18T19:34:38.279117+0000","last_fullsized":"2023-10-18T19:34:38.279117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733124+0000","last_change":"2023-10-18T19:34:21.255564+0000","last_active":"2023-10-18T19:34:38.733124+0000","last_peered":"2023-10-18T19:34:38.733124+0000","last_clean":"2023-10-18T19:34:38.733124+0000","last_became_active":"2023-10-18T19:34:21.255230+0000","last_became_peered":"2023-10-18T19:34:21.255230+0000","last_unstale":"2023-10-18T19:34:38.733124+0000","last_undegraded":"2023-10-18T19:34:38.733124+0000","last_fullsized":"2023-10-18T19:34:38.733124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733197+0000","last_change":"2023-10-18T19:34:11.535128+0000","last_active":"2023-10-18T19:34:38.733197+0000","last_peered":"2023-10-18T19:34:38.733197+0000","last_clean":"2023-10-18T19:34:38.733197+0000","last_became_active":"2023-10-18T19:34:11.534248+0000","last_became_peered":"2023-10-18T19:34:11.534248+0000","last_unstale":"2023-10-18T19:34:38.733197+0000","last_undegraded":"2023-10-18T19:34:38.733197+0000","last_fullsized":"2023-10-18T19:34:38.733197+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431228+0000","last_change":"2023-10-18T19:34:20.855194+0000","last_active":"2023-10-18T19:37:15.431228+0000","last_peered":"2023-10-18T19:37:15.431228+0000","last_clean":"2023-10-18T19:37:15.431228+0000","last_became_active":"2023-10-18T19:34:20.854897+0000","last_became_peered":"2023-10-18T19:34:20.854897+0000","last_unstale":"2023-10-18T19:37:15.431228+0000","last_undegraded":"2023-10-18T19:37:15.431228+0000","last_fullsized":"2023-10-18T19:37:15.431228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281390+0000","last_change":"2023-10-18T19:34:21.270017+0000","last_active":"2023-10-18T19:34:38.281390+0000","last_peered":"2023-10-18T19:34:38.281390+0000","last_clean":"2023-10-18T19:34:38.281390+0000","last_became_active":"2023-10-18T19:34:21.269485+0000","last_became_peered":"2023-10-18T19:34:21.269485+0000","last_unstale":"2023-10-18T19:34:38.281390+0000","last_undegraded":"2023-10-18T19:34:38.281390+0000","last_fullsized":"2023-10-18T19:34:38.281390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281541+0000","last_change":"2023-10-18T19:34:11.532872+0000","last_active":"2023-10-18T19:34:38.281541+0000","last_peered":"2023-10-18T19:34:38.281541+0000","last_clean":"2023-10-18T19:34:38.281541+0000","last_became_active":"2023-10-18T19:34:11.531562+0000","last_became_peered":"2023-10-18T19:34:11.531562+0000","last_unstale":"2023-10-18T19:34:38.281541+0000","last_undegraded":"2023-10-18T19:34:38.281541+0000","last_fullsized":"2023-10-18T19:34:38.281541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:06.799201+0000","last_change":"2023-10-18T19:34:20.852891+0000","last_active":"2023-10-18T19:35:06.799201+0000","last_peered":"2023-10-18T19:35:06.799201+0000","last_clean":"2023-10-18T19:35:06.799201+0000","last_became_active":"2023-10-18T19:34:20.852426+0000","last_became_peered":"2023-10-18T19:34:20.852426+0000","last_unstale":"2023-10-18T19:35:06.799201+0000","last_undegraded":"2023-10-18T19:35:06.799201+0000","last_fullsized":"2023-10-18T19:35:06.799201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280643+0000","last_change":"2023-10-18T19:34:21.266390+0000","last_active":"2023-10-18T19:34:38.280643+0000","last_peered":"2023-10-18T19:34:38.280643+0000","last_clean":"2023-10-18T19:34:38.280643+0000","last_became_active":"2023-10-18T19:34:21.266089+0000","last_became_peered":"2023-10-18T19:34:21.266089+0000","last_unstale":"2023-10-18T19:34:38.280643+0000","last_undegraded":"2023-10-18T19:34:38.280643+0000","last_fullsized":"2023-10-18T19:34:38.280643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279963+0000","last_change":"2023-10-18T19:34:11.532565+0000","last_active":"2023-10-18T19:34:38.279963+0000","last_peered":"2023-10-18T19:34:38.279963+0000","last_clean":"2023-10-18T19:34:38.279963+0000","last_became_active":"2023-10-18T19:34:11.532168+0000","last_became_peered":"2023-10-18T19:34:11.532168+0000","last_unstale":"2023-10-18T19:34:38.279963+0000","last_undegraded":"2023-10-18T19:34:38.279963+0000","last_fullsized":"2023-10-18T19:34:38.279963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280817+0000","last_change":"2023-10-18T19:34:20.852330+0000","last_active":"2023-10-18T19:34:38.280817+0000","last_peered":"2023-10-18T19:34:38.280817+0000","last_clean":"2023-10-18T19:34:38.280817+0000","last_became_active":"2023-10-18T19:34:20.851992+0000","last_became_peered":"2023-10-18T19:34:20.851992+0000","last_unstale":"2023-10-18T19:34:38.280817+0000","last_undegraded":"2023-10-18T19:34:38.280817+0000","last_fullsized":"2023-10-18T19:34:38.280817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733604+0000","last_change":"2023-10-18T19:34:21.264314+0000","last_active":"2023-10-18T19:34:38.733604+0000","last_peered":"2023-10-18T19:34:38.733604+0000","last_clean":"2023-10-18T19:34:38.733604+0000","last_became_active":"2023-10-18T19:34:21.263937+0000","last_became_peered":"2023-10-18T19:34:21.263937+0000","last_unstale":"2023-10-18T19:34:38.733604+0000","last_undegraded":"2023-10-18T19:34:38.733604+0000","last_fullsized":"2023-10-18T19:34:38.733604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282680+0000","last_change":"2023-10-18T19:34:11.533453+0000","last_active":"2023-10-18T19:34:38.282680+0000","last_peered":"2023-10-18T19:34:38.282680+0000","last_clean":"2023-10-18T19:34:38.282680+0000","last_became_active":"2023-10-18T19:34:11.532769+0000","last_became_peered":"2023-10-18T19:34:11.532769+0000","last_unstale":"2023-10-18T19:34:38.282680+0000","last_undegraded":"2023-10-18T19:34:38.282680+0000","last_fullsized":"2023-10-18T19:34:38.282680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282101+0000","last_change":"2023-10-18T19:34:20.853145+0000","last_active":"2023-10-18T19:34:38.282101+0000","last_peered":"2023-10-18T19:34:38.282101+0000","last_clean":"2023-10-18T19:34:38.282101+0000","last_became_active":"2023-10-18T19:34:20.852683+0000","last_became_peered":"2023-10-18T19:34:20.852683+0000","last_unstale":"2023-10-18T19:34:38.282101+0000","last_undegraded":"2023-10-18T19:34:38.282101+0000","last_fullsized":"2023-10-18T19:34:38.282101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282182+0000","last_change":"2023-10-18T19:34:21.266346+0000","last_active":"2023-10-18T19:34:38.282182+0000","last_peered":"2023-10-18T19:34:38.282182+0000","last_clean":"2023-10-18T19:34:38.282182+0000","last_became_active":"2023-10-18T19:34:21.265950+0000","last_became_peered":"2023-10-18T19:34:21.265950+0000","last_unstale":"2023-10-18T19:34:38.282182+0000","last_undegraded":"2023-10-18T19:34:38.282182+0000","last_fullsized":"2023-10-18T19:34:38.282182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282658+0000","last_change":"2023-10-18T19:34:11.533454+0000","last_active":"2023-10-18T19:34:38.282658+0000","last_peered":"2023-10-18T19:34:38.282658+0000","last_clean":"2023-10-18T19:34:38.282658+0000","last_became_active":"2023-10-18T19:34:11.533123+0000","last_became_peered":"2023-10-18T19:34:11.533123+0000","last_unstale":"2023-10-18T19:34:38.282658+0000","last_undegraded":"2023-10-18T19:34:38.282658+0000","last_fullsized":"2023-10-18T19:34:38.282658+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281898+0000","last_change":"2023-10-18T19:34:20.844955+0000","last_active":"2023-10-18T19:34:38.281898+0000","last_peered":"2023-10-18T19:34:38.281898+0000","last_clean":"2023-10-18T19:34:38.281898+0000","last_became_active":"2023-10-18T19:34:20.844711+0000","last_became_peered":"2023-10-18T19:34:20.844711+0000","last_unstale":"2023-10-18T19:34:38.281898+0000","last_undegraded":"2023-10-18T19:34:38.281898+0000","last_fullsized":"2023-10-18T19:34:38.281898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431387+0000","last_change":"2023-10-18T19:34:21.256370+0000","last_active":"2023-10-18T19:37:15.431387+0000","last_peered":"2023-10-18T19:37:15.431387+0000","last_clean":"2023-10-18T19:37:15.431387+0000","last_became_active":"2023-10-18T19:34:21.256084+0000","last_became_peered":"2023-10-18T19:34:21.256084+0000","last_unstale":"2023-10-18T19:37:15.431387+0000","last_undegraded":"2023-10-18T19:37:15.431387+0000","last_fullsized":"2023-10-18T19:37:15.431387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282545+0000","last_change":"2023-10-18T19:34:21.253778+0000","last_active":"2023-10-18T19:34:38.282545+0000","last_peered":"2023-10-18T19:34:38.282545+0000","last_clean":"2023-10-18T19:34:38.282545+0000","last_became_active":"2023-10-18T19:34:21.251946+0000","last_became_peered":"2023-10-18T19:34:21.251946+0000","last_unstale":"2023-10-18T19:34:38.282545+0000","last_undegraded":"2023-10-18T19:34:38.282545+0000","last_fullsized":"2023-10-18T19:34:38.282545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733900+0000","last_change":"2023-10-18T19:34:20.862585+0000","last_active":"2023-10-18T19:34:38.733900+0000","last_peered":"2023-10-18T19:34:38.733900+0000","last_clean":"2023-10-18T19:34:38.733900+0000","last_became_active":"2023-10-18T19:34:20.862326+0000","last_became_peered":"2023-10-18T19:34:20.862326+0000","last_unstale":"2023-10-18T19:34:38.733900+0000","last_undegraded":"2023-10-18T19:34:38.733900+0000","last_fullsized":"2023-10-18T19:34:38.733900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281804+0000","last_change":"2023-10-18T19:34:21.259196+0000","last_active":"2023-10-18T19:34:38.281804+0000","last_peered":"2023-10-18T19:34:38.281804+0000","last_clean":"2023-10-18T19:34:38.281804+0000","last_became_active":"2023-10-18T19:34:21.258884+0000","last_became_peered":"2023-10-18T19:34:21.258884+0000","last_unstale":"2023-10-18T19:34:38.281804+0000","last_undegraded":"2023-10-18T19:34:38.281804+0000","last_fullsized":"2023-10-18T19:34:38.281804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733897+0000","last_change":"2023-10-18T19:34:20.863893+0000","last_active":"2023-10-18T19:34:38.733897+0000","last_peered":"2023-10-18T19:34:38.733897+0000","last_clean":"2023-10-18T19:34:38.733897+0000","last_became_active":"2023-10-18T19:34:20.863549+0000","last_became_peered":"2023-10-18T19:34:20.863549+0000","last_unstale":"2023-10-18T19:34:38.733897+0000","last_undegraded":"2023-10-18T19:34:38.733897+0000","last_fullsized":"2023-10-18T19:34:38.733897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734602+0000","last_change":"2023-10-18T19:34:21.261264+0000","last_active":"2023-10-18T19:34:38.734602+0000","last_peered":"2023-10-18T19:34:38.734602+0000","last_clean":"2023-10-18T19:34:38.734602+0000","last_became_active":"2023-10-18T19:34:21.260951+0000","last_became_peered":"2023-10-18T19:34:21.260951+0000","last_unstale":"2023-10-18T19:34:38.734602+0000","last_undegraded":"2023-10-18T19:34:38.734602+0000","last_fullsized":"2023-10-18T19:34:38.734602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.853421+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.853091+0000","last_became_peered":"2023-10-18T19:34:20.853091+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282564+0000","last_change":"2023-10-18T19:34:21.274214+0000","last_active":"2023-10-18T19:34:38.282564+0000","last_peered":"2023-10-18T19:34:38.282564+0000","last_clean":"2023-10-18T19:34:38.282564+0000","last_became_active":"2023-10-18T19:34:21.273899+0000","last_became_peered":"2023-10-18T19:34:21.273899+0000","last_unstale":"2023-10-18T19:34:38.282564+0000","last_undegraded":"2023-10-18T19:34:38.282564+0000","last_fullsized":"2023-10-18T19:34:38.282564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734358+0000","last_change":"2023-10-18T19:34:20.860150+0000","last_active":"2023-10-18T19:34:38.734358+0000","last_peered":"2023-10-18T19:34:38.734358+0000","last_clean":"2023-10-18T19:34:38.734358+0000","last_became_active":"2023-10-18T19:34:20.859836+0000","last_became_peered":"2023-10-18T19:34:20.859836+0000","last_unstale":"2023-10-18T19:34:38.734358+0000","last_undegraded":"2023-10-18T19:34:38.734358+0000","last_fullsized":"2023-10-18T19:34:38.734358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432488+0000","last_change":"2023-10-18T19:34:21.260022+0000","last_active":"2023-10-18T19:37:15.432488+0000","last_peered":"2023-10-18T19:37:15.432488+0000","last_clean":"2023-10-18T19:37:15.432488+0000","last_became_active":"2023-10-18T19:34:21.259630+0000","last_became_peered":"2023-10-18T19:34:21.259630+0000","last_unstale":"2023-10-18T19:37:15.432488+0000","last_undegraded":"2023-10-18T19:37:15.432488+0000","last_fullsized":"2023-10-18T19:37:15.432488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279207+0000","last_change":"2023-10-18T19:34:20.832124+0000","last_active":"2023-10-18T19:34:38.279207+0000","last_peered":"2023-10-18T19:34:38.279207+0000","last_clean":"2023-10-18T19:34:38.279207+0000","last_became_active":"2023-10-18T19:34:20.831830+0000","last_became_peered":"2023-10-18T19:34:20.831830+0000","last_unstale":"2023-10-18T19:34:38.279207+0000","last_undegraded":"2023-10-18T19:34:38.279207+0000","last_fullsized":"2023-10-18T19:34:38.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430926+0000","last_change":"2023-10-18T19:34:21.263372+0000","last_active":"2023-10-18T19:37:15.430926+0000","last_peered":"2023-10-18T19:37:15.430926+0000","last_clean":"2023-10-18T19:37:15.430926+0000","last_became_active":"2023-10-18T19:34:21.256876+0000","last_became_peered":"2023-10-18T19:34:21.256876+0000","last_unstale":"2023-10-18T19:37:15.430926+0000","last_undegraded":"2023-10-18T19:37:15.430926+0000","last_fullsized":"2023-10-18T19:37:15.430926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431460+0000","last_change":"2023-10-18T19:34:20.846546+0000","last_active":"2023-10-18T19:37:15.431460+0000","last_peered":"2023-10-18T19:37:15.431460+0000","last_clean":"2023-10-18T19:37:15.431460+0000","last_became_active":"2023-10-18T19:34:20.846229+0000","last_became_peered":"2023-10-18T19:34:20.846229+0000","last_unstale":"2023-10-18T19:37:15.431460+0000","last_undegraded":"2023-10-18T19:37:15.431460+0000","last_fullsized":"2023-10-18T19:37:15.431460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733497+0000","last_change":"2023-10-18T19:34:21.248032+0000","last_active":"2023-10-18T19:34:38.733497+0000","last_peered":"2023-10-18T19:34:38.733497+0000","last_clean":"2023-10-18T19:34:38.733497+0000","last_became_active":"2023-10-18T19:34:21.247196+0000","last_became_peered":"2023-10-18T19:34:21.247196+0000","last_unstale":"2023-10-18T19:34:38.733497+0000","last_undegraded":"2023-10-18T19:34:38.733497+0000","last_fullsized":"2023-10-18T19:34:38.733497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280987+0000","last_change":"2023-10-18T19:34:20.847408+0000","last_active":"2023-10-18T19:34:38.280987+0000","last_peered":"2023-10-18T19:34:38.280987+0000","last_clean":"2023-10-18T19:34:38.280987+0000","last_became_active":"2023-10-18T19:34:20.847100+0000","last_became_peered":"2023-10-18T19:34:20.847100+0000","last_unstale":"2023-10-18T19:34:38.280987+0000","last_undegraded":"2023-10-18T19:34:38.280987+0000","last_fullsized":"2023-10-18T19:34:38.280987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280644+0000","last_change":"2023-10-18T19:34:21.256724+0000","last_active":"2023-10-18T19:34:38.280644+0000","last_peered":"2023-10-18T19:34:38.280644+0000","last_clean":"2023-10-18T19:34:38.280644+0000","last_became_active":"2023-10-18T19:34:21.256252+0000","last_became_peered":"2023-10-18T19:34:21.256252+0000","last_unstale":"2023-10-18T19:34:38.280644+0000","last_undegraded":"2023-10-18T19:34:38.280644+0000","last_fullsized":"2023-10-18T19:34:38.280644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281329+0000","last_change":"2023-10-18T19:34:20.846959+0000","last_active":"2023-10-18T19:34:38.281329+0000","last_peered":"2023-10-18T19:34:38.281329+0000","last_clean":"2023-10-18T19:34:38.281329+0000","last_became_active":"2023-10-18T19:34:20.846541+0000","last_became_peered":"2023-10-18T19:34:20.846541+0000","last_unstale":"2023-10-18T19:34:38.281329+0000","last_undegraded":"2023-10-18T19:34:38.281329+0000","last_fullsized":"2023-10-18T19:34:38.281329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282350+0000","last_change":"2023-10-18T19:34:21.251998+0000","last_active":"2023-10-18T19:34:38.282350+0000","last_peered":"2023-10-18T19:34:38.282350+0000","last_clean":"2023-10-18T19:34:38.282350+0000","last_became_active":"2023-10-18T19:34:21.251641+0000","last_became_peered":"2023-10-18T19:34:21.251641+0000","last_unstale":"2023-10-18T19:34:38.282350+0000","last_undegraded":"2023-10-18T19:34:38.282350+0000","last_fullsized":"2023-10-18T19:34:38.282350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281984+0000","last_change":"2023-10-18T19:34:20.844433+0000","last_active":"2023-10-18T19:34:38.281984+0000","last_peered":"2023-10-18T19:34:38.281984+0000","last_clean":"2023-10-18T19:34:38.281984+0000","last_became_active":"2023-10-18T19:34:20.843767+0000","last_became_peered":"2023-10-18T19:34:20.843767+0000","last_unstale":"2023-10-18T19:34:38.281984+0000","last_undegraded":"2023-10-18T19:34:38.281984+0000","last_fullsized":"2023-10-18T19:34:38.281984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282148+0000","last_change":"2023-10-18T19:34:21.259590+0000","last_active":"2023-10-18T19:34:38.282148+0000","last_peered":"2023-10-18T19:34:38.282148+0000","last_clean":"2023-10-18T19:34:38.282148+0000","last_became_active":"2023-10-18T19:34:21.257762+0000","last_became_peered":"2023-10-18T19:34:21.257762+0000","last_unstale":"2023-10-18T19:34:38.282148+0000","last_undegraded":"2023-10-18T19:34:38.282148+0000","last_fullsized":"2023-10-18T19:34:38.282148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432829+0000","last_change":"2023-10-18T19:34:20.845853+0000","last_active":"2023-10-18T19:37:15.432829+0000","last_peered":"2023-10-18T19:37:15.432829+0000","last_clean":"2023-10-18T19:37:15.432829+0000","last_became_active":"2023-10-18T19:34:20.845487+0000","last_became_peered":"2023-10-18T19:34:20.845487+0000","last_unstale":"2023-10-18T19:37:15.432829+0000","last_undegraded":"2023-10-18T19:37:15.432829+0000","last_fullsized":"2023-10-18T19:37:15.432829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282909+0000","last_change":"2023-10-18T19:34:21.255163+0000","last_active":"2023-10-18T19:34:38.282909+0000","last_peered":"2023-10-18T19:34:38.282909+0000","last_clean":"2023-10-18T19:34:38.282909+0000","last_became_active":"2023-10-18T19:34:21.252262+0000","last_became_peered":"2023-10-18T19:34:21.252262+0000","last_unstale":"2023-10-18T19:34:38.282909+0000","last_undegraded":"2023-10-18T19:34:38.282909+0000","last_fullsized":"2023-10-18T19:34:38.282909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:56.775862+0000","last_change":"2023-10-18T19:34:20.861998+0000","last_active":"2023-10-18T19:34:56.775862+0000","last_peered":"2023-10-18T19:34:56.775862+0000","last_clean":"2023-10-18T19:34:56.775862+0000","last_became_active":"2023-10-18T19:34:20.860333+0000","last_became_peered":"2023-10-18T19:34:20.860333+0000","last_unstale":"2023-10-18T19:34:56.775862+0000","last_undegraded":"2023-10-18T19:34:56.775862+0000","last_fullsized":"2023-10-18T19:34:56.775862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433015+0000","last_change":"2023-10-18T19:34:21.258083+0000","last_active":"2023-10-18T19:37:15.433015+0000","last_peered":"2023-10-18T19:37:15.433015+0000","last_clean":"2023-10-18T19:37:15.433015+0000","last_became_active":"2023-10-18T19:34:21.257626+0000","last_became_peered":"2023-10-18T19:34:21.257626+0000","last_unstale":"2023-10-18T19:37:15.433015+0000","last_undegraded":"2023-10-18T19:37:15.433015+0000","last_fullsized":"2023-10-18T19:37:15.433015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282770+0000","last_change":"2023-10-18T19:34:20.855980+0000","last_active":"2023-10-18T19:34:38.282770+0000","last_peered":"2023-10-18T19:34:38.282770+0000","last_clean":"2023-10-18T19:34:38.282770+0000","last_became_active":"2023-10-18T19:34:20.855446+0000","last_became_peered":"2023-10-18T19:34:20.855446+0000","last_unstale":"2023-10-18T19:34:38.282770+0000","last_undegraded":"2023-10-18T19:34:38.282770+0000","last_fullsized":"2023-10-18T19:34:38.282770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280057+0000","last_change":"2023-10-18T19:34:21.267157+0000","last_active":"2023-10-18T19:34:38.280057+0000","last_peered":"2023-10-18T19:34:38.280057+0000","last_clean":"2023-10-18T19:34:38.280057+0000","last_became_active":"2023-10-18T19:34:21.266854+0000","last_became_peered":"2023-10-18T19:34:21.266854+0000","last_unstale":"2023-10-18T19:34:38.280057+0000","last_undegraded":"2023-10-18T19:34:38.280057+0000","last_fullsized":"2023-10-18T19:34:38.280057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279385+0000","last_change":"2023-10-18T19:34:20.847879+0000","last_active":"2023-10-18T19:34:38.279385+0000","last_peered":"2023-10-18T19:34:38.279385+0000","last_clean":"2023-10-18T19:34:38.279385+0000","last_became_active":"2023-10-18T19:34:20.847368+0000","last_became_peered":"2023-10-18T19:34:20.847368+0000","last_unstale":"2023-10-18T19:34:38.279385+0000","last_undegraded":"2023-10-18T19:34:38.279385+0000","last_fullsized":"2023-10-18T19:34:38.279385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279012+0000","last_change":"2023-10-18T19:34:21.271229+0000","last_active":"2023-10-18T19:34:38.279012+0000","last_peered":"2023-10-18T19:34:38.279012+0000","last_clean":"2023-10-18T19:34:38.279012+0000","last_became_active":"2023-10-18T19:34:21.270946+0000","last_became_peered":"2023-10-18T19:34:21.270946+0000","last_unstale":"2023-10-18T19:34:38.279012+0000","last_undegraded":"2023-10-18T19:34:38.279012+0000","last_fullsized":"2023-10-18T19:34:38.279012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281579+0000","last_change":"2023-10-18T19:34:20.857540+0000","last_active":"2023-10-18T19:34:38.281579+0000","last_peered":"2023-10-18T19:34:38.281579+0000","last_clean":"2023-10-18T19:34:38.281579+0000","last_became_active":"2023-10-18T19:34:20.857056+0000","last_became_peered":"2023-10-18T19:34:20.857056+0000","last_unstale":"2023-10-18T19:34:38.281579+0000","last_undegraded":"2023-10-18T19:34:38.281579+0000","last_fullsized":"2023-10-18T19:34:38.281579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733162+0000","last_change":"2023-10-18T19:34:21.264597+0000","last_active":"2023-10-18T19:34:38.733162+0000","last_peered":"2023-10-18T19:34:38.733162+0000","last_clean":"2023-10-18T19:34:38.733162+0000","last_became_active":"2023-10-18T19:34:21.264304+0000","last_became_peered":"2023-10-18T19:34:21.264304+0000","last_unstale":"2023-10-18T19:34:38.733162+0000","last_undegraded":"2023-10-18T19:34:38.733162+0000","last_fullsized":"2023-10-18T19:34:38.733162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.798950+0000","last_change":"2023-10-18T19:34:20.830160+0000","last_active":"2023-10-18T19:35:01.798950+0000","last_peered":"2023-10-18T19:35:01.798950+0000","last_clean":"2023-10-18T19:35:01.798950+0000","last_became_active":"2023-10-18T19:34:20.829821+0000","last_became_peered":"2023-10-18T19:34:20.829821+0000","last_unstale":"2023-10-18T19:35:01.798950+0000","last_undegraded":"2023-10-18T19:35:01.798950+0000","last_fullsized":"2023-10-18T19:35:01.798950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282061+0000","last_change":"2023-10-18T19:34:21.250388+0000","last_active":"2023-10-18T19:34:38.282061+0000","last_peered":"2023-10-18T19:34:38.282061+0000","last_clean":"2023-10-18T19:34:38.282061+0000","last_became_active":"2023-10-18T19:34:21.250098+0000","last_became_peered":"2023-10-18T19:34:21.250098+0000","last_unstale":"2023-10-18T19:34:38.282061+0000","last_undegraded":"2023-10-18T19:34:38.282061+0000","last_fullsized":"2023-10-18T19:34:38.282061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431970+0000","last_change":"2023-10-18T19:34:20.857726+0000","last_active":"2023-10-18T19:37:15.431970+0000","last_peered":"2023-10-18T19:37:15.431970+0000","last_clean":"2023-10-18T19:37:15.431970+0000","last_became_active":"2023-10-18T19:34:20.856983+0000","last_became_peered":"2023-10-18T19:34:20.856983+0000","last_unstale":"2023-10-18T19:37:15.431970+0000","last_undegraded":"2023-10-18T19:37:15.431970+0000","last_fullsized":"2023-10-18T19:37:15.431970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282838+0000","last_change":"2023-10-18T19:34:21.270485+0000","last_active":"2023-10-18T19:34:38.282838+0000","last_peered":"2023-10-18T19:34:38.282838+0000","last_clean":"2023-10-18T19:34:38.282838+0000","last_became_active":"2023-10-18T19:34:21.270140+0000","last_became_peered":"2023-10-18T19:34:21.270140+0000","last_unstale":"2023-10-18T19:34:38.282838+0000","last_undegraded":"2023-10-18T19:34:38.282838+0000","last_fullsized":"2023-10-18T19:34:38.282838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432509+0000","last_change":"2023-10-18T19:34:20.847009+0000","last_active":"2023-10-18T19:37:15.432509+0000","last_peered":"2023-10-18T19:37:15.432509+0000","last_clean":"2023-10-18T19:37:15.432509+0000","last_became_active":"2023-10-18T19:34:20.846481+0000","last_became_peered":"2023-10-18T19:34:20.846481+0000","last_unstale":"2023-10-18T19:37:15.432509+0000","last_undegraded":"2023-10-18T19:37:15.432509+0000","last_fullsized":"2023-10-18T19:37:15.432509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733909+0000","last_change":"2023-10-18T19:34:21.256060+0000","last_active":"2023-10-18T19:34:38.733909+0000","last_peered":"2023-10-18T19:34:38.733909+0000","last_clean":"2023-10-18T19:34:38.733909+0000","last_became_active":"2023-10-18T19:34:21.255703+0000","last_became_peered":"2023-10-18T19:34:21.255703+0000","last_unstale":"2023-10-18T19:34:38.733909+0000","last_undegraded":"2023-10-18T19:34:38.733909+0000","last_fullsized":"2023-10-18T19:34:38.733909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282443+0000","last_change":"2023-10-18T19:34:20.849799+0000","last_active":"2023-10-18T19:34:38.282443+0000","last_peered":"2023-10-18T19:34:38.282443+0000","last_clean":"2023-10-18T19:34:38.282443+0000","last_became_active":"2023-10-18T19:34:20.849488+0000","last_became_peered":"2023-10-18T19:34:20.849488+0000","last_unstale":"2023-10-18T19:34:38.282443+0000","last_undegraded":"2023-10-18T19:34:38.282443+0000","last_fullsized":"2023-10-18T19:34:38.282443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282561+0000","last_change":"2023-10-18T19:34:21.260006+0000","last_active":"2023-10-18T19:34:38.282561+0000","last_peered":"2023-10-18T19:34:38.282561+0000","last_clean":"2023-10-18T19:34:38.282561+0000","last_became_active":"2023-10-18T19:34:21.259689+0000","last_became_peered":"2023-10-18T19:34:21.259689+0000","last_unstale":"2023-10-18T19:34:38.282561+0000","last_undegraded":"2023-10-18T19:34:38.282561+0000","last_fullsized":"2023-10-18T19:34:38.282561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282357+0000","last_change":"2023-10-18T19:34:20.858108+0000","last_active":"2023-10-18T19:34:38.282357+0000","last_peered":"2023-10-18T19:34:38.282357+0000","last_clean":"2023-10-18T19:34:38.282357+0000","last_became_active":"2023-10-18T19:34:20.854784+0000","last_became_peered":"2023-10-18T19:34:20.854784+0000","last_unstale":"2023-10-18T19:34:38.282357+0000","last_undegraded":"2023-10-18T19:34:38.282357+0000","last_fullsized":"2023-10-18T19:34:38.282357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433066+0000","last_change":"2023-10-18T19:34:21.257919+0000","last_active":"2023-10-18T19:37:15.433066+0000","last_peered":"2023-10-18T19:37:15.433066+0000","last_clean":"2023-10-18T19:37:15.433066+0000","last_became_active":"2023-10-18T19:34:21.257409+0000","last_became_peered":"2023-10-18T19:34:21.257409+0000","last_unstale":"2023-10-18T19:37:15.433066+0000","last_undegraded":"2023-10-18T19:37:15.433066+0000","last_fullsized":"2023-10-18T19:37:15.433066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282854+0000","last_change":"2023-10-18T19:34:20.847577+0000","last_active":"2023-10-18T19:34:38.282854+0000","last_peered":"2023-10-18T19:34:38.282854+0000","last_clean":"2023-10-18T19:34:38.282854+0000","last_became_active":"2023-10-18T19:34:20.842013+0000","last_became_peered":"2023-10-18T19:34:20.842013+0000","last_unstale":"2023-10-18T19:34:38.282854+0000","last_undegraded":"2023-10-18T19:34:38.282854+0000","last_fullsized":"2023-10-18T19:34:38.282854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281875+0000","last_change":"2023-10-18T19:34:21.251747+0000","last_active":"2023-10-18T19:34:38.281875+0000","last_peered":"2023-10-18T19:34:38.281875+0000","last_clean":"2023-10-18T19:34:38.281875+0000","last_became_active":"2023-10-18T19:34:21.251325+0000","last_became_peered":"2023-10-18T19:34:21.251325+0000","last_unstale":"2023-10-18T19:34:38.281875+0000","last_undegraded":"2023-10-18T19:34:38.281875+0000","last_fullsized":"2023-10-18T19:34:38.281875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732897+0000","last_change":"2023-10-18T19:34:20.832572+0000","last_active":"2023-10-18T19:34:38.732897+0000","last_peered":"2023-10-18T19:34:38.732897+0000","last_clean":"2023-10-18T19:34:38.732897+0000","last_became_active":"2023-10-18T19:34:20.832216+0000","last_became_peered":"2023-10-18T19:34:20.832216+0000","last_unstale":"2023-10-18T19:34:38.732897+0000","last_undegraded":"2023-10-18T19:34:38.732897+0000","last_fullsized":"2023-10-18T19:34:38.732897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279223+0000","last_change":"2023-10-18T19:34:21.272247+0000","last_active":"2023-10-18T19:34:38.279223+0000","last_peered":"2023-10-18T19:34:38.279223+0000","last_clean":"2023-10-18T19:34:38.279223+0000","last_became_active":"2023-10-18T19:34:21.271930+0000","last_became_peered":"2023-10-18T19:34:21.271930+0000","last_unstale":"2023-10-18T19:34:38.279223+0000","last_undegraded":"2023-10-18T19:34:38.279223+0000","last_fullsized":"2023-10-18T19:34:38.279223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733403+0000","last_change":"2023-10-18T19:34:20.840841+0000","last_active":"2023-10-18T19:34:38.733403+0000","last_peered":"2023-10-18T19:34:38.733403+0000","last_clean":"2023-10-18T19:34:38.733403+0000","last_became_active":"2023-10-18T19:34:20.840351+0000","last_became_peered":"2023-10-18T19:34:20.840351+0000","last_unstale":"2023-10-18T19:34:38.733403+0000","last_undegraded":"2023-10-18T19:34:38.733403+0000","last_fullsized":"2023-10-18T19:34:38.733403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281107+0000","last_change":"2023-10-18T19:34:21.258445+0000","last_active":"2023-10-18T19:34:38.281107+0000","last_peered":"2023-10-18T19:34:38.281107+0000","last_clean":"2023-10-18T19:34:38.281107+0000","last_became_active":"2023-10-18T19:34:21.257747+0000","last_became_peered":"2023-10-18T19:34:21.257747+0000","last_unstale":"2023-10-18T19:34:38.281107+0000","last_undegraded":"2023-10-18T19:34:38.281107+0000","last_fullsized":"2023-10-18T19:34:38.281107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431681+0000","last_change":"2023-10-18T19:34:20.856638+0000","last_active":"2023-10-18T19:37:15.431681+0000","last_peered":"2023-10-18T19:37:15.431681+0000","last_clean":"2023-10-18T19:37:15.431681+0000","last_became_active":"2023-10-18T19:34:20.856094+0000","last_became_peered":"2023-10-18T19:34:20.856094+0000","last_unstale":"2023-10-18T19:37:15.431681+0000","last_undegraded":"2023-10-18T19:37:15.431681+0000","last_fullsized":"2023-10-18T19:37:15.431681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733334+0000","last_change":"2023-10-18T19:34:21.249180+0000","last_active":"2023-10-18T19:34:38.733334+0000","last_peered":"2023-10-18T19:34:38.733334+0000","last_clean":"2023-10-18T19:34:38.733334+0000","last_became_active":"2023-10-18T19:34:21.245370+0000","last_became_peered":"2023-10-18T19:34:21.245370+0000","last_unstale":"2023-10-18T19:34:38.733334+0000","last_undegraded":"2023-10-18T19:34:38.733334+0000","last_fullsized":"2023-10-18T19:34:38.733334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281765+0000","last_change":"2023-10-18T19:34:20.823278+0000","last_active":"2023-10-18T19:34:38.281765+0000","last_peered":"2023-10-18T19:34:38.281765+0000","last_clean":"2023-10-18T19:34:38.281765+0000","last_became_active":"2023-10-18T19:34:20.823003+0000","last_became_peered":"2023-10-18T19:34:20.823003+0000","last_unstale":"2023-10-18T19:34:38.281765+0000","last_undegraded":"2023-10-18T19:34:38.281765+0000","last_fullsized":"2023-10-18T19:34:38.281765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734049+0000","last_change":"2023-10-18T19:34:21.246335+0000","last_active":"2023-10-18T19:34:38.734049+0000","last_peered":"2023-10-18T19:34:38.734049+0000","last_clean":"2023-10-18T19:34:38.734049+0000","last_became_active":"2023-10-18T19:34:21.246040+0000","last_became_peered":"2023-10-18T19:34:21.246040+0000","last_unstale":"2023-10-18T19:34:38.734049+0000","last_undegraded":"2023-10-18T19:34:38.734049+0000","last_fullsized":"2023-10-18T19:34:38.734049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.404885+0000","last_change":"2023-10-18T19:34:20.855032+0000","last_active":"2023-10-18T19:37:15.404885+0000","last_peered":"2023-10-18T19:37:15.404885+0000","last_clean":"2023-10-18T19:37:15.404885+0000","last_became_active":"2023-10-18T19:34:20.854673+0000","last_became_peered":"2023-10-18T19:34:20.854673+0000","last_unstale":"2023-10-18T19:37:15.404885+0000","last_undegraded":"2023-10-18T19:37:15.404885+0000","last_fullsized":"2023-10-18T19:37:15.404885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734255+0000","last_change":"2023-10-18T19:34:21.254232+0000","last_active":"2023-10-18T19:34:38.734255+0000","last_peered":"2023-10-18T19:34:38.734255+0000","last_clean":"2023-10-18T19:34:38.734255+0000","last_became_active":"2023-10-18T19:34:21.253932+0000","last_became_peered":"2023-10-18T19:34:21.253932+0000","last_unstale":"2023-10-18T19:34:38.734255+0000","last_undegraded":"2023-10-18T19:34:38.734255+0000","last_fullsized":"2023-10-18T19:34:38.734255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282242+0000","last_change":"2023-10-18T19:34:20.855559+0000","last_active":"2023-10-18T19:34:38.282242+0000","last_peered":"2023-10-18T19:34:38.282242+0000","last_clean":"2023-10-18T19:34:38.282242+0000","last_became_active":"2023-10-18T19:34:20.854845+0000","last_became_peered":"2023-10-18T19:34:20.854845+0000","last_unstale":"2023-10-18T19:34:38.282242+0000","last_undegraded":"2023-10-18T19:34:38.282242+0000","last_fullsized":"2023-10-18T19:34:38.282242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282827+0000","last_change":"2023-10-18T19:34:21.248190+0000","last_active":"2023-10-18T19:34:38.282827+0000","last_peered":"2023-10-18T19:34:38.282827+0000","last_clean":"2023-10-18T19:34:38.282827+0000","last_became_active":"2023-10-18T19:34:21.247102+0000","last_became_peered":"2023-10-18T19:34:21.247102+0000","last_unstale":"2023-10-18T19:34:38.282827+0000","last_undegraded":"2023-10-18T19:34:38.282827+0000","last_fullsized":"2023-10-18T19:34:38.282827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282185+0000","last_change":"2023-10-18T19:34:20.857956+0000","last_active":"2023-10-18T19:34:38.282185+0000","last_peered":"2023-10-18T19:34:38.282185+0000","last_clean":"2023-10-18T19:34:38.282185+0000","last_became_active":"2023-10-18T19:34:20.855051+0000","last_became_peered":"2023-10-18T19:34:20.855051+0000","last_unstale":"2023-10-18T19:34:38.282185+0000","last_undegraded":"2023-10-18T19:34:38.282185+0000","last_fullsized":"2023-10-18T19:34:38.282185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734496+0000","last_change":"2023-10-18T19:34:21.266700+0000","last_active":"2023-10-18T19:34:38.734496+0000","last_peered":"2023-10-18T19:34:38.734496+0000","last_clean":"2023-10-18T19:34:38.734496+0000","last_became_active":"2023-10-18T19:34:21.266409+0000","last_became_peered":"2023-10-18T19:34:21.266409+0000","last_unstale":"2023-10-18T19:34:38.734496+0000","last_undegraded":"2023-10-18T19:34:38.734496+0000","last_fullsized":"2023-10-18T19:34:38.734496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734439+0000","last_change":"2023-10-18T19:34:20.851465+0000","last_active":"2023-10-18T19:34:38.734439+0000","last_peered":"2023-10-18T19:34:38.734439+0000","last_clean":"2023-10-18T19:34:38.734439+0000","last_became_active":"2023-10-18T19:34:20.851166+0000","last_became_peered":"2023-10-18T19:34:20.851166+0000","last_unstale":"2023-10-18T19:34:38.734439+0000","last_undegraded":"2023-10-18T19:34:38.734439+0000","last_fullsized":"2023-10-18T19:34:38.734439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733028+0000","last_change":"2023-10-18T19:34:21.245529+0000","last_active":"2023-10-18T19:34:38.733028+0000","last_peered":"2023-10-18T19:34:38.733028+0000","last_clean":"2023-10-18T19:34:38.733028+0000","last_became_active":"2023-10-18T19:34:21.245217+0000","last_became_peered":"2023-10-18T19:34:21.245217+0000","last_unstale":"2023-10-18T19:34:38.733028+0000","last_undegraded":"2023-10-18T19:34:38.733028+0000","last_fullsized":"2023-10-18T19:34:38.733028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732935+0000","last_change":"2023-10-18T19:34:20.837517+0000","last_active":"2023-10-18T19:34:38.732935+0000","last_peered":"2023-10-18T19:34:38.732935+0000","last_clean":"2023-10-18T19:34:38.732935+0000","last_became_active":"2023-10-18T19:34:20.837192+0000","last_became_peered":"2023-10-18T19:34:20.837192+0000","last_unstale":"2023-10-18T19:34:38.732935+0000","last_undegraded":"2023-10-18T19:34:38.732935+0000","last_fullsized":"2023-10-18T19:34:38.732935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279330+0000","last_change":"2023-10-18T19:34:21.262649+0000","last_active":"2023-10-18T19:34:38.279330+0000","last_peered":"2023-10-18T19:34:38.279330+0000","last_clean":"2023-10-18T19:34:38.279330+0000","last_became_active":"2023-10-18T19:34:21.262175+0000","last_became_peered":"2023-10-18T19:34:21.262175+0000","last_unstale":"2023-10-18T19:34:38.279330+0000","last_undegraded":"2023-10-18T19:34:38.279330+0000","last_fullsized":"2023-10-18T19:34:38.279330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281496+0000","last_change":"2023-10-18T19:34:20.821558+0000","last_active":"2023-10-18T19:34:38.281496+0000","last_peered":"2023-10-18T19:34:38.281496+0000","last_clean":"2023-10-18T19:34:38.281496+0000","last_became_active":"2023-10-18T19:34:20.821225+0000","last_became_peered":"2023-10-18T19:34:20.821225+0000","last_unstale":"2023-10-18T19:34:38.281496+0000","last_undegraded":"2023-10-18T19:34:38.281496+0000","last_fullsized":"2023-10-18T19:34:38.281496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733138+0000","last_change":"2023-10-18T19:34:21.268630+0000","last_active":"2023-10-18T19:34:38.733138+0000","last_peered":"2023-10-18T19:34:38.733138+0000","last_clean":"2023-10-18T19:34:38.733138+0000","last_became_active":"2023-10-18T19:34:21.268347+0000","last_became_peered":"2023-10-18T19:34:21.268347+0000","last_unstale":"2023-10-18T19:34:38.733138+0000","last_undegraded":"2023-10-18T19:34:38.733138+0000","last_fullsized":"2023-10-18T19:34:38.733138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431765+0000","last_change":"2023-10-18T19:34:20.856427+0000","last_active":"2023-10-18T19:37:15.431765+0000","last_peered":"2023-10-18T19:37:15.431765+0000","last_clean":"2023-10-18T19:37:15.431765+0000","last_became_active":"2023-10-18T19:34:20.855877+0000","last_became_peered":"2023-10-18T19:34:20.855877+0000","last_unstale":"2023-10-18T19:37:15.431765+0000","last_undegraded":"2023-10-18T19:37:15.431765+0000","last_fullsized":"2023-10-18T19:37:15.431765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431545+0000","last_change":"2023-10-18T19:34:21.259142+0000","last_active":"2023-10-18T19:37:15.431545+0000","last_peered":"2023-10-18T19:37:15.431545+0000","last_clean":"2023-10-18T19:37:15.431545+0000","last_became_active":"2023-10-18T19:34:21.258709+0000","last_became_peered":"2023-10-18T19:34:21.258709+0000","last_unstale":"2023-10-18T19:37:15.431545+0000","last_undegraded":"2023-10-18T19:37:15.431545+0000","last_fullsized":"2023-10-18T19:37:15.431545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733304+0000","last_change":"2023-10-18T19:34:20.861616+0000","last_active":"2023-10-18T19:34:38.733304+0000","last_peered":"2023-10-18T19:34:38.733304+0000","last_clean":"2023-10-18T19:34:38.733304+0000","last_became_active":"2023-10-18T19:34:20.861363+0000","last_became_peered":"2023-10-18T19:34:20.861363+0000","last_unstale":"2023-10-18T19:34:38.733304+0000","last_undegraded":"2023-10-18T19:34:38.733304+0000","last_fullsized":"2023-10-18T19:34:38.733304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733725+0000","last_change":"2023-10-18T19:34:21.267981+0000","last_active":"2023-10-18T19:34:38.733725+0000","last_peered":"2023-10-18T19:34:38.733725+0000","last_clean":"2023-10-18T19:34:38.733725+0000","last_became_active":"2023-10-18T19:34:21.267584+0000","last_became_peered":"2023-10-18T19:34:21.267584+0000","last_unstale":"2023-10-18T19:34:38.733725+0000","last_undegraded":"2023-10-18T19:34:38.733725+0000","last_fullsized":"2023-10-18T19:34:38.733725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734167+0000","last_change":"2023-10-18T19:34:20.855045+0000","last_active":"2023-10-18T19:34:38.734167+0000","last_peered":"2023-10-18T19:34:38.734167+0000","last_clean":"2023-10-18T19:34:38.734167+0000","last_became_active":"2023-10-18T19:34:20.854724+0000","last_became_peered":"2023-10-18T19:34:20.854724+0000","last_unstale":"2023-10-18T19:34:38.734167+0000","last_undegraded":"2023-10-18T19:34:38.734167+0000","last_fullsized":"2023-10-18T19:34:38.734167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432660+0000","last_change":"2023-10-18T19:34:21.262741+0000","last_active":"2023-10-18T19:37:15.432660+0000","last_peered":"2023-10-18T19:37:15.432660+0000","last_clean":"2023-10-18T19:37:15.432660+0000","last_became_active":"2023-10-18T19:34:21.262435+0000","last_became_peered":"2023-10-18T19:34:21.262435+0000","last_unstale":"2023-10-18T19:37:15.432660+0000","last_undegraded":"2023-10-18T19:37:15.432660+0000","last_fullsized":"2023-10-18T19:37:15.432660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282043+0000","last_change":"2023-10-18T19:34:20.850195+0000","last_active":"2023-10-18T19:34:38.282043+0000","last_peered":"2023-10-18T19:34:38.282043+0000","last_clean":"2023-10-18T19:34:38.282043+0000","last_became_active":"2023-10-18T19:34:20.849885+0000","last_became_peered":"2023-10-18T19:34:20.849885+0000","last_unstale":"2023-10-18T19:34:38.282043+0000","last_undegraded":"2023-10-18T19:34:38.282043+0000","last_fullsized":"2023-10-18T19:34:38.282043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734093+0000","last_change":"2023-10-18T19:34:21.248730+0000","last_active":"2023-10-18T19:34:38.734093+0000","last_peered":"2023-10-18T19:34:38.734093+0000","last_clean":"2023-10-18T19:34:38.734093+0000","last_became_active":"2023-10-18T19:34:21.248420+0000","last_became_peered":"2023-10-18T19:34:21.248420+0000","last_unstale":"2023-10-18T19:34:38.734093+0000","last_undegraded":"2023-10-18T19:34:38.734093+0000","last_fullsized":"2023-10-18T19:34:38.734093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734685+0000","last_change":"2023-10-18T19:34:20.862008+0000","last_active":"2023-10-18T19:34:38.734685+0000","last_peered":"2023-10-18T19:34:38.734685+0000","last_clean":"2023-10-18T19:34:38.734685+0000","last_became_active":"2023-10-18T19:34:20.858973+0000","last_became_peered":"2023-10-18T19:34:20.858973+0000","last_unstale":"2023-10-18T19:34:38.734685+0000","last_undegraded":"2023-10-18T19:34:38.734685+0000","last_fullsized":"2023-10-18T19:34:38.734685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282092+0000","last_change":"2023-10-18T19:34:21.259920+0000","last_active":"2023-10-18T19:34:38.282092+0000","last_peered":"2023-10-18T19:34:38.282092+0000","last_clean":"2023-10-18T19:34:38.282092+0000","last_became_active":"2023-10-18T19:34:21.259474+0000","last_became_peered":"2023-10-18T19:34:21.259474+0000","last_unstale":"2023-10-18T19:34:38.282092+0000","last_undegraded":"2023-10-18T19:34:38.282092+0000","last_fullsized":"2023-10-18T19:34:38.282092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282747+0000","last_change":"2023-10-18T19:34:20.842664+0000","last_active":"2023-10-18T19:34:38.282747+0000","last_peered":"2023-10-18T19:34:38.282747+0000","last_clean":"2023-10-18T19:34:38.282747+0000","last_became_active":"2023-10-18T19:34:20.842341+0000","last_became_peered":"2023-10-18T19:34:20.842341+0000","last_unstale":"2023-10-18T19:34:38.282747+0000","last_undegraded":"2023-10-18T19:34:38.282747+0000","last_fullsized":"2023-10-18T19:34:38.282747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":54653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35999999999999999,"15min":0.376},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.48099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.41799999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39400000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.377},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.45300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40200000000000002}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.375},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.43099999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":44912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56699999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:19.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:20.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.179+0000 7fddf45ff700 1 Processor -- start 2023-10-18T19:37:20.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.179+0000 7fddf45ff700 1 -- start start 2023-10-18T19:37:20.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 0x7fddec136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 0x7fddec13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec0afd50 con 0x7fddec0a4c50 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0a47a0 con 0x7fddec0a1790 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf45ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0a3a10 con 0x7fddec0af970 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf1b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 0x7fddec136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf2b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 0x7fddec13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56312/0 (socket says 172.21.15.88:56312) 2023-10-18T19:37:20.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 -- 172.21.15.88:0/1135834088 learned_addr learned my addr 172.21.15.88:0/1135834088 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:20.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf1b9a700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 0x7fddec136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38960/0 (socket says 172.21.15.88:38960) 2023-10-18T19:37:20.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 -- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 msgr2=0x7fddec136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 0x7fddec136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 -- 172.21.15.88:0/1135834088 >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 msgr2=0x7fddec13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 --2- 172.21.15.88:0/1135834088 >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 0x7fddec13bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf239b700 1 -- 172.21.15.88:0/1135834088 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0a32d0 con 0x7fddec0af970 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.180+0000 7fddf2b9c700 1 --2- 172.21.15.88:0/1135834088 >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 0x7fddec13bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:20.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf239b700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdde8009830 tx=0x7fdde80090f0).ready entity=mon.2 client_cookie=8787ca79a9e0942 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:20.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf1399700 1 -- 172.21.15.88:0/1135834088 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f510 con 0x7fddec0af970 2023-10-18T19:37:20.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf1399700 1 -- 172.21.15.88:0/1135834088 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde800f670 con 0x7fddec0af970 2023-10-18T19:37:20.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf1399700 1 -- 172.21.15.88:0/1135834088 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800f9f0 con 0x7fddec0af970 2023-10-18T19:37:20.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 -- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 msgr2=0x7fddec135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdde8009830 tx=0x7fdde80090f0).stop 2023-10-18T19:37:20.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 -- 172.21.15.88:0/1135834088 shutdown_connections 2023-10-18T19:37:20.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec135d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1135834088 >> v2:172.21.15.88:3300/0 conn(0x7fddec0a4c50 0x7fddec13bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1135834088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a1790 0x7fddec136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.181+0000 7fddf45ff700 1 -- 172.21.15.88:0/1135834088 >> 172.21.15.88:0/1135834088 conn(0x7fddec05eb60 msgr2=0x7fddec0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:20.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.182+0000 7fddf45ff700 1 -- 172.21.15.88:0/1135834088 shutdown_connections 2023-10-18T19:37:20.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.182+0000 7fddf45ff700 1 -- 172.21.15.88:0/1135834088 wait complete. 2023-10-18T19:37:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.183+0000 7fddf45ff700 1 Processor -- start 2023-10-18T19:37:20.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.183+0000 7fddf45ff700 1 -- start start 2023-10-18T19:37:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0a9760 con 0x7fddec0a1790 2023-10-18T19:37:20.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0aada0 con 0x7fddec0a4c50 2023-10-18T19:37:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf45ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0a90c0 con 0x7fddec0af970 2023-10-18T19:37:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf239b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf239b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36460/0 (socket says 172.21.15.88:36460) 2023-10-18T19:37:20.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38962/0 (socket says 172.21.15.88:38962) 2023-10-18T19:37:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf239b700 1 -- 172.21.15.88:0/1003494418 learned_addr learned my addr 172.21.15.88:0/1003494418 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf2b9c700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 -- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 msgr2=0x7fddec148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 -- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 msgr2=0x7fddec0ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf1b9a700 1 -- 172.21.15.88:0/1003494418 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4009a20 con 0x7fddec0a4c50 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.184+0000 7fddf239b700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fddf1b9a700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdddc00e8d0 tx=0x7fdddc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc012600 con 0x7fddec0a4c50 2023-10-18T19:37:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc012760 con 0x7fddec0a4c50 2023-10-18T19:37:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc012ae0 con 0x7fddec0a4c50 2023-10-18T19:37:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde8009370 con 0x7fddec0a4c50 2023-10-18T19:37:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.185+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec1492b0 con 0x7fddec0a4c50 2023-10-18T19:37:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.186+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fdddc01b400 con 0x7fddec0a4c50 2023-10-18T19:37:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.186+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec149530 con 0x7fddec0a4c50 2023-10-18T19:37:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.187+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fdddc055ce0 con 0x7fddec0a4c50 2023-10-18T19:37:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.191+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fdddc036270 con 0x7fddec0a4c50 2023-10-18T19:37:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.333+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddec05f270 con 0x7fddd0041d10 2023-10-18T19:37:20.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.342+0000 7fdde27fc700 1 -- 172.21.15.88:0/1003494418 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325971 (unknown 2965378022 0 2983035873) 0x7fddec05f270 con 0x7fddd0041d10 2023-10-18T19:37:20.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.345+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 >> v1:172.21.15.88:6800/113625 conn(0x7fddd0041d10 legacy=0x7fddd00441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.345+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 msgr2=0x7fddec0ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.345+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdddc00e8d0 tx=0x7fdddc009060).stop 2023-10-18T19:37:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 shutdown_connections 2023-10-18T19:37:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fddec0af970 0x7fddec148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fddec0a1790 0x7fddec0ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 --2- 172.21.15.88:0/1003494418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fddec0a4c50 0x7fddec0ab6f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 >> 172.21.15.88:0/1003494418 conn(0x7fddec05eb60 msgr2=0x7fddec1372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 shutdown_connections 2023-10-18T19:37:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.346+0000 7fddf45ff700 1 -- 172.21.15.88:0/1003494418 wait complete. 2023-10-18T19:37:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:20.366 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-18T19:37:19.354993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195048,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292312,"statfs":{"total":386547056640,"available":382251327488,"internally_reserved":4294967296,"allocated":729088,"data_stored":201443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993836"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281973+0000","last_change":"2023-10-18T19:34:21.266064+0000","last_active":"2023-10-18T19:34:38.281973+0000","last_peered":"2023-10-18T19:34:38.281973+0000","last_clean":"2023-10-18T19:34:38.281973+0000","last_became_active":"2023-10-18T19:34:21.265745+0000","last_became_peered":"2023-10-18T19:34:21.265745+0000","last_unstale":"2023-10-18T19:34:38.281973+0000","last_undegraded":"2023-10-18T19:34:38.281973+0000","last_fullsized":"2023-10-18T19:34:38.281973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.799504+0000","last_change":"2023-10-18T19:34:20.848544+0000","last_active":"2023-10-18T19:35:01.799504+0000","last_peered":"2023-10-18T19:35:01.799504+0000","last_clean":"2023-10-18T19:35:01.799504+0000","last_became_active":"2023-10-18T19:34:20.848186+0000","last_became_peered":"2023-10-18T19:34:20.848186+0000","last_unstale":"2023-10-18T19:35:01.799504+0000","last_undegraded":"2023-10-18T19:35:01.799504+0000","last_fullsized":"2023-10-18T19:35:01.799504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733305+0000","last_change":"2023-10-18T19:34:21.249452+0000","last_active":"2023-10-18T19:34:38.733305+0000","last_peered":"2023-10-18T19:34:38.733305+0000","last_clean":"2023-10-18T19:34:38.733305+0000","last_became_active":"2023-10-18T19:34:21.249103+0000","last_became_peered":"2023-10-18T19:34:21.249103+0000","last_unstale":"2023-10-18T19:34:38.733305+0000","last_undegraded":"2023-10-18T19:34:38.733305+0000","last_fullsized":"2023-10-18T19:34:38.733305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280902+0000","last_change":"2023-10-18T19:34:20.835459+0000","last_active":"2023-10-18T19:34:38.280902+0000","last_peered":"2023-10-18T19:34:38.280902+0000","last_clean":"2023-10-18T19:34:38.280902+0000","last_became_active":"2023-10-18T19:34:20.835145+0000","last_became_peered":"2023-10-18T19:34:20.835145+0000","last_unstale":"2023-10-18T19:34:38.280902+0000","last_undegraded":"2023-10-18T19:34:38.280902+0000","last_fullsized":"2023-10-18T19:34:38.280902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279296+0000","last_change":"2023-10-18T19:34:21.262486+0000","last_active":"2023-10-18T19:34:38.279296+0000","last_peered":"2023-10-18T19:34:38.279296+0000","last_clean":"2023-10-18T19:34:38.279296+0000","last_became_active":"2023-10-18T19:34:21.261956+0000","last_became_peered":"2023-10-18T19:34:21.261956+0000","last_unstale":"2023-10-18T19:34:38.279296+0000","last_undegraded":"2023-10-18T19:34:38.279296+0000","last_fullsized":"2023-10-18T19:34:38.279296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280144+0000","last_change":"2023-10-18T19:34:20.854649+0000","last_active":"2023-10-18T19:34:38.280144+0000","last_peered":"2023-10-18T19:34:38.280144+0000","last_clean":"2023-10-18T19:34:38.280144+0000","last_became_active":"2023-10-18T19:34:20.854333+0000","last_became_peered":"2023-10-18T19:34:20.854333+0000","last_unstale":"2023-10-18T19:34:38.280144+0000","last_undegraded":"2023-10-18T19:34:38.280144+0000","last_fullsized":"2023-10-18T19:34:38.280144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281669+0000","last_change":"2023-10-18T19:34:21.246025+0000","last_active":"2023-10-18T19:34:38.281669+0000","last_peered":"2023-10-18T19:34:38.281669+0000","last_clean":"2023-10-18T19:34:38.281669+0000","last_became_active":"2023-10-18T19:34:21.245735+0000","last_became_peered":"2023-10-18T19:34:21.245735+0000","last_unstale":"2023-10-18T19:34:38.281669+0000","last_undegraded":"2023-10-18T19:34:38.281669+0000","last_fullsized":"2023-10-18T19:34:38.281669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279099+0000","last_change":"2023-10-18T19:34:20.853312+0000","last_active":"2023-10-18T19:34:38.279099+0000","last_peered":"2023-10-18T19:34:38.279099+0000","last_clean":"2023-10-18T19:34:38.279099+0000","last_became_active":"2023-10-18T19:34:20.852964+0000","last_became_peered":"2023-10-18T19:34:20.852964+0000","last_unstale":"2023-10-18T19:34:38.279099+0000","last_undegraded":"2023-10-18T19:34:38.279099+0000","last_fullsized":"2023-10-18T19:34:38.279099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432978+0000","last_change":"2023-10-18T19:34:21.265408+0000","last_active":"2023-10-18T19:37:15.432978+0000","last_peered":"2023-10-18T19:37:15.432978+0000","last_clean":"2023-10-18T19:37:15.432978+0000","last_became_active":"2023-10-18T19:34:21.265029+0000","last_became_peered":"2023-10-18T19:34:21.265029+0000","last_unstale":"2023-10-18T19:37:15.432978+0000","last_undegraded":"2023-10-18T19:37:15.432978+0000","last_fullsized":"2023-10-18T19:37:15.432978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:11.800534+0000","last_change":"2023-10-18T19:34:20.825709+0000","last_active":"2023-10-18T19:35:11.800534+0000","last_peered":"2023-10-18T19:35:11.800534+0000","last_clean":"2023-10-18T19:35:11.800534+0000","last_became_active":"2023-10-18T19:34:20.825364+0000","last_became_peered":"2023-10-18T19:34:20.825364+0000","last_unstale":"2023-10-18T19:35:11.800534+0000","last_undegraded":"2023-10-18T19:35:11.800534+0000","last_fullsized":"2023-10-18T19:35:11.800534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734181+0000","last_change":"2023-10-18T19:34:21.250032+0000","last_active":"2023-10-18T19:34:38.734181+0000","last_peered":"2023-10-18T19:34:38.734181+0000","last_clean":"2023-10-18T19:34:38.734181+0000","last_became_active":"2023-10-18T19:34:21.245104+0000","last_became_peered":"2023-10-18T19:34:21.245104+0000","last_unstale":"2023-10-18T19:34:38.734181+0000","last_undegraded":"2023-10-18T19:34:38.734181+0000","last_fullsized":"2023-10-18T19:34:38.734181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734258+0000","last_change":"2023-10-18T19:34:20.862583+0000","last_active":"2023-10-18T19:34:38.734258+0000","last_peered":"2023-10-18T19:34:38.734258+0000","last_clean":"2023-10-18T19:34:38.734258+0000","last_became_active":"2023-10-18T19:34:20.862262+0000","last_became_peered":"2023-10-18T19:34:20.862262+0000","last_unstale":"2023-10-18T19:34:38.734258+0000","last_undegraded":"2023-10-18T19:34:38.734258+0000","last_fullsized":"2023-10-18T19:34:38.734258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281992+0000","last_change":"2023-10-18T19:34:21.265750+0000","last_active":"2023-10-18T19:34:38.281992+0000","last_peered":"2023-10-18T19:34:38.281992+0000","last_clean":"2023-10-18T19:34:38.281992+0000","last_became_active":"2023-10-18T19:34:21.265449+0000","last_became_peered":"2023-10-18T19:34:21.265449+0000","last_unstale":"2023-10-18T19:34:38.281992+0000","last_undegraded":"2023-10-18T19:34:38.281992+0000","last_fullsized":"2023-10-18T19:34:38.281992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281687+0000","last_change":"2023-10-18T19:34:20.855201+0000","last_active":"2023-10-18T19:34:38.281687+0000","last_peered":"2023-10-18T19:34:38.281687+0000","last_clean":"2023-10-18T19:34:38.281687+0000","last_became_active":"2023-10-18T19:34:20.854344+0000","last_became_peered":"2023-10-18T19:34:20.854344+0000","last_unstale":"2023-10-18T19:34:38.281687+0000","last_undegraded":"2023-10-18T19:34:38.281687+0000","last_fullsized":"2023-10-18T19:34:38.281687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734008+0000","last_change":"2023-10-18T19:34:21.249688+0000","last_active":"2023-10-18T19:34:38.734008+0000","last_peered":"2023-10-18T19:34:38.734008+0000","last_clean":"2023-10-18T19:34:38.734008+0000","last_became_active":"2023-10-18T19:34:21.246078+0000","last_became_peered":"2023-10-18T19:34:21.246078+0000","last_unstale":"2023-10-18T19:34:38.734008+0000","last_undegraded":"2023-10-18T19:34:38.734008+0000","last_fullsized":"2023-10-18T19:34:38.734008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.434758+0000","last_change":"2023-10-18T19:34:20.857791+0000","last_active":"2023-10-18T19:37:15.434758+0000","last_peered":"2023-10-18T19:37:15.434758+0000","last_clean":"2023-10-18T19:37:15.434758+0000","last_became_active":"2023-10-18T19:34:20.857489+0000","last_became_peered":"2023-10-18T19:34:20.857489+0000","last_unstale":"2023-10-18T19:37:15.434758+0000","last_undegraded":"2023-10-18T19:37:15.434758+0000","last_fullsized":"2023-10-18T19:37:15.434758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733296+0000","last_change":"2023-10-18T19:34:21.245879+0000","last_active":"2023-10-18T19:34:38.733296+0000","last_peered":"2023-10-18T19:34:38.733296+0000","last_clean":"2023-10-18T19:34:38.733296+0000","last_became_active":"2023-10-18T19:34:21.245587+0000","last_became_peered":"2023-10-18T19:34:21.245587+0000","last_unstale":"2023-10-18T19:34:38.733296+0000","last_undegraded":"2023-10-18T19:34:38.733296+0000","last_fullsized":"2023-10-18T19:34:38.733296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733510+0000","last_change":"2023-10-18T19:34:20.857559+0000","last_active":"2023-10-18T19:34:38.733510+0000","last_peered":"2023-10-18T19:34:38.733510+0000","last_clean":"2023-10-18T19:34:38.733510+0000","last_became_active":"2023-10-18T19:34:20.857227+0000","last_became_peered":"2023-10-18T19:34:20.857227+0000","last_unstale":"2023-10-18T19:34:38.733510+0000","last_undegraded":"2023-10-18T19:34:38.733510+0000","last_fullsized":"2023-10-18T19:34:38.733510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281235+0000","last_change":"2023-10-18T19:34:21.258745+0000","last_active":"2023-10-18T19:34:38.281235+0000","last_peered":"2023-10-18T19:34:38.281235+0000","last_clean":"2023-10-18T19:34:38.281235+0000","last_became_active":"2023-10-18T19:34:21.258295+0000","last_became_peered":"2023-10-18T19:34:21.258295+0000","last_unstale":"2023-10-18T19:34:38.281235+0000","last_undegraded":"2023-10-18T19:34:38.281235+0000","last_fullsized":"2023-10-18T19:34:38.281235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281065+0000","last_change":"2023-10-18T19:34:20.836255+0000","last_active":"2023-10-18T19:34:38.281065+0000","last_peered":"2023-10-18T19:34:38.281065+0000","last_clean":"2023-10-18T19:34:38.281065+0000","last_became_active":"2023-10-18T19:34:20.835941+0000","last_became_peered":"2023-10-18T19:34:20.835941+0000","last_unstale":"2023-10-18T19:34:38.281065+0000","last_undegraded":"2023-10-18T19:34:38.281065+0000","last_fullsized":"2023-10-18T19:34:38.281065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281432+0000","last_change":"2023-10-18T19:34:21.253538+0000","last_active":"2023-10-18T19:34:38.281432+0000","last_peered":"2023-10-18T19:34:38.281432+0000","last_clean":"2023-10-18T19:34:38.281432+0000","last_became_active":"2023-10-18T19:34:21.253274+0000","last_became_peered":"2023-10-18T19:34:21.253274+0000","last_unstale":"2023-10-18T19:34:38.281432+0000","last_undegraded":"2023-10-18T19:34:38.281432+0000","last_fullsized":"2023-10-18T19:34:38.281432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733135+0000","last_change":"2023-10-18T19:34:20.857139+0000","last_active":"2023-10-18T19:34:38.733135+0000","last_peered":"2023-10-18T19:34:38.733135+0000","last_clean":"2023-10-18T19:34:38.733135+0000","last_became_active":"2023-10-18T19:34:20.856766+0000","last_became_peered":"2023-10-18T19:34:20.856766+0000","last_unstale":"2023-10-18T19:34:38.733135+0000","last_undegraded":"2023-10-18T19:34:38.733135+0000","last_fullsized":"2023-10-18T19:34:38.733135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280240+0000","last_change":"2023-10-18T19:34:21.272980+0000","last_active":"2023-10-18T19:34:38.280240+0000","last_peered":"2023-10-18T19:34:38.280240+0000","last_clean":"2023-10-18T19:34:38.280240+0000","last_became_active":"2023-10-18T19:34:21.272618+0000","last_became_peered":"2023-10-18T19:34:21.272618+0000","last_unstale":"2023-10-18T19:34:38.280240+0000","last_undegraded":"2023-10-18T19:34:38.280240+0000","last_fullsized":"2023-10-18T19:34:38.280240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430950+0000","last_change":"2023-10-18T19:34:20.828547+0000","last_active":"2023-10-18T19:37:15.430950+0000","last_peered":"2023-10-18T19:37:15.430950+0000","last_clean":"2023-10-18T19:37:15.430950+0000","last_became_active":"2023-10-18T19:34:20.828036+0000","last_became_peered":"2023-10-18T19:34:20.828036+0000","last_unstale":"2023-10-18T19:37:15.430950+0000","last_undegraded":"2023-10-18T19:37:15.430950+0000","last_fullsized":"2023-10-18T19:37:15.430950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432549+0000","last_change":"2023-10-18T19:34:21.265823+0000","last_active":"2023-10-18T19:37:15.432549+0000","last_peered":"2023-10-18T19:37:15.432549+0000","last_clean":"2023-10-18T19:37:15.432549+0000","last_became_active":"2023-10-18T19:34:21.265276+0000","last_became_peered":"2023-10-18T19:34:21.265276+0000","last_unstale":"2023-10-18T19:37:15.432549+0000","last_undegraded":"2023-10-18T19:37:15.432549+0000","last_fullsized":"2023-10-18T19:37:15.432549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734440+0000","last_change":"2023-10-18T19:34:20.856792+0000","last_active":"2023-10-18T19:34:38.734440+0000","last_peered":"2023-10-18T19:34:38.734440+0000","last_clean":"2023-10-18T19:34:38.734440+0000","last_became_active":"2023-10-18T19:34:20.856486+0000","last_became_peered":"2023-10-18T19:34:20.856486+0000","last_unstale":"2023-10-18T19:34:38.734440+0000","last_undegraded":"2023-10-18T19:34:38.734440+0000","last_fullsized":"2023-10-18T19:34:38.734440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734257+0000","last_change":"2023-10-18T19:34:21.265884+0000","last_active":"2023-10-18T19:34:38.734257+0000","last_peered":"2023-10-18T19:34:38.734257+0000","last_clean":"2023-10-18T19:34:38.734257+0000","last_became_active":"2023-10-18T19:34:21.265564+0000","last_became_peered":"2023-10-18T19:34:21.265564+0000","last_unstale":"2023-10-18T19:34:38.734257+0000","last_undegraded":"2023-10-18T19:34:38.734257+0000","last_fullsized":"2023-10-18T19:34:38.734257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432913+0000","last_change":"2023-10-18T19:34:20.858811+0000","last_active":"2023-10-18T19:37:15.432913+0000","last_peered":"2023-10-18T19:37:15.432913+0000","last_clean":"2023-10-18T19:37:15.432913+0000","last_became_active":"2023-10-18T19:34:20.858481+0000","last_became_peered":"2023-10-18T19:34:20.858481+0000","last_unstale":"2023-10-18T19:37:15.432913+0000","last_undegraded":"2023-10-18T19:37:15.432913+0000","last_fullsized":"2023-10-18T19:37:15.432913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733566+0000","last_change":"2023-10-18T19:34:21.246195+0000","last_active":"2023-10-18T19:34:38.733566+0000","last_peered":"2023-10-18T19:34:38.733566+0000","last_clean":"2023-10-18T19:34:38.733566+0000","last_became_active":"2023-10-18T19:34:21.245896+0000","last_became_peered":"2023-10-18T19:34:21.245896+0000","last_unstale":"2023-10-18T19:34:38.733566+0000","last_undegraded":"2023-10-18T19:34:38.733566+0000","last_fullsized":"2023-10-18T19:34:38.733566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281781+0000","last_change":"2023-10-18T19:34:20.855423+0000","last_active":"2023-10-18T19:34:38.281781+0000","last_peered":"2023-10-18T19:34:38.281781+0000","last_clean":"2023-10-18T19:34:38.281781+0000","last_became_active":"2023-10-18T19:34:20.854593+0000","last_became_peered":"2023-10-18T19:34:20.854593+0000","last_unstale":"2023-10-18T19:34:38.281781+0000","last_undegraded":"2023-10-18T19:34:38.281781+0000","last_fullsized":"2023-10-18T19:34:38.281781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282176+0000","last_change":"2023-10-18T19:34:21.256949+0000","last_active":"2023-10-18T19:34:38.282176+0000","last_peered":"2023-10-18T19:34:38.282176+0000","last_clean":"2023-10-18T19:34:38.282176+0000","last_became_active":"2023-10-18T19:34:21.256623+0000","last_became_peered":"2023-10-18T19:34:21.256623+0000","last_unstale":"2023-10-18T19:34:38.282176+0000","last_undegraded":"2023-10-18T19:34:38.282176+0000","last_fullsized":"2023-10-18T19:34:38.282176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433109+0000","last_change":"2023-10-18T19:34:20.846802+0000","last_active":"2023-10-18T19:37:15.433109+0000","last_peered":"2023-10-18T19:37:15.433109+0000","last_clean":"2023-10-18T19:37:15.433109+0000","last_became_active":"2023-10-18T19:34:20.846249+0000","last_became_peered":"2023-10-18T19:34:20.846249+0000","last_unstale":"2023-10-18T19:37:15.433109+0000","last_undegraded":"2023-10-18T19:37:15.433109+0000","last_fullsized":"2023-10-18T19:37:15.433109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280549+0000","last_change":"2023-10-18T19:34:21.258895+0000","last_active":"2023-10-18T19:34:38.280549+0000","last_peered":"2023-10-18T19:34:38.280549+0000","last_clean":"2023-10-18T19:34:38.280549+0000","last_became_active":"2023-10-18T19:34:21.256384+0000","last_became_peered":"2023-10-18T19:34:21.256384+0000","last_unstale":"2023-10-18T19:34:38.280549+0000","last_undegraded":"2023-10-18T19:34:38.280549+0000","last_fullsized":"2023-10-18T19:34:38.280549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280964+0000","last_change":"2023-10-18T19:34:20.850016+0000","last_active":"2023-10-18T19:34:38.280964+0000","last_peered":"2023-10-18T19:34:38.280964+0000","last_clean":"2023-10-18T19:34:38.280964+0000","last_became_active":"2023-10-18T19:34:20.849501+0000","last_became_peered":"2023-10-18T19:34:20.849501+0000","last_unstale":"2023-10-18T19:34:38.280964+0000","last_undegraded":"2023-10-18T19:34:38.280964+0000","last_fullsized":"2023-10-18T19:34:38.280964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281151+0000","last_change":"2023-10-18T19:34:21.258646+0000","last_active":"2023-10-18T19:34:38.281151+0000","last_peered":"2023-10-18T19:34:38.281151+0000","last_clean":"2023-10-18T19:34:38.281151+0000","last_became_active":"2023-10-18T19:34:21.257999+0000","last_became_peered":"2023-10-18T19:34:21.257999+0000","last_unstale":"2023-10-18T19:34:38.281151+0000","last_undegraded":"2023-10-18T19:34:38.281151+0000","last_fullsized":"2023-10-18T19:34:38.281151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281871+0000","last_change":"2023-10-18T19:34:20.856264+0000","last_active":"2023-10-18T19:34:38.281871+0000","last_peered":"2023-10-18T19:34:38.281871+0000","last_clean":"2023-10-18T19:34:38.281871+0000","last_became_active":"2023-10-18T19:34:20.856072+0000","last_became_peered":"2023-10-18T19:34:20.856072+0000","last_unstale":"2023-10-18T19:34:38.281871+0000","last_undegraded":"2023-10-18T19:34:38.281871+0000","last_fullsized":"2023-10-18T19:34:38.281871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279415+0000","last_change":"2023-10-18T19:34:21.242536+0000","last_active":"2023-10-18T19:34:38.279415+0000","last_peered":"2023-10-18T19:34:38.279415+0000","last_clean":"2023-10-18T19:34:38.279415+0000","last_became_active":"2023-10-18T19:34:21.242187+0000","last_became_peered":"2023-10-18T19:34:21.242187+0000","last_unstale":"2023-10-18T19:34:38.279415+0000","last_undegraded":"2023-10-18T19:34:38.279415+0000","last_fullsized":"2023-10-18T19:34:38.279415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281401+0000","last_change":"2023-10-18T19:34:20.844847+0000","last_active":"2023-10-18T19:34:38.281401+0000","last_peered":"2023-10-18T19:34:38.281401+0000","last_clean":"2023-10-18T19:34:38.281401+0000","last_became_active":"2023-10-18T19:34:20.844528+0000","last_became_peered":"2023-10-18T19:34:20.844528+0000","last_unstale":"2023-10-18T19:34:38.281401+0000","last_undegraded":"2023-10-18T19:34:38.281401+0000","last_fullsized":"2023-10-18T19:34:38.281401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280217+0000","last_change":"2023-10-18T19:34:21.272824+0000","last_active":"2023-10-18T19:34:38.280217+0000","last_peered":"2023-10-18T19:34:38.280217+0000","last_clean":"2023-10-18T19:34:38.280217+0000","last_became_active":"2023-10-18T19:34:21.272631+0000","last_became_peered":"2023-10-18T19:34:21.272631+0000","last_unstale":"2023-10-18T19:34:38.280217+0000","last_undegraded":"2023-10-18T19:34:38.280217+0000","last_fullsized":"2023-10-18T19:34:38.280217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732827+0000","last_change":"2023-10-18T19:34:20.833452+0000","last_active":"2023-10-18T19:34:38.732827+0000","last_peered":"2023-10-18T19:34:38.732827+0000","last_clean":"2023-10-18T19:34:38.732827+0000","last_became_active":"2023-10-18T19:34:20.832840+0000","last_became_peered":"2023-10-18T19:34:20.832840+0000","last_unstale":"2023-10-18T19:34:38.732827+0000","last_undegraded":"2023-10-18T19:34:38.732827+0000","last_fullsized":"2023-10-18T19:34:38.732827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-18T19:37:16.342037+0000","last_change":"2023-10-18T19:37:16.342037+0000","last_active":"2023-10-18T19:37:16.342037+0000","last_peered":"2023-10-18T19:37:16.342037+0000","last_clean":"2023-10-18T19:37:16.342037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-18T19:37:16.342037+0000","last_undegraded":"2023-10-18T19:37:16.342037+0000","last_fullsized":"2023-10-18T19:37:16.342037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282848+0000","last_change":"2023-10-18T19:34:21.255174+0000","last_active":"2023-10-18T19:34:38.282848+0000","last_peered":"2023-10-18T19:34:38.282848+0000","last_clean":"2023-10-18T19:34:38.282848+0000","last_became_active":"2023-10-18T19:34:21.252377+0000","last_became_peered":"2023-10-18T19:34:21.252377+0000","last_unstale":"2023-10-18T19:34:38.282848+0000","last_undegraded":"2023-10-18T19:34:38.282848+0000","last_fullsized":"2023-10-18T19:34:38.282848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432775+0000","last_change":"2023-10-18T19:34:11.535715+0000","last_active":"2023-10-18T19:37:15.432775+0000","last_peered":"2023-10-18T19:37:15.432775+0000","last_clean":"2023-10-18T19:37:15.432775+0000","last_became_active":"2023-10-18T19:34:11.534518+0000","last_became_peered":"2023-10-18T19:34:11.534518+0000","last_unstale":"2023-10-18T19:37:15.432775+0000","last_undegraded":"2023-10-18T19:37:15.432775+0000","last_fullsized":"2023-10-18T19:37:15.432775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282276+0000","last_change":"2023-10-18T19:34:20.857782+0000","last_active":"2023-10-18T19:34:38.282276+0000","last_peered":"2023-10-18T19:34:38.282276+0000","last_clean":"2023-10-18T19:34:38.282276+0000","last_became_active":"2023-10-18T19:34:20.853192+0000","last_became_peered":"2023-10-18T19:34:20.853192+0000","last_unstale":"2023-10-18T19:34:38.282276+0000","last_undegraded":"2023-10-18T19:34:38.282276+0000","last_fullsized":"2023-10-18T19:34:38.282276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734825+0000","last_change":"2023-10-18T19:34:21.257423+0000","last_active":"2023-10-18T19:34:38.734825+0000","last_peered":"2023-10-18T19:34:38.734825+0000","last_clean":"2023-10-18T19:34:38.734825+0000","last_became_active":"2023-10-18T19:34:21.256448+0000","last_became_peered":"2023-10-18T19:34:21.256448+0000","last_unstale":"2023-10-18T19:34:38.734825+0000","last_undegraded":"2023-10-18T19:34:38.734825+0000","last_fullsized":"2023-10-18T19:34:38.734825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282069+0000","last_change":"2023-10-18T19:34:11.532756+0000","last_active":"2023-10-18T19:34:38.282069+0000","last_peered":"2023-10-18T19:34:38.282069+0000","last_clean":"2023-10-18T19:34:38.282069+0000","last_became_active":"2023-10-18T19:34:11.532425+0000","last_became_peered":"2023-10-18T19:34:11.532425+0000","last_unstale":"2023-10-18T19:34:38.282069+0000","last_undegraded":"2023-10-18T19:34:38.282069+0000","last_fullsized":"2023-10-18T19:34:38.282069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.852964+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.852642+0000","last_became_peered":"2023-10-18T19:34:20.852642+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281876+0000","last_change":"2023-10-18T19:34:11.534856+0000","last_active":"2023-10-18T19:34:38.281876+0000","last_peered":"2023-10-18T19:34:38.281876+0000","last_clean":"2023-10-18T19:34:38.281876+0000","last_became_active":"2023-10-18T19:34:11.534541+0000","last_became_peered":"2023-10-18T19:34:11.534541+0000","last_unstale":"2023-10-18T19:34:38.281876+0000","last_undegraded":"2023-10-18T19:34:38.281876+0000","last_fullsized":"2023-10-18T19:34:38.281876+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279117+0000","last_change":"2023-10-18T19:34:20.847678+0000","last_active":"2023-10-18T19:34:38.279117+0000","last_peered":"2023-10-18T19:34:38.279117+0000","last_clean":"2023-10-18T19:34:38.279117+0000","last_became_active":"2023-10-18T19:34:20.847107+0000","last_became_peered":"2023-10-18T19:34:20.847107+0000","last_unstale":"2023-10-18T19:34:38.279117+0000","last_undegraded":"2023-10-18T19:34:38.279117+0000","last_fullsized":"2023-10-18T19:34:38.279117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733124+0000","last_change":"2023-10-18T19:34:21.255564+0000","last_active":"2023-10-18T19:34:38.733124+0000","last_peered":"2023-10-18T19:34:38.733124+0000","last_clean":"2023-10-18T19:34:38.733124+0000","last_became_active":"2023-10-18T19:34:21.255230+0000","last_became_peered":"2023-10-18T19:34:21.255230+0000","last_unstale":"2023-10-18T19:34:38.733124+0000","last_undegraded":"2023-10-18T19:34:38.733124+0000","last_fullsized":"2023-10-18T19:34:38.733124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733197+0000","last_change":"2023-10-18T19:34:11.535128+0000","last_active":"2023-10-18T19:34:38.733197+0000","last_peered":"2023-10-18T19:34:38.733197+0000","last_clean":"2023-10-18T19:34:38.733197+0000","last_became_active":"2023-10-18T19:34:11.534248+0000","last_became_peered":"2023-10-18T19:34:11.534248+0000","last_unstale":"2023-10-18T19:34:38.733197+0000","last_undegraded":"2023-10-18T19:34:38.733197+0000","last_fullsized":"2023-10-18T19:34:38.733197+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431228+0000","last_change":"2023-10-18T19:34:20.855194+0000","last_active":"2023-10-18T19:37:15.431228+0000","last_peered":"2023-10-18T19:37:15.431228+0000","last_clean":"2023-10-18T19:37:15.431228+0000","last_became_active":"2023-10-18T19:34:20.854897+0000","last_became_peered":"2023-10-18T19:34:20.854897+0000","last_unstale":"2023-10-18T19:37:15.431228+0000","last_undegraded":"2023-10-18T19:37:15.431228+0000","last_fullsized":"2023-10-18T19:37:15.431228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281390+0000","last_change":"2023-10-18T19:34:21.270017+0000","last_active":"2023-10-18T19:34:38.281390+0000","last_peered":"2023-10-18T19:34:38.281390+0000","last_clean":"2023-10-18T19:34:38.281390+0000","last_became_active":"2023-10-18T19:34:21.269485+0000","last_became_peered":"2023-10-18T19:34:21.269485+0000","last_unstale":"2023-10-18T19:34:38.281390+0000","last_undegraded":"2023-10-18T19:34:38.281390+0000","last_fullsized":"2023-10-18T19:34:38.281390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281541+0000","last_change":"2023-10-18T19:34:11.532872+0000","last_active":"2023-10-18T19:34:38.281541+0000","last_peered":"2023-10-18T19:34:38.281541+0000","last_clean":"2023-10-18T19:34:38.281541+0000","last_became_active":"2023-10-18T19:34:11.531562+0000","last_became_peered":"2023-10-18T19:34:11.531562+0000","last_unstale":"2023-10-18T19:34:38.281541+0000","last_undegraded":"2023-10-18T19:34:38.281541+0000","last_fullsized":"2023-10-18T19:34:38.281541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:06.799201+0000","last_change":"2023-10-18T19:34:20.852891+0000","last_active":"2023-10-18T19:35:06.799201+0000","last_peered":"2023-10-18T19:35:06.799201+0000","last_clean":"2023-10-18T19:35:06.799201+0000","last_became_active":"2023-10-18T19:34:20.852426+0000","last_became_peered":"2023-10-18T19:34:20.852426+0000","last_unstale":"2023-10-18T19:35:06.799201+0000","last_undegraded":"2023-10-18T19:35:06.799201+0000","last_fullsized":"2023-10-18T19:35:06.799201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280643+0000","last_change":"2023-10-18T19:34:21.266390+0000","last_active":"2023-10-18T19:34:38.280643+0000","last_peered":"2023-10-18T19:34:38.280643+0000","last_clean":"2023-10-18T19:34:38.280643+0000","last_became_active":"2023-10-18T19:34:21.266089+0000","last_became_peered":"2023-10-18T19:34:21.266089+0000","last_unstale":"2023-10-18T19:34:38.280643+0000","last_undegraded":"2023-10-18T19:34:38.280643+0000","last_fullsized":"2023-10-18T19:34:38.280643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279963+0000","last_change":"2023-10-18T19:34:11.532565+0000","last_active":"2023-10-18T19:34:38.279963+0000","last_peered":"2023-10-18T19:34:38.279963+0000","last_clean":"2023-10-18T19:34:38.279963+0000","last_became_active":"2023-10-18T19:34:11.532168+0000","last_became_peered":"2023-10-18T19:34:11.532168+0000","last_unstale":"2023-10-18T19:34:38.279963+0000","last_undegraded":"2023-10-18T19:34:38.279963+0000","last_fullsized":"2023-10-18T19:34:38.279963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280817+0000","last_change":"2023-10-18T19:34:20.852330+0000","last_active":"2023-10-18T19:34:38.280817+0000","last_peered":"2023-10-18T19:34:38.280817+0000","last_clean":"2023-10-18T19:34:38.280817+0000","last_became_active":"2023-10-18T19:34:20.851992+0000","last_became_peered":"2023-10-18T19:34:20.851992+0000","last_unstale":"2023-10-18T19:34:38.280817+0000","last_undegraded":"2023-10-18T19:34:38.280817+0000","last_fullsized":"2023-10-18T19:34:38.280817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733604+0000","last_change":"2023-10-18T19:34:21.264314+0000","last_active":"2023-10-18T19:34:38.733604+0000","last_peered":"2023-10-18T19:34:38.733604+0000","last_clean":"2023-10-18T19:34:38.733604+0000","last_became_active":"2023-10-18T19:34:21.263937+0000","last_became_peered":"2023-10-18T19:34:21.263937+0000","last_unstale":"2023-10-18T19:34:38.733604+0000","last_undegraded":"2023-10-18T19:34:38.733604+0000","last_fullsized":"2023-10-18T19:34:38.733604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282680+0000","last_change":"2023-10-18T19:34:11.533453+0000","last_active":"2023-10-18T19:34:38.282680+0000","last_peered":"2023-10-18T19:34:38.282680+0000","last_clean":"2023-10-18T19:34:38.282680+0000","last_became_active":"2023-10-18T19:34:11.532769+0000","last_became_peered":"2023-10-18T19:34:11.532769+0000","last_unstale":"2023-10-18T19:34:38.282680+0000","last_undegraded":"2023-10-18T19:34:38.282680+0000","last_fullsized":"2023-10-18T19:34:38.282680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282101+0000","last_change":"2023-10-18T19:34:20.853145+0000","last_active":"2023-10-18T19:34:38.282101+0000","last_peered":"2023-10-18T19:34:38.282101+0000","last_clean":"2023-10-18T19:34:38.282101+0000","last_became_active":"2023-10-18T19:34:20.852683+0000","last_became_peered":"2023-10-18T19:34:20.852683+0000","last_unstale":"2023-10-18T19:34:38.282101+0000","last_undegraded":"2023-10-18T19:34:38.282101+0000","last_fullsized":"2023-10-18T19:34:38.282101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282182+0000","last_change":"2023-10-18T19:34:21.266346+0000","last_active":"2023-10-18T19:34:38.282182+0000","last_peered":"2023-10-18T19:34:38.282182+0000","last_clean":"2023-10-18T19:34:38.282182+0000","last_became_active":"2023-10-18T19:34:21.265950+0000","last_became_peered":"2023-10-18T19:34:21.265950+0000","last_unstale":"2023-10-18T19:34:38.282182+0000","last_undegraded":"2023-10-18T19:34:38.282182+0000","last_fullsized":"2023-10-18T19:34:38.282182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282658+0000","last_change":"2023-10-18T19:34:11.533454+0000","last_active":"2023-10-18T19:34:38.282658+0000","last_peered":"2023-10-18T19:34:38.282658+0000","last_clean":"2023-10-18T19:34:38.282658+0000","last_became_active":"2023-10-18T19:34:11.533123+0000","last_became_peered":"2023-10-18T19:34:11.533123+0000","last_unstale":"2023-10-18T19:34:38.282658+0000","last_undegraded":"2023-10-18T19:34:38.282658+0000","last_fullsized":"2023-10-18T19:34:38.282658+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281898+0000","last_change":"2023-10-18T19:34:20.844955+0000","last_active":"2023-10-18T19:34:38.281898+0000","last_peered":"2023-10-18T19:34:38.281898+0000","last_clean":"2023-10-18T19:34:38.281898+0000","last_became_active":"2023-10-18T19:34:20.844711+0000","last_became_peered":"2023-10-18T19:34:20.844711+0000","last_unstale":"2023-10-18T19:34:38.281898+0000","last_undegraded":"2023-10-18T19:34:38.281898+0000","last_fullsized":"2023-10-18T19:34:38.281898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431387+0000","last_change":"2023-10-18T19:34:21.256370+0000","last_active":"2023-10-18T19:37:15.431387+0000","last_peered":"2023-10-18T19:37:15.431387+0000","last_clean":"2023-10-18T19:37:15.431387+0000","last_became_active":"2023-10-18T19:34:21.256084+0000","last_became_peered":"2023-10-18T19:34:21.256084+0000","last_unstale":"2023-10-18T19:37:15.431387+0000","last_undegraded":"2023-10-18T19:37:15.431387+0000","last_fullsized":"2023-10-18T19:37:15.431387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282545+0000","last_change":"2023-10-18T19:34:21.253778+0000","last_active":"2023-10-18T19:34:38.282545+0000","last_peered":"2023-10-18T19:34:38.282545+0000","last_clean":"2023-10-18T19:34:38.282545+0000","last_became_active":"2023-10-18T19:34:21.251946+0000","last_became_peered":"2023-10-18T19:34:21.251946+0000","last_unstale":"2023-10-18T19:34:38.282545+0000","last_undegraded":"2023-10-18T19:34:38.282545+0000","last_fullsized":"2023-10-18T19:34:38.282545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733900+0000","last_change":"2023-10-18T19:34:20.862585+0000","last_active":"2023-10-18T19:34:38.733900+0000","last_peered":"2023-10-18T19:34:38.733900+0000","last_clean":"2023-10-18T19:34:38.733900+0000","last_became_active":"2023-10-18T19:34:20.862326+0000","last_became_peered":"2023-10-18T19:34:20.862326+0000","last_unstale":"2023-10-18T19:34:38.733900+0000","last_undegraded":"2023-10-18T19:34:38.733900+0000","last_fullsized":"2023-10-18T19:34:38.733900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281804+0000","last_change":"2023-10-18T19:34:21.259196+0000","last_active":"2023-10-18T19:34:38.281804+0000","last_peered":"2023-10-18T19:34:38.281804+0000","last_clean":"2023-10-18T19:34:38.281804+0000","last_became_active":"2023-10-18T19:34:21.258884+0000","last_became_peered":"2023-10-18T19:34:21.258884+0000","last_unstale":"2023-10-18T19:34:38.281804+0000","last_undegraded":"2023-10-18T19:34:38.281804+0000","last_fullsized":"2023-10-18T19:34:38.281804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733897+0000","last_change":"2023-10-18T19:34:20.863893+0000","last_active":"2023-10-18T19:34:38.733897+0000","last_peered":"2023-10-18T19:34:38.733897+0000","last_clean":"2023-10-18T19:34:38.733897+0000","last_became_active":"2023-10-18T19:34:20.863549+0000","last_became_peered":"2023-10-18T19:34:20.863549+0000","last_unstale":"2023-10-18T19:34:38.733897+0000","last_undegraded":"2023-10-18T19:34:38.733897+0000","last_fullsized":"2023-10-18T19:34:38.733897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734602+0000","last_change":"2023-10-18T19:34:21.261264+0000","last_active":"2023-10-18T19:34:38.734602+0000","last_peered":"2023-10-18T19:34:38.734602+0000","last_clean":"2023-10-18T19:34:38.734602+0000","last_became_active":"2023-10-18T19:34:21.260951+0000","last_became_peered":"2023-10-18T19:34:21.260951+0000","last_unstale":"2023-10-18T19:34:38.734602+0000","last_undegraded":"2023-10-18T19:34:38.734602+0000","last_fullsized":"2023-10-18T19:34:38.734602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.853421+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.853091+0000","last_became_peered":"2023-10-18T19:34:20.853091+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282564+0000","last_change":"2023-10-18T19:34:21.274214+0000","last_active":"2023-10-18T19:34:38.282564+0000","last_peered":"2023-10-18T19:34:38.282564+0000","last_clean":"2023-10-18T19:34:38.282564+0000","last_became_active":"2023-10-18T19:34:21.273899+0000","last_became_peered":"2023-10-18T19:34:21.273899+0000","last_unstale":"2023-10-18T19:34:38.282564+0000","last_undegraded":"2023-10-18T19:34:38.282564+0000","last_fullsized":"2023-10-18T19:34:38.282564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734358+0000","last_change":"2023-10-18T19:34:20.860150+0000","last_active":"2023-10-18T19:34:38.734358+0000","last_peered":"2023-10-18T19:34:38.734358+0000","last_clean":"2023-10-18T19:34:38.734358+0000","last_became_active":"2023-10-18T19:34:20.859836+0000","last_became_peered":"2023-10-18T19:34:20.859836+0000","last_unstale":"2023-10-18T19:34:38.734358+0000","last_undegraded":"2023-10-18T19:34:38.734358+0000","last_fullsized":"2023-10-18T19:34:38.734358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432488+0000","last_change":"2023-10-18T19:34:21.260022+0000","last_active":"2023-10-18T19:37:15.432488+0000","last_peered":"2023-10-18T19:37:15.432488+0000","last_clean":"2023-10-18T19:37:15.432488+0000","last_became_active":"2023-10-18T19:34:21.259630+0000","last_became_peered":"2023-10-18T19:34:21.259630+0000","last_unstale":"2023-10-18T19:37:15.432488+0000","last_undegraded":"2023-10-18T19:37:15.432488+0000","last_fullsized":"2023-10-18T19:37:15.432488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279207+0000","last_change":"2023-10-18T19:34:20.832124+0000","last_active":"2023-10-18T19:34:38.279207+0000","last_peered":"2023-10-18T19:34:38.279207+0000","last_clean":"2023-10-18T19:34:38.279207+0000","last_became_active":"2023-10-18T19:34:20.831830+0000","last_became_peered":"2023-10-18T19:34:20.831830+0000","last_unstale":"2023-10-18T19:34:38.279207+0000","last_undegraded":"2023-10-18T19:34:38.279207+0000","last_fullsized":"2023-10-18T19:34:38.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430926+0000","last_change":"2023-10-18T19:34:21.263372+0000","last_active":"2023-10-18T19:37:15.430926+0000","last_peered":"2023-10-18T19:37:15.430926+0000","last_clean":"2023-10-18T19:37:15.430926+0000","last_became_active":"2023-10-18T19:34:21.256876+0000","last_became_peered":"2023-10-18T19:34:21.256876+0000","last_unstale":"2023-10-18T19:37:15.430926+0000","last_undegraded":"2023-10-18T19:37:15.430926+0000","last_fullsized":"2023-10-18T19:37:15.430926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431460+0000","last_change":"2023-10-18T19:34:20.846546+0000","last_active":"2023-10-18T19:37:15.431460+0000","last_peered":"2023-10-18T19:37:15.431460+0000","last_clean":"2023-10-18T19:37:15.431460+0000","last_became_active":"2023-10-18T19:34:20.846229+0000","last_became_peered":"2023-10-18T19:34:20.846229+0000","last_unstale":"2023-10-18T19:37:15.431460+0000","last_undegraded":"2023-10-18T19:37:15.431460+0000","last_fullsized":"2023-10-18T19:37:15.431460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733497+0000","last_change":"2023-10-18T19:34:21.248032+0000","last_active":"2023-10-18T19:34:38.733497+0000","last_peered":"2023-10-18T19:34:38.733497+0000","last_clean":"2023-10-18T19:34:38.733497+0000","last_became_active":"2023-10-18T19:34:21.247196+0000","last_became_peered":"2023-10-18T19:34:21.247196+0000","last_unstale":"2023-10-18T19:34:38.733497+0000","last_undegraded":"2023-10-18T19:34:38.733497+0000","last_fullsized":"2023-10-18T19:34:38.733497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280987+0000","last_change":"2023-10-18T19:34:20.847408+0000","last_active":"2023-10-18T19:34:38.280987+0000","last_peered":"2023-10-18T19:34:38.280987+0000","last_clean":"2023-10-18T19:34:38.280987+0000","last_became_active":"2023-10-18T19:34:20.847100+0000","last_became_peered":"2023-10-18T19:34:20.847100+0000","last_unstale":"2023-10-18T19:34:38.280987+0000","last_undegraded":"2023-10-18T19:34:38.280987+0000","last_fullsized":"2023-10-18T19:34:38.280987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280644+0000","last_change":"2023-10-18T19:34:21.256724+0000","last_active":"2023-10-18T19:34:38.280644+0000","last_peered":"2023-10-18T19:34:38.280644+0000","last_clean":"2023-10-18T19:34:38.280644+0000","last_became_active":"2023-10-18T19:34:21.256252+0000","last_became_peered":"2023-10-18T19:34:21.256252+0000","last_unstale":"2023-10-18T19:34:38.280644+0000","last_undegraded":"2023-10-18T19:34:38.280644+0000","last_fullsized":"2023-10-18T19:34:38.280644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281329+0000","last_change":"2023-10-18T19:34:20.846959+0000","last_active":"2023-10-18T19:34:38.281329+0000","last_peered":"2023-10-18T19:34:38.281329+0000","last_clean":"2023-10-18T19:34:38.281329+0000","last_became_active":"2023-10-18T19:34:20.846541+0000","last_became_peered":"2023-10-18T19:34:20.846541+0000","last_unstale":"2023-10-18T19:34:38.281329+0000","last_undegraded":"2023-10-18T19:34:38.281329+0000","last_fullsized":"2023-10-18T19:34:38.281329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282350+0000","last_change":"2023-10-18T19:34:21.251998+0000","last_active":"2023-10-18T19:34:38.282350+0000","last_peered":"2023-10-18T19:34:38.282350+0000","last_clean":"2023-10-18T19:34:38.282350+0000","last_became_active":"2023-10-18T19:34:21.251641+0000","last_became_peered":"2023-10-18T19:34:21.251641+0000","last_unstale":"2023-10-18T19:34:38.282350+0000","last_undegraded":"2023-10-18T19:34:38.282350+0000","last_fullsized":"2023-10-18T19:34:38.282350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281984+0000","last_change":"2023-10-18T19:34:20.844433+0000","last_active":"2023-10-18T19:34:38.281984+0000","last_peered":"2023-10-18T19:34:38.281984+0000","last_clean":"2023-10-18T19:34:38.281984+0000","last_became_active":"2023-10-18T19:34:20.843767+0000","last_became_peered":"2023-10-18T19:34:20.843767+0000","last_unstale":"2023-10-18T19:34:38.281984+0000","last_undegraded":"2023-10-18T19:34:38.281984+0000","last_fullsized":"2023-10-18T19:34:38.281984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282148+0000","last_change":"2023-10-18T19:34:21.259590+0000","last_active":"2023-10-18T19:34:38.282148+0000","last_peered":"2023-10-18T19:34:38.282148+0000","last_clean":"2023-10-18T19:34:38.282148+0000","last_became_active":"2023-10-18T19:34:21.257762+0000","last_became_peered":"2023-10-18T19:34:21.257762+0000","last_unstale":"2023-10-18T19:34:38.282148+0000","last_undegraded":"2023-10-18T19:34:38.282148+0000","last_fullsized":"2023-10-18T19:34:38.282148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432829+0000","last_change":"2023-10-18T19:34:20.845853+0000","last_active":"2023-10-18T19:37:15.432829+0000","last_peered":"2023-10-18T19:37:15.432829+0000","last_clean":"2023-10-18T19:37:15.432829+0000","last_became_active":"2023-10-18T19:34:20.845487+0000","last_became_peered":"2023-10-18T19:34:20.845487+0000","last_unstale":"2023-10-18T19:37:15.432829+0000","last_undegraded":"2023-10-18T19:37:15.432829+0000","last_fullsized":"2023-10-18T19:37:15.432829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282909+0000","last_change":"2023-10-18T19:34:21.255163+0000","last_active":"2023-10-18T19:34:38.282909+0000","last_peered":"2023-10-18T19:34:38.282909+0000","last_clean":"2023-10-18T19:34:38.282909+0000","last_became_active":"2023-10-18T19:34:21.252262+0000","last_became_peered":"2023-10-18T19:34:21.252262+0000","last_unstale":"2023-10-18T19:34:38.282909+0000","last_undegraded":"2023-10-18T19:34:38.282909+0000","last_fullsized":"2023-10-18T19:34:38.282909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:56.775862+0000","last_change":"2023-10-18T19:34:20.861998+0000","last_active":"2023-10-18T19:34:56.775862+0000","last_peered":"2023-10-18T19:34:56.775862+0000","last_clean":"2023-10-18T19:34:56.775862+0000","last_became_active":"2023-10-18T19:34:20.860333+0000","last_became_peered":"2023-10-18T19:34:20.860333+0000","last_unstale":"2023-10-18T19:34:56.775862+0000","last_undegraded":"2023-10-18T19:34:56.775862+0000","last_fullsized":"2023-10-18T19:34:56.775862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433015+0000","last_change":"2023-10-18T19:34:21.258083+0000","last_active":"2023-10-18T19:37:15.433015+0000","last_peered":"2023-10-18T19:37:15.433015+0000","last_clean":"2023-10-18T19:37:15.433015+0000","last_became_active":"2023-10-18T19:34:21.257626+0000","last_became_peered":"2023-10-18T19:34:21.257626+0000","last_unstale":"2023-10-18T19:37:15.433015+0000","last_undegraded":"2023-10-18T19:37:15.433015+0000","last_fullsized":"2023-10-18T19:37:15.433015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282770+0000","last_change":"2023-10-18T19:34:20.855980+0000","last_active":"2023-10-18T19:34:38.282770+0000","last_peered":"2023-10-18T19:34:38.282770+0000","last_clean":"2023-10-18T19:34:38.282770+0000","last_became_active":"2023-10-18T19:34:20.855446+0000","last_became_peered":"2023-10-18T19:34:20.855446+0000","last_unstale":"2023-10-18T19:34:38.282770+0000","last_undegraded":"2023-10-18T19:34:38.282770+0000","last_fullsized":"2023-10-18T19:34:38.282770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280057+0000","last_change":"2023-10-18T19:34:21.267157+0000","last_active":"2023-10-18T19:34:38.280057+0000","last_peered":"2023-10-18T19:34:38.280057+0000","last_clean":"2023-10-18T19:34:38.280057+0000","last_became_active":"2023-10-18T19:34:21.266854+0000","last_became_peered":"2023-10-18T19:34:21.266854+0000","last_unstale":"2023-10-18T19:34:38.280057+0000","last_undegraded":"2023-10-18T19:34:38.280057+0000","last_fullsized":"2023-10-18T19:34:38.280057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279385+0000","last_change":"2023-10-18T19:34:20.847879+0000","last_active":"2023-10-18T19:34:38.279385+0000","last_peered":"2023-10-18T19:34:38.279385+0000","last_clean":"2023-10-18T19:34:38.279385+0000","last_became_active":"2023-10-18T19:34:20.847368+0000","last_became_peered":"2023-10-18T19:34:20.847368+0000","last_unstale":"2023-10-18T19:34:38.279385+0000","last_undegraded":"2023-10-18T19:34:38.279385+0000","last_fullsized":"2023-10-18T19:34:38.279385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279012+0000","last_change":"2023-10-18T19:34:21.271229+0000","last_active":"2023-10-18T19:34:38.279012+0000","last_peered":"2023-10-18T19:34:38.279012+0000","last_clean":"2023-10-18T19:34:38.279012+0000","last_became_active":"2023-10-18T19:34:21.270946+0000","last_became_peered":"2023-10-18T19:34:21.270946+0000","last_unstale":"2023-10-18T19:34:38.279012+0000","last_undegraded":"2023-10-18T19:34:38.279012+0000","last_fullsized":"2023-10-18T19:34:38.279012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281579+0000","last_change":"2023-10-18T19:34:20.857540+0000","last_active":"2023-10-18T19:34:38.281579+0000","last_peered":"2023-10-18T19:34:38.281579+0000","last_clean":"2023-10-18T19:34:38.281579+0000","last_became_active":"2023-10-18T19:34:20.857056+0000","last_became_peered":"2023-10-18T19:34:20.857056+0000","last_unstale":"2023-10-18T19:34:38.281579+0000","last_undegraded":"2023-10-18T19:34:38.281579+0000","last_fullsized":"2023-10-18T19:34:38.281579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733162+0000","last_change":"2023-10-18T19:34:21.264597+0000","last_active":"2023-10-18T19:34:38.733162+0000","last_peered":"2023-10-18T19:34:38.733162+0000","last_clean":"2023-10-18T19:34:38.733162+0000","last_became_active":"2023-10-18T19:34:21.264304+0000","last_became_peered":"2023-10-18T19:34:21.264304+0000","last_unstale":"2023-10-18T19:34:38.733162+0000","last_undegraded":"2023-10-18T19:34:38.733162+0000","last_fullsized":"2023-10-18T19:34:38.733162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.798950+0000","last_change":"2023-10-18T19:34:20.830160+0000","last_active":"2023-10-18T19:35:01.798950+0000","last_peered":"2023-10-18T19:35:01.798950+0000","last_clean":"2023-10-18T19:35:01.798950+0000","last_became_active":"2023-10-18T19:34:20.829821+0000","last_became_peered":"2023-10-18T19:34:20.829821+0000","last_unstale":"2023-10-18T19:35:01.798950+0000","last_undegraded":"2023-10-18T19:35:01.798950+0000","last_fullsized":"2023-10-18T19:35:01.798950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282061+0000","last_change":"2023-10-18T19:34:21.250388+0000","last_active":"2023-10-18T19:34:38.282061+0000","last_peered":"2023-10-18T19:34:38.282061+0000","last_clean":"2023-10-18T19:34:38.282061+0000","last_became_active":"2023-10-18T19:34:21.250098+0000","last_became_peered":"2023-10-18T19:34:21.250098+0000","last_unstale":"2023-10-18T19:34:38.282061+0000","last_undegraded":"2023-10-18T19:34:38.282061+0000","last_fullsized":"2023-10-18T19:34:38.282061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431970+0000","last_change":"2023-10-18T19:34:20.857726+0000","last_active":"2023-10-18T19:37:15.431970+0000","last_peered":"2023-10-18T19:37:15.431970+0000","last_clean":"2023-10-18T19:37:15.431970+0000","last_became_active":"2023-10-18T19:34:20.856983+0000","last_became_peered":"2023-10-18T19:34:20.856983+0000","last_unstale":"2023-10-18T19:37:15.431970+0000","last_undegraded":"2023-10-18T19:37:15.431970+0000","last_fullsized":"2023-10-18T19:37:15.431970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282838+0000","last_change":"2023-10-18T19:34:21.270485+0000","last_active":"2023-10-18T19:34:38.282838+0000","last_peered":"2023-10-18T19:34:38.282838+0000","last_clean":"2023-10-18T19:34:38.282838+0000","last_became_active":"2023-10-18T19:34:21.270140+0000","last_became_peered":"2023-10-18T19:34:21.270140+0000","last_unstale":"2023-10-18T19:34:38.282838+0000","last_undegraded":"2023-10-18T19:34:38.282838+0000","last_fullsized":"2023-10-18T19:34:38.282838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432509+0000","last_change":"2023-10-18T19:34:20.847009+0000","last_active":"2023-10-18T19:37:15.432509+0000","last_peered":"2023-10-18T19:37:15.432509+0000","last_clean":"2023-10-18T19:37:15.432509+0000","last_became_active":"2023-10-18T19:34:20.846481+0000","last_became_peered":"2023-10-18T19:34:20.846481+0000","last_unstale":"2023-10-18T19:37:15.432509+0000","last_undegraded":"2023-10-18T19:37:15.432509+0000","last_fullsized":"2023-10-18T19:37:15.432509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733909+0000","last_change":"2023-10-18T19:34:21.256060+0000","last_active":"2023-10-18T19:34:38.733909+0000","last_peered":"2023-10-18T19:34:38.733909+0000","last_clean":"2023-10-18T19:34:38.733909+0000","last_became_active":"2023-10-18T19:34:21.255703+0000","last_became_peered":"2023-10-18T19:34:21.255703+0000","last_unstale":"2023-10-18T19:34:38.733909+0000","last_undegraded":"2023-10-18T19:34:38.733909+0000","last_fullsized":"2023-10-18T19:34:38.733909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282443+0000","last_change":"2023-10-18T19:34:20.849799+0000","last_active":"2023-10-18T19:34:38.282443+0000","last_peered":"2023-10-18T19:34:38.282443+0000","last_clean":"2023-10-18T19:34:38.282443+0000","last_became_active":"2023-10-18T19:34:20.849488+0000","last_became_peered":"2023-10-18T19:34:20.849488+0000","last_unstale":"2023-10-18T19:34:38.282443+0000","last_undegraded":"2023-10-18T19:34:38.282443+0000","last_fullsized":"2023-10-18T19:34:38.282443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282561+0000","last_change":"2023-10-18T19:34:21.260006+0000","last_active":"2023-10-18T19:34:38.282561+0000","last_peered":"2023-10-18T19:34:38.282561+0000","last_clean":"2023-10-18T19:34:38.282561+0000","last_became_active":"2023-10-18T19:34:21.259689+0000","last_became_peered":"2023-10-18T19:34:21.259689+0000","last_unstale":"2023-10-18T19:34:38.282561+0000","last_undegraded":"2023-10-18T19:34:38.282561+0000","last_fullsized":"2023-10-18T19:34:38.282561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282357+0000","last_change":"2023-10-18T19:34:20.858108+0000","last_active":"2023-10-18T19:34:38.282357+0000","last_peered":"2023-10-18T19:34:38.282357+0000","last_clean":"2023-10-18T19:34:38.282357+0000","last_became_active":"2023-10-18T19:34:20.854784+0000","last_became_peered":"2023-10-18T19:34:20.854784+0000","last_unstale":"2023-10-18T19:34:38.282357+0000","last_undegraded":"2023-10-18T19:34:38.282357+0000","last_fullsized":"2023-10-18T19:34:38.282357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433066+0000","last_change":"2023-10-18T19:34:21.257919+0000","last_active":"2023-10-18T19:37:15.433066+0000","last_peered":"2023-10-18T19:37:15.433066+0000","last_clean":"2023-10-18T19:37:15.433066+0000","last_became_active":"2023-10-18T19:34:21.257409+0000","last_became_peered":"2023-10-18T19:34:21.257409+0000","last_unstale":"2023-10-18T19:37:15.433066+0000","last_undegraded":"2023-10-18T19:37:15.433066+0000","last_fullsized":"2023-10-18T19:37:15.433066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282854+0000","last_change":"2023-10-18T19:34:20.847577+0000","last_active":"2023-10-18T19:34:38.282854+0000","last_peered":"2023-10-18T19:34:38.282854+0000","last_clean":"2023-10-18T19:34:38.282854+0000","last_became_active":"2023-10-18T19:34:20.842013+0000","last_became_peered":"2023-10-18T19:34:20.842013+0000","last_unstale":"2023-10-18T19:34:38.282854+0000","last_undegraded":"2023-10-18T19:34:38.282854+0000","last_fullsized":"2023-10-18T19:34:38.282854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281875+0000","last_change":"2023-10-18T19:34:21.251747+0000","last_active":"2023-10-18T19:34:38.281875+0000","last_peered":"2023-10-18T19:34:38.281875+0000","last_clean":"2023-10-18T19:34:38.281875+0000","last_became_active":"2023-10-18T19:34:21.251325+0000","last_became_peered":"2023-10-18T19:34:21.251325+0000","last_unstale":"2023-10-18T19:34:38.281875+0000","last_undegraded":"2023-10-18T19:34:38.281875+0000","last_fullsized":"2023-10-18T19:34:38.281875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732897+0000","last_change":"2023-10-18T19:34:20.832572+0000","last_active":"2023-10-18T19:34:38.732897+0000","last_peered":"2023-10-18T19:34:38.732897+0000","last_clean":"2023-10-18T19:34:38.732897+0000","last_became_active":"2023-10-18T19:34:20.832216+0000","last_became_peered":"2023-10-18T19:34:20.832216+0000","last_unstale":"2023-10-18T19:34:38.732897+0000","last_undegraded":"2023-10-18T19:34:38.732897+0000","last_fullsized":"2023-10-18T19:34:38.732897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279223+0000","last_change":"2023-10-18T19:34:21.272247+0000","last_active":"2023-10-18T19:34:38.279223+0000","last_peered":"2023-10-18T19:34:38.279223+0000","last_clean":"2023-10-18T19:34:38.279223+0000","last_became_active":"2023-10-18T19:34:21.271930+0000","last_became_peered":"2023-10-18T19:34:21.271930+0000","last_unstale":"2023-10-18T19:34:38.279223+0000","last_undegraded":"2023-10-18T19:34:38.279223+0000","last_fullsized":"2023-10-18T19:34:38.279223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733403+0000","last_change":"2023-10-18T19:34:20.840841+0000","last_active":"2023-10-18T19:34:38.733403+0000","last_peered":"2023-10-18T19:34:38.733403+0000","last_clean":"2023-10-18T19:34:38.733403+0000","last_became_active":"2023-10-18T19:34:20.840351+0000","last_became_peered":"2023-10-18T19:34:20.840351+0000","last_unstale":"2023-10-18T19:34:38.733403+0000","last_undegraded":"2023-10-18T19:34:38.733403+0000","last_fullsized":"2023-10-18T19:34:38.733403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281107+0000","last_change":"2023-10-18T19:34:21.258445+0000","last_active":"2023-10-18T19:34:38.281107+0000","last_peered":"2023-10-18T19:34:38.281107+0000","last_clean":"2023-10-18T19:34:38.281107+0000","last_became_active":"2023-10-18T19:34:21.257747+0000","last_became_peered":"2023-10-18T19:34:21.257747+0000","last_unstale":"2023-10-18T19:34:38.281107+0000","last_undegraded":"2023-10-18T19:34:38.281107+0000","last_fullsized":"2023-10-18T19:34:38.281107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431681+0000","last_change":"2023-10-18T19:34:20.856638+0000","last_active":"2023-10-18T19:37:15.431681+0000","last_peered":"2023-10-18T19:37:15.431681+0000","last_clean":"2023-10-18T19:37:15.431681+0000","last_became_active":"2023-10-18T19:34:20.856094+0000","last_became_peered":"2023-10-18T19:34:20.856094+0000","last_unstale":"2023-10-18T19:37:15.431681+0000","last_undegraded":"2023-10-18T19:37:15.431681+0000","last_fullsized":"2023-10-18T19:37:15.431681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733334+0000","last_change":"2023-10-18T19:34:21.249180+0000","last_active":"2023-10-18T19:34:38.733334+0000","last_peered":"2023-10-18T19:34:38.733334+0000","last_clean":"2023-10-18T19:34:38.733334+0000","last_became_active":"2023-10-18T19:34:21.245370+0000","last_became_peered":"2023-10-18T19:34:21.245370+0000","last_unstale":"2023-10-18T19:34:38.733334+0000","last_undegraded":"2023-10-18T19:34:38.733334+0000","last_fullsized":"2023-10-18T19:34:38.733334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281765+0000","last_change":"2023-10-18T19:34:20.823278+0000","last_active":"2023-10-18T19:34:38.281765+0000","last_peered":"2023-10-18T19:34:38.281765+0000","last_clean":"2023-10-18T19:34:38.281765+0000","last_became_active":"2023-10-18T19:34:20.823003+0000","last_became_peered":"2023-10-18T19:34:20.823003+0000","last_unstale":"2023-10-18T19:34:38.281765+0000","last_undegraded":"2023-10-18T19:34:38.281765+0000","last_fullsized":"2023-10-18T19:34:38.281765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734049+0000","last_change":"2023-10-18T19:34:21.246335+0000","last_active":"2023-10-18T19:34:38.734049+0000","last_peered":"2023-10-18T19:34:38.734049+0000","last_clean":"2023-10-18T19:34:38.734049+0000","last_became_active":"2023-10-18T19:34:21.246040+0000","last_became_peered":"2023-10-18T19:34:21.246040+0000","last_unstale":"2023-10-18T19:34:38.734049+0000","last_undegraded":"2023-10-18T19:34:38.734049+0000","last_fullsized":"2023-10-18T19:34:38.734049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.404885+0000","last_change":"2023-10-18T19:34:20.855032+0000","last_active":"2023-10-18T19:37:15.404885+0000","last_peered":"2023-10-18T19:37:15.404885+0000","last_clean":"2023-10-18T19:37:15.404885+0000","last_became_active":"2023-10-18T19:34:20.854673+0000","last_became_peered":"2023-10-18T19:34:20.854673+0000","last_unstale":"2023-10-18T19:37:15.404885+0000","last_undegraded":"2023-10-18T19:37:15.404885+0000","last_fullsized":"2023-10-18T19:37:15.404885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734255+0000","last_change":"2023-10-18T19:34:21.254232+0000","last_active":"2023-10-18T19:34:38.734255+0000","last_peered":"2023-10-18T19:34:38.734255+0000","last_clean":"2023-10-18T19:34:38.734255+0000","last_became_active":"2023-10-18T19:34:21.253932+0000","last_became_peered":"2023-10-18T19:34:21.253932+0000","last_unstale":"2023-10-18T19:34:38.734255+0000","last_undegraded":"2023-10-18T19:34:38.734255+0000","last_fullsized":"2023-10-18T19:34:38.734255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282242+0000","last_change":"2023-10-18T19:34:20.855559+0000","last_active":"2023-10-18T19:34:38.282242+0000","last_peered":"2023-10-18T19:34:38.282242+0000","last_clean":"2023-10-18T19:34:38.282242+0000","last_became_active":"2023-10-18T19:34:20.854845+0000","last_became_peered":"2023-10-18T19:34:20.854845+0000","last_unstale":"2023-10-18T19:34:38.282242+0000","last_undegraded":"2023-10-18T19:34:38.282242+0000","last_fullsized":"2023-10-18T19:34:38.282242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282827+0000","last_change":"2023-10-18T19:34:21.248190+0000","last_active":"2023-10-18T19:34:38.282827+0000","last_peered":"2023-10-18T19:34:38.282827+0000","last_clean":"2023-10-18T19:34:38.282827+0000","last_became_active":"2023-10-18T19:34:21.247102+0000","last_became_peered":"2023-10-18T19:34:21.247102+0000","last_unstale":"2023-10-18T19:34:38.282827+0000","last_undegraded":"2023-10-18T19:34:38.282827+0000","last_fullsized":"2023-10-18T19:34:38.282827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282185+0000","last_change":"2023-10-18T19:34:20.857956+0000","last_active":"2023-10-18T19:34:38.282185+0000","last_peered":"2023-10-18T19:34:38.282185+0000","last_clean":"2023-10-18T19:34:38.282185+0000","last_became_active":"2023-10-18T19:34:20.855051+0000","last_became_peered":"2023-10-18T19:34:20.855051+0000","last_unstale":"2023-10-18T19:34:38.282185+0000","last_undegraded":"2023-10-18T19:34:38.282185+0000","last_fullsized":"2023-10-18T19:34:38.282185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734496+0000","last_change":"2023-10-18T19:34:21.266700+0000","last_active":"2023-10-18T19:34:38.734496+0000","last_peered":"2023-10-18T19:34:38.734496+0000","last_clean":"2023-10-18T19:34:38.734496+0000","last_became_active":"2023-10-18T19:34:21.266409+0000","last_became_peered":"2023-10-18T19:34:21.266409+0000","last_unstale":"2023-10-18T19:34:38.734496+0000","last_undegraded":"2023-10-18T19:34:38.734496+0000","last_fullsized":"2023-10-18T19:34:38.734496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734439+0000","last_change":"2023-10-18T19:34:20.851465+0000","last_active":"2023-10-18T19:34:38.734439+0000","last_peered":"2023-10-18T19:34:38.734439+0000","last_clean":"2023-10-18T19:34:38.734439+0000","last_became_active":"2023-10-18T19:34:20.851166+0000","last_became_peered":"2023-10-18T19:34:20.851166+0000","last_unstale":"2023-10-18T19:34:38.734439+0000","last_undegraded":"2023-10-18T19:34:38.734439+0000","last_fullsized":"2023-10-18T19:34:38.734439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733028+0000","last_change":"2023-10-18T19:34:21.245529+0000","last_active":"2023-10-18T19:34:38.733028+0000","last_peered":"2023-10-18T19:34:38.733028+0000","last_clean":"2023-10-18T19:34:38.733028+0000","last_became_active":"2023-10-18T19:34:21.245217+0000","last_became_peered":"2023-10-18T19:34:21.245217+0000","last_unstale":"2023-10-18T19:34:38.733028+0000","last_undegraded":"2023-10-18T19:34:38.733028+0000","last_fullsized":"2023-10-18T19:34:38.733028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732935+0000","last_change":"2023-10-18T19:34:20.837517+0000","last_active":"2023-10-18T19:34:38.732935+0000","last_peered":"2023-10-18T19:34:38.732935+0000","last_clean":"2023-10-18T19:34:38.732935+0000","last_became_active":"2023-10-18T19:34:20.837192+0000","last_became_peered":"2023-10-18T19:34:20.837192+0000","last_unstale":"2023-10-18T19:34:38.732935+0000","last_undegraded":"2023-10-18T19:34:38.732935+0000","last_fullsized":"2023-10-18T19:34:38.732935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279330+0000","last_change":"2023-10-18T19:34:21.262649+0000","last_active":"2023-10-18T19:34:38.279330+0000","last_peered":"2023-10-18T19:34:38.279330+0000","last_clean":"2023-10-18T19:34:38.279330+0000","last_became_active":"2023-10-18T19:34:21.262175+0000","last_became_peered":"2023-10-18T19:34:21.262175+0000","last_unstale":"2023-10-18T19:34:38.279330+0000","last_undegraded":"2023-10-18T19:34:38.279330+0000","last_fullsized":"2023-10-18T19:34:38.279330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281496+0000","last_change":"2023-10-18T19:34:20.821558+0000","last_active":"2023-10-18T19:34:38.281496+0000","last_peered":"2023-10-18T19:34:38.281496+0000","last_clean":"2023-10-18T19:34:38.281496+0000","last_became_active":"2023-10-18T19:34:20.821225+0000","last_became_peered":"2023-10-18T19:34:20.821225+0000","last_unstale":"2023-10-18T19:34:38.281496+0000","last_undegraded":"2023-10-18T19:34:38.281496+0000","last_fullsized":"2023-10-18T19:34:38.281496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733138+0000","last_change":"2023-10-18T19:34:21.268630+0000","last_active":"2023-10-18T19:34:38.733138+0000","last_peered":"2023-10-18T19:34:38.733138+0000","last_clean":"2023-10-18T19:34:38.733138+0000","last_became_active":"2023-10-18T19:34:21.268347+0000","last_became_peered":"2023-10-18T19:34:21.268347+0000","last_unstale":"2023-10-18T19:34:38.733138+0000","last_undegraded":"2023-10-18T19:34:38.733138+0000","last_fullsized":"2023-10-18T19:34:38.733138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431765+0000","last_change":"2023-10-18T19:34:20.856427+0000","last_active":"2023-10-18T19:37:15.431765+0000","last_peered":"2023-10-18T19:37:15.431765+0000","last_clean":"2023-10-18T19:37:15.431765+0000","last_became_active":"2023-10-18T19:34:20.855877+0000","last_became_peered":"2023-10-18T19:34:20.855877+0000","last_unstale":"2023-10-18T19:37:15.431765+0000","last_undegraded":"2023-10-18T19:37:15.431765+0000","last_fullsized":"2023-10-18T19:37:15.431765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431545+0000","last_change":"2023-10-18T19:34:21.259142+0000","last_active":"2023-10-18T19:37:15.431545+0000","last_peered":"2023-10-18T19:37:15.431545+0000","last_clean":"2023-10-18T19:37:15.431545+0000","last_became_active":"2023-10-18T19:34:21.258709+0000","last_became_peered":"2023-10-18T19:34:21.258709+0000","last_unstale":"2023-10-18T19:37:15.431545+0000","last_undegraded":"2023-10-18T19:37:15.431545+0000","last_fullsized":"2023-10-18T19:37:15.431545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733304+0000","last_change":"2023-10-18T19:34:20.861616+0000","last_active":"2023-10-18T19:34:38.733304+0000","last_peered":"2023-10-18T19:34:38.733304+0000","last_clean":"2023-10-18T19:34:38.733304+0000","last_became_active":"2023-10-18T19:34:20.861363+0000","last_became_peered":"2023-10-18T19:34:20.861363+0000","last_unstale":"2023-10-18T19:34:38.733304+0000","last_undegraded":"2023-10-18T19:34:38.733304+0000","last_fullsized":"2023-10-18T19:34:38.733304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733725+0000","last_change":"2023-10-18T19:34:21.267981+0000","last_active":"2023-10-18T19:34:38.733725+0000","last_peered":"2023-10-18T19:34:38.733725+0000","last_clean":"2023-10-18T19:34:38.733725+0000","last_became_active":"2023-10-18T19:34:21.267584+0000","last_became_peered":"2023-10-18T19:34:21.267584+0000","last_unstale":"2023-10-18T19:34:38.733725+0000","last_undegraded":"2023-10-18T19:34:38.733725+0000","last_fullsized":"2023-10-18T19:34:38.733725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734167+0000","last_change":"2023-10-18T19:34:20.855045+0000","last_active":"2023-10-18T19:34:38.734167+0000","last_peered":"2023-10-18T19:34:38.734167+0000","last_clean":"2023-10-18T19:34:38.734167+0000","last_became_active":"2023-10-18T19:34:20.854724+0000","last_became_peered":"2023-10-18T19:34:20.854724+0000","last_unstale":"2023-10-18T19:34:38.734167+0000","last_undegraded":"2023-10-18T19:34:38.734167+0000","last_fullsized":"2023-10-18T19:34:38.734167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432660+0000","last_change":"2023-10-18T19:34:21.262741+0000","last_active":"2023-10-18T19:37:15.432660+0000","last_peered":"2023-10-18T19:37:15.432660+0000","last_clean":"2023-10-18T19:37:15.432660+0000","last_became_active":"2023-10-18T19:34:21.262435+0000","last_became_peered":"2023-10-18T19:34:21.262435+0000","last_unstale":"2023-10-18T19:37:15.432660+0000","last_undegraded":"2023-10-18T19:37:15.432660+0000","last_fullsized":"2023-10-18T19:37:15.432660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282043+0000","last_change":"2023-10-18T19:34:20.850195+0000","last_active":"2023-10-18T19:34:38.282043+0000","last_peered":"2023-10-18T19:34:38.282043+0000","last_clean":"2023-10-18T19:34:38.282043+0000","last_became_active":"2023-10-18T19:34:20.849885+0000","last_became_peered":"2023-10-18T19:34:20.849885+0000","last_unstale":"2023-10-18T19:34:38.282043+0000","last_undegraded":"2023-10-18T19:34:38.282043+0000","last_fullsized":"2023-10-18T19:34:38.282043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734093+0000","last_change":"2023-10-18T19:34:21.248730+0000","last_active":"2023-10-18T19:34:38.734093+0000","last_peered":"2023-10-18T19:34:38.734093+0000","last_clean":"2023-10-18T19:34:38.734093+0000","last_became_active":"2023-10-18T19:34:21.248420+0000","last_became_peered":"2023-10-18T19:34:21.248420+0000","last_unstale":"2023-10-18T19:34:38.734093+0000","last_undegraded":"2023-10-18T19:34:38.734093+0000","last_fullsized":"2023-10-18T19:34:38.734093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734685+0000","last_change":"2023-10-18T19:34:20.862008+0000","last_active":"2023-10-18T19:34:38.734685+0000","last_peered":"2023-10-18T19:34:38.734685+0000","last_clean":"2023-10-18T19:34:38.734685+0000","last_became_active":"2023-10-18T19:34:20.858973+0000","last_became_peered":"2023-10-18T19:34:20.858973+0000","last_unstale":"2023-10-18T19:34:38.734685+0000","last_undegraded":"2023-10-18T19:34:38.734685+0000","last_fullsized":"2023-10-18T19:34:38.734685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282092+0000","last_change":"2023-10-18T19:34:21.259920+0000","last_active":"2023-10-18T19:34:38.282092+0000","last_peered":"2023-10-18T19:34:38.282092+0000","last_clean":"2023-10-18T19:34:38.282092+0000","last_became_active":"2023-10-18T19:34:21.259474+0000","last_became_peered":"2023-10-18T19:34:21.259474+0000","last_unstale":"2023-10-18T19:34:38.282092+0000","last_undegraded":"2023-10-18T19:34:38.282092+0000","last_fullsized":"2023-10-18T19:34:38.282092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282747+0000","last_change":"2023-10-18T19:34:20.842664+0000","last_active":"2023-10-18T19:34:38.282747+0000","last_peered":"2023-10-18T19:34:38.282747+0000","last_clean":"2023-10-18T19:34:38.282747+0000","last_became_active":"2023-10-18T19:34:20.842341+0000","last_became_peered":"2023-10-18T19:34:20.842341+0000","last_unstale":"2023-10-18T19:34:38.282747+0000","last_undegraded":"2023-10-18T19:34:38.282747+0000","last_fullsized":"2023-10-18T19:34:38.282747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":54653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35999999999999999,"15min":0.376},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.48099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.41799999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39400000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.377},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.45300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40200000000000002}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.375},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.43099999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":44912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56699999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:20.372 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2023-10-18T19:37:20.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-18T19:37:16.342037+0000', 'last_change': '2023-10-18T19:37:16.342037+0000', 'last_active': '2023-10-18T19:37:16.342037+0000', 'last_peered': '2023-10-18T19:37:16.342037+0000', 'last_clean': '2023-10-18T19:37:16.342037+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-18T19:37:16.342037+0000', 'last_undegraded': '2023-10-18T19:37:16.342037+0000', 'last_fullsized': '2023-10-18T19:37:16.342037+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-18T19:37:16.342037+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-18T19:37:16.342037+0000', 'last_clean_scrub_stamp': '2023-10-18T19:37:16.342037+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-18T19:37:20.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-18T19:37:20.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.592+0000 7fb879fff700 1 Processor -- start 2023-10-18T19:37:20.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.592+0000 7fb879fff700 1 -- start start 2023-10-18T19:37:20.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.593+0000 7fb879fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8740ab3d0 0x7fb874091f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.593+0000 7fb879fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.593+0000 7fb879fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874091b30 con 0x7fb874136b60 2023-10-18T19:37:20.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.593+0000 7fb879fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb874134610 con 0x7fb8740ab3d0 2023-10-18T19:37:20.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.593+0000 7fb879fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87406aa40 con 0x7fb87409a860 2023-10-18T19:37:20.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb873fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8740ab3d0 0x7fb874091f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb873fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56330/0 (socket says 172.21.15.88:56330) 2023-10-18T19:37:20.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8740ab3d0 0x7fb874091f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36472/0 (socket says 172.21.15.88:36472) 2023-10-18T19:37:20.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb873fff700 1 -- 172.21.15.88:0/1650211867 learned_addr learned my addr 172.21.15.88:0/1650211867 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:20.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb872ffd700 1 --1- 172.21.15.88:0/1650211867 >> v1:172.21.15.88:6789/0 conn(0x7fb874136b60 0x7fb874069420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35184/0 (socket says 172.21.15.88:35184) 2023-10-18T19:37:20.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 -- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 msgr2=0x7fb874141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:20.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 -- 172.21.15.88:0/1650211867 >> v1:172.21.15.88:6789/0 conn(0x7fb874136b60 legacy=0x7fb874069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 -- 172.21.15.88:0/1650211867 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874137090 con 0x7fb8740ab3d0 2023-10-18T19:37:20.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb873fff700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:20.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8727fc700 1 -- 172.21.15.88:0/1650211867 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700406620 0 0) 0x7fb874091b30 con 0x7fb874136b60 2023-10-18T19:37:20.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.594+0000 7fb8737fe700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8740ab3d0 0x7fb874091f80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb864009760 tx=0x7fb864009060).ready entity=mon.0 client_cookie=1c8db35043b865b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:20.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb8727fc700 1 -- 172.21.15.88:0/1650211867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f510 con 0x7fb8740ab3d0 2023-10-18T19:37:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb8727fc700 1 -- 172.21.15.88:0/1650211867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400f670 con 0x7fb8740ab3d0 2023-10-18T19:37:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb8727fc700 1 -- 172.21.15.88:0/1650211867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f9f0 con 0x7fb8740ab3d0 2023-10-18T19:37:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 -- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8740ab3d0 msgr2=0x7fb874091f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8740ab3d0 0x7fb874091f80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb864009760 tx=0x7fb864009060).stop 2023-10-18T19:37:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 -- 172.21.15.88:0/1650211867 shutdown_connections 2023-10-18T19:37:20.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb87409a860 0x7fb874141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 --2- 172.21.15.88:0/1650211867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8740ab3d0 0x7fb874091f80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 -- 172.21.15.88:0/1650211867 >> 172.21.15.88:0/1650211867 conn(0x7fb87405eb30 msgr2=0x7fb8740aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:20.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 -- 172.21.15.88:0/1650211867 shutdown_connections 2023-10-18T19:37:20.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.595+0000 7fb879fff700 1 -- 172.21.15.88:0/1650211867 wait complete. 2023-10-18T19:37:20.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 Processor -- start 2023-10-18T19:37:20.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 -- start start 2023-10-18T19:37:20.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8740ab3d0 0x7fb8740994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 0x7fb874148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:20.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.597+0000 7fb879fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874067f60 con 0x7fb87409a860 2023-10-18T19:37:20.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb879fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87409a160 con 0x7fb874136b60 2023-10-18T19:37:20.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb879fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87409a440 con 0x7fb8740ab3d0 2023-10-18T19:37:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36482/0 (socket says 172.21.15.88:36482) 2023-10-18T19:37:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 -- 172.21.15.88:0/2454453075 learned_addr learned my addr 172.21.15.88:0/2454453075 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:20.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb872ffd700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8740ab3d0 0x7fb8740994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb873fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 0x7fb874148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 -- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8740ab3d0 msgr2=0x7fb8740994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8740ab3d0 0x7fb8740994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 -- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 msgr2=0x7fb874148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 0x7fb874148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 -- 172.21.15.88:0/2454453075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009ae0 con 0x7fb87409a860 2023-10-18T19:37:20.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb873fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 0x7fb874148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:37:20.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb8737fe700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb864009f30 tx=0x7fb864017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:20.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.598+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f7e0 con 0x7fb87409a860 2023-10-18T19:37:20.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.599+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400f940 con 0x7fb87409a860 2023-10-18T19:37:20.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.599+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640092a0 con 0x7fb87409a860 2023-10-18T19:37:20.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.599+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86401b660 con 0x7fb87409a860 2023-10-18T19:37:20.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.599+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87409ecb0 con 0x7fb87409a860 2023-10-18T19:37:20.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.600+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb86401ba10 con 0x7fb87409a860 2023-10-18T19:37:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.600+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87405f270 con 0x7fb87409a860 2023-10-18T19:37:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.600+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fb864057130 con 0x7fb87409a860 2023-10-18T19:37:20.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.604+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb864007a40 con 0x7fb87409a860 2023-10-18T19:37:20.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.802+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb874064e20 con 0x7fb87409a860 2023-10-18T19:37:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.803+0000 7fb85b7fe700 1 -- 172.21.15.88:0/2454453075 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1021 (secure 0 0 0) 0x7fb86403ace0 con 0x7fb87409a860 2023-10-18T19:37:20.806 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:20.806 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":9,"monmap":{"epoch":2,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":21,"num_osds":4,"num_up_osds":4,"osd_up_since":1697657646,"num_in_osds":4,"osd_in_since":1697657646,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":136},{"state_name":"unknown","count":1}],"num_pgs":137,"num_pools":4,"num_objects":41,"data_bytes":8352,"bytes_used":4295729152,"bytes_avail":382251327488,"bytes_total":386547056640,"unknown_pgs_ratio":0.0072992700152099133},"fsmap":{"epoch":15,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4180}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-18T19:36:21.971417+0000","services":{}},"progress_events":{}} 2023-10-18T19:37:20.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 >> v1:172.21.15.88:6800/113625 conn(0x7fb860041d10 legacy=0x7fb8600441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 msgr2=0x7fb87409e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:20.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb864009f30 tx=0x7fb864017000).stop 2023-10-18T19:37:20.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 shutdown_connections 2023-10-18T19:37:20.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb874136b60 0x7fb874148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb87409a860 0x7fb87409e7c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 --2- 172.21.15.88:0/2454453075 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8740ab3d0 0x7fb8740994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:20.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 >> 172.21.15.88:0/2454453075 conn(0x7fb87405eb30 msgr2=0x7fb874133cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:20.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 shutdown_connections 2023-10-18T19:37:20.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:20.805+0000 7fb879fff700 1 -- 172.21.15.88:0/2454453075 wait complete. 2023-10-18T19:37:20.824 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2023-10-18T19:37:20.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.009+0000 7efe0bdff700 1 Processor -- start 2023-10-18T19:37:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.010+0000 7efe0bdff700 1 -- start start 2023-10-18T19:37:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.010+0000 7efe0bdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0bdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe040a4c50 0x7efe04136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:21.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0bdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040afd50 con 0x7efe040a1790 2023-10-18T19:37:21.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0bdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040a47a0 con 0x7efe040a4c50 2023-10-18T19:37:21.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0bdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe040a3a10 con 0x7efe040af970 2023-10-18T19:37:21.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe09b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:21.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe040a4c50 0x7efe04136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:21.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe09b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56346/0 (socket says 172.21.15.88:56346) 2023-10-18T19:37:21.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe09b9b700 1 -- 172.21.15.88:0/52426481 learned_addr learned my addr 172.21.15.88:0/52426481 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:21.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0939a700 1 --1- 172.21.15.88:0/52426481 >> v1:172.21.15.88:6789/0 conn(0x7efe040a1790 0x7efe0413bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35192/0 (socket says 172.21.15.88:35192) 2023-10-18T19:37:21.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 -- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 msgr2=0x7efe04135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:21.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 -- 172.21.15.88:0/52426481 >> v1:172.21.15.88:6789/0 conn(0x7efe040a1790 legacy=0x7efe0413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 -- 172.21.15.88:0/52426481 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040a32d0 con 0x7efe040a4c50 2023-10-18T19:37:21.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe09b9b700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:21.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe08b99700 1 -- 172.21.15.88:0/52426481 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748754899 0 0) 0x7efe040afd50 con 0x7efe040a1790 2023-10-18T19:37:21.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.011+0000 7efe0a39c700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040a4c50 0x7efe04136220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7efdfc009e60 tx=0x7efdfc009780).ready entity=mon.0 client_cookie=f7850da0a273e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe08b99700 1 -- 172.21.15.88:0/52426481 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00e070 con 0x7efe040a4c50 2023-10-18T19:37:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe08b99700 1 -- 172.21.15.88:0/52426481 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc00bb60 con 0x7efe040a4c50 2023-10-18T19:37:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe08b99700 1 -- 172.21.15.88:0/52426481 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc012410 con 0x7efe040a4c50 2023-10-18T19:37:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 -- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040a4c50 msgr2=0x7efe04136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040a4c50 0x7efe04136220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7efdfc009e60 tx=0x7efdfc009780).stop 2023-10-18T19:37:21.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 -- 172.21.15.88:0/52426481 shutdown_connections 2023-10-18T19:37:21.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040a4c50 0x7efe04136220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 --2- 172.21.15.88:0/52426481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040af970 0x7efe04135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 -- 172.21.15.88:0/52426481 >> 172.21.15.88:0/52426481 conn(0x7efe0405eb60 msgr2=0x7efe040af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:21.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 -- 172.21.15.88:0/52426481 shutdown_connections 2023-10-18T19:37:21.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.012+0000 7efe0bdff700 1 -- 172.21.15.88:0/52426481 wait complete. 2023-10-18T19:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 Processor -- start 2023-10-18T19:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 -- start start 2023-10-18T19:37:21.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe040a1790 0x7efe0413c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:21.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 0x7efe040a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:21.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:21.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe041488d0 con 0x7efe040af970 2023-10-18T19:37:21.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040a6ec0 con 0x7efe040a1790 2023-10-18T19:37:21.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.014+0000 7efe0bdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe040a7080 con 0x7efe040a4c50 2023-10-18T19:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 0x7efe040a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0a39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:21.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0a39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36502/0 (socket says 172.21.15.88:36502) 2023-10-18T19:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0a39c700 1 -- 172.21.15.88:0/1124502954 learned_addr learned my addr 172.21.15.88:0/1124502954 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:21.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe09b9b700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe040a1790 0x7efe0413c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 -- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe040a1790 msgr2=0x7efe0413c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe040a1790 0x7efe0413c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 -- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 msgr2=0x7efe040a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 -- 172.21.15.88:0/1124502954 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009370 con 0x7efe040a4c50 2023-10-18T19:37:21.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0a39c700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efe0939a700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 0x7efe040a7f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7efdf4000c00 tx=0x7efdf4007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.015+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40070d0 con 0x7efe040a4c50 2023-10-18T19:37:21.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.016+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4007250 con 0x7efe040a4c50 2023-10-18T19:37:21.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.016+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc009a20 con 0x7efe040a4c50 2023-10-18T19:37:21.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.016+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf40056e0 con 0x7efe040a4c50 2023-10-18T19:37:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.016+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040a97c0 con 0x7efe040a4c50 2023-10-18T19:37:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.017+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0405f270 con 0x7efe040a4c50 2023-10-18T19:37:21.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.017+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7efdf4005a90 con 0x7efe040a4c50 2023-10-18T19:37:21.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.017+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7efdf4054de0 con 0x7efe040a4c50 2023-10-18T19:37:21.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.021+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7efdf4035180 con 0x7efe040a4c50 2023-10-18T19:37:21.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.162+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe040ae0c0 con 0x7efde8041ce0 2023-10-18T19:37:21.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.171+0000 7efdf9ffb700 1 -- 172.21.15.88:0/1124502954 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325971 (unknown 2965378022 0 2983035873) 0x7efe040ae0c0 con 0x7efde8041ce0 2023-10-18T19:37:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:21.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 >> v1:172.21.15.88:6800/113625 conn(0x7efde8041ce0 legacy=0x7efde80441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 msgr2=0x7efe040a7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:21.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 0x7efe040a7f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7efdf4000c00 tx=0x7efdf4007bb0).stop 2023-10-18T19:37:21.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 shutdown_connections 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe040af970 0x7efe040a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe040a1790 0x7efe0413c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 --2- 172.21.15.88:0/1124502954 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe040a4c50 0x7efe040a7f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 >> 172.21.15.88:0/1124502954 conn(0x7efe0405eb60 msgr2=0x7efe04138aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 shutdown_connections 2023-10-18T19:37:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:21.175+0000 7efe0bdff700 1 -- 172.21.15.88:0/1124502954 wait complete. 2023-10-18T19:37:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:21.195 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-18T19:37:19.354993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195048,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292312,"statfs":{"total":386547056640,"available":382251327488,"internally_reserved":4294967296,"allocated":729088,"data_stored":201443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.993836"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281973+0000","last_change":"2023-10-18T19:34:21.266064+0000","last_active":"2023-10-18T19:34:38.281973+0000","last_peered":"2023-10-18T19:34:38.281973+0000","last_clean":"2023-10-18T19:34:38.281973+0000","last_became_active":"2023-10-18T19:34:21.265745+0000","last_became_peered":"2023-10-18T19:34:21.265745+0000","last_unstale":"2023-10-18T19:34:38.281973+0000","last_undegraded":"2023-10-18T19:34:38.281973+0000","last_fullsized":"2023-10-18T19:34:38.281973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.799504+0000","last_change":"2023-10-18T19:34:20.848544+0000","last_active":"2023-10-18T19:35:01.799504+0000","last_peered":"2023-10-18T19:35:01.799504+0000","last_clean":"2023-10-18T19:35:01.799504+0000","last_became_active":"2023-10-18T19:34:20.848186+0000","last_became_peered":"2023-10-18T19:34:20.848186+0000","last_unstale":"2023-10-18T19:35:01.799504+0000","last_undegraded":"2023-10-18T19:35:01.799504+0000","last_fullsized":"2023-10-18T19:35:01.799504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733305+0000","last_change":"2023-10-18T19:34:21.249452+0000","last_active":"2023-10-18T19:34:38.733305+0000","last_peered":"2023-10-18T19:34:38.733305+0000","last_clean":"2023-10-18T19:34:38.733305+0000","last_became_active":"2023-10-18T19:34:21.249103+0000","last_became_peered":"2023-10-18T19:34:21.249103+0000","last_unstale":"2023-10-18T19:34:38.733305+0000","last_undegraded":"2023-10-18T19:34:38.733305+0000","last_fullsized":"2023-10-18T19:34:38.733305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280902+0000","last_change":"2023-10-18T19:34:20.835459+0000","last_active":"2023-10-18T19:34:38.280902+0000","last_peered":"2023-10-18T19:34:38.280902+0000","last_clean":"2023-10-18T19:34:38.280902+0000","last_became_active":"2023-10-18T19:34:20.835145+0000","last_became_peered":"2023-10-18T19:34:20.835145+0000","last_unstale":"2023-10-18T19:34:38.280902+0000","last_undegraded":"2023-10-18T19:34:38.280902+0000","last_fullsized":"2023-10-18T19:34:38.280902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279296+0000","last_change":"2023-10-18T19:34:21.262486+0000","last_active":"2023-10-18T19:34:38.279296+0000","last_peered":"2023-10-18T19:34:38.279296+0000","last_clean":"2023-10-18T19:34:38.279296+0000","last_became_active":"2023-10-18T19:34:21.261956+0000","last_became_peered":"2023-10-18T19:34:21.261956+0000","last_unstale":"2023-10-18T19:34:38.279296+0000","last_undegraded":"2023-10-18T19:34:38.279296+0000","last_fullsized":"2023-10-18T19:34:38.279296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280144+0000","last_change":"2023-10-18T19:34:20.854649+0000","last_active":"2023-10-18T19:34:38.280144+0000","last_peered":"2023-10-18T19:34:38.280144+0000","last_clean":"2023-10-18T19:34:38.280144+0000","last_became_active":"2023-10-18T19:34:20.854333+0000","last_became_peered":"2023-10-18T19:34:20.854333+0000","last_unstale":"2023-10-18T19:34:38.280144+0000","last_undegraded":"2023-10-18T19:34:38.280144+0000","last_fullsized":"2023-10-18T19:34:38.280144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281669+0000","last_change":"2023-10-18T19:34:21.246025+0000","last_active":"2023-10-18T19:34:38.281669+0000","last_peered":"2023-10-18T19:34:38.281669+0000","last_clean":"2023-10-18T19:34:38.281669+0000","last_became_active":"2023-10-18T19:34:21.245735+0000","last_became_peered":"2023-10-18T19:34:21.245735+0000","last_unstale":"2023-10-18T19:34:38.281669+0000","last_undegraded":"2023-10-18T19:34:38.281669+0000","last_fullsized":"2023-10-18T19:34:38.281669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279099+0000","last_change":"2023-10-18T19:34:20.853312+0000","last_active":"2023-10-18T19:34:38.279099+0000","last_peered":"2023-10-18T19:34:38.279099+0000","last_clean":"2023-10-18T19:34:38.279099+0000","last_became_active":"2023-10-18T19:34:20.852964+0000","last_became_peered":"2023-10-18T19:34:20.852964+0000","last_unstale":"2023-10-18T19:34:38.279099+0000","last_undegraded":"2023-10-18T19:34:38.279099+0000","last_fullsized":"2023-10-18T19:34:38.279099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432978+0000","last_change":"2023-10-18T19:34:21.265408+0000","last_active":"2023-10-18T19:37:15.432978+0000","last_peered":"2023-10-18T19:37:15.432978+0000","last_clean":"2023-10-18T19:37:15.432978+0000","last_became_active":"2023-10-18T19:34:21.265029+0000","last_became_peered":"2023-10-18T19:34:21.265029+0000","last_unstale":"2023-10-18T19:37:15.432978+0000","last_undegraded":"2023-10-18T19:37:15.432978+0000","last_fullsized":"2023-10-18T19:37:15.432978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:11.800534+0000","last_change":"2023-10-18T19:34:20.825709+0000","last_active":"2023-10-18T19:35:11.800534+0000","last_peered":"2023-10-18T19:35:11.800534+0000","last_clean":"2023-10-18T19:35:11.800534+0000","last_became_active":"2023-10-18T19:34:20.825364+0000","last_became_peered":"2023-10-18T19:34:20.825364+0000","last_unstale":"2023-10-18T19:35:11.800534+0000","last_undegraded":"2023-10-18T19:35:11.800534+0000","last_fullsized":"2023-10-18T19:35:11.800534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734181+0000","last_change":"2023-10-18T19:34:21.250032+0000","last_active":"2023-10-18T19:34:38.734181+0000","last_peered":"2023-10-18T19:34:38.734181+0000","last_clean":"2023-10-18T19:34:38.734181+0000","last_became_active":"2023-10-18T19:34:21.245104+0000","last_became_peered":"2023-10-18T19:34:21.245104+0000","last_unstale":"2023-10-18T19:34:38.734181+0000","last_undegraded":"2023-10-18T19:34:38.734181+0000","last_fullsized":"2023-10-18T19:34:38.734181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734258+0000","last_change":"2023-10-18T19:34:20.862583+0000","last_active":"2023-10-18T19:34:38.734258+0000","last_peered":"2023-10-18T19:34:38.734258+0000","last_clean":"2023-10-18T19:34:38.734258+0000","last_became_active":"2023-10-18T19:34:20.862262+0000","last_became_peered":"2023-10-18T19:34:20.862262+0000","last_unstale":"2023-10-18T19:34:38.734258+0000","last_undegraded":"2023-10-18T19:34:38.734258+0000","last_fullsized":"2023-10-18T19:34:38.734258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281992+0000","last_change":"2023-10-18T19:34:21.265750+0000","last_active":"2023-10-18T19:34:38.281992+0000","last_peered":"2023-10-18T19:34:38.281992+0000","last_clean":"2023-10-18T19:34:38.281992+0000","last_became_active":"2023-10-18T19:34:21.265449+0000","last_became_peered":"2023-10-18T19:34:21.265449+0000","last_unstale":"2023-10-18T19:34:38.281992+0000","last_undegraded":"2023-10-18T19:34:38.281992+0000","last_fullsized":"2023-10-18T19:34:38.281992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281687+0000","last_change":"2023-10-18T19:34:20.855201+0000","last_active":"2023-10-18T19:34:38.281687+0000","last_peered":"2023-10-18T19:34:38.281687+0000","last_clean":"2023-10-18T19:34:38.281687+0000","last_became_active":"2023-10-18T19:34:20.854344+0000","last_became_peered":"2023-10-18T19:34:20.854344+0000","last_unstale":"2023-10-18T19:34:38.281687+0000","last_undegraded":"2023-10-18T19:34:38.281687+0000","last_fullsized":"2023-10-18T19:34:38.281687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734008+0000","last_change":"2023-10-18T19:34:21.249688+0000","last_active":"2023-10-18T19:34:38.734008+0000","last_peered":"2023-10-18T19:34:38.734008+0000","last_clean":"2023-10-18T19:34:38.734008+0000","last_became_active":"2023-10-18T19:34:21.246078+0000","last_became_peered":"2023-10-18T19:34:21.246078+0000","last_unstale":"2023-10-18T19:34:38.734008+0000","last_undegraded":"2023-10-18T19:34:38.734008+0000","last_fullsized":"2023-10-18T19:34:38.734008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.434758+0000","last_change":"2023-10-18T19:34:20.857791+0000","last_active":"2023-10-18T19:37:15.434758+0000","last_peered":"2023-10-18T19:37:15.434758+0000","last_clean":"2023-10-18T19:37:15.434758+0000","last_became_active":"2023-10-18T19:34:20.857489+0000","last_became_peered":"2023-10-18T19:34:20.857489+0000","last_unstale":"2023-10-18T19:37:15.434758+0000","last_undegraded":"2023-10-18T19:37:15.434758+0000","last_fullsized":"2023-10-18T19:37:15.434758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733296+0000","last_change":"2023-10-18T19:34:21.245879+0000","last_active":"2023-10-18T19:34:38.733296+0000","last_peered":"2023-10-18T19:34:38.733296+0000","last_clean":"2023-10-18T19:34:38.733296+0000","last_became_active":"2023-10-18T19:34:21.245587+0000","last_became_peered":"2023-10-18T19:34:21.245587+0000","last_unstale":"2023-10-18T19:34:38.733296+0000","last_undegraded":"2023-10-18T19:34:38.733296+0000","last_fullsized":"2023-10-18T19:34:38.733296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733510+0000","last_change":"2023-10-18T19:34:20.857559+0000","last_active":"2023-10-18T19:34:38.733510+0000","last_peered":"2023-10-18T19:34:38.733510+0000","last_clean":"2023-10-18T19:34:38.733510+0000","last_became_active":"2023-10-18T19:34:20.857227+0000","last_became_peered":"2023-10-18T19:34:20.857227+0000","last_unstale":"2023-10-18T19:34:38.733510+0000","last_undegraded":"2023-10-18T19:34:38.733510+0000","last_fullsized":"2023-10-18T19:34:38.733510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281235+0000","last_change":"2023-10-18T19:34:21.258745+0000","last_active":"2023-10-18T19:34:38.281235+0000","last_peered":"2023-10-18T19:34:38.281235+0000","last_clean":"2023-10-18T19:34:38.281235+0000","last_became_active":"2023-10-18T19:34:21.258295+0000","last_became_peered":"2023-10-18T19:34:21.258295+0000","last_unstale":"2023-10-18T19:34:38.281235+0000","last_undegraded":"2023-10-18T19:34:38.281235+0000","last_fullsized":"2023-10-18T19:34:38.281235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281065+0000","last_change":"2023-10-18T19:34:20.836255+0000","last_active":"2023-10-18T19:34:38.281065+0000","last_peered":"2023-10-18T19:34:38.281065+0000","last_clean":"2023-10-18T19:34:38.281065+0000","last_became_active":"2023-10-18T19:34:20.835941+0000","last_became_peered":"2023-10-18T19:34:20.835941+0000","last_unstale":"2023-10-18T19:34:38.281065+0000","last_undegraded":"2023-10-18T19:34:38.281065+0000","last_fullsized":"2023-10-18T19:34:38.281065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281432+0000","last_change":"2023-10-18T19:34:21.253538+0000","last_active":"2023-10-18T19:34:38.281432+0000","last_peered":"2023-10-18T19:34:38.281432+0000","last_clean":"2023-10-18T19:34:38.281432+0000","last_became_active":"2023-10-18T19:34:21.253274+0000","last_became_peered":"2023-10-18T19:34:21.253274+0000","last_unstale":"2023-10-18T19:34:38.281432+0000","last_undegraded":"2023-10-18T19:34:38.281432+0000","last_fullsized":"2023-10-18T19:34:38.281432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733135+0000","last_change":"2023-10-18T19:34:20.857139+0000","last_active":"2023-10-18T19:34:38.733135+0000","last_peered":"2023-10-18T19:34:38.733135+0000","last_clean":"2023-10-18T19:34:38.733135+0000","last_became_active":"2023-10-18T19:34:20.856766+0000","last_became_peered":"2023-10-18T19:34:20.856766+0000","last_unstale":"2023-10-18T19:34:38.733135+0000","last_undegraded":"2023-10-18T19:34:38.733135+0000","last_fullsized":"2023-10-18T19:34:38.733135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280240+0000","last_change":"2023-10-18T19:34:21.272980+0000","last_active":"2023-10-18T19:34:38.280240+0000","last_peered":"2023-10-18T19:34:38.280240+0000","last_clean":"2023-10-18T19:34:38.280240+0000","last_became_active":"2023-10-18T19:34:21.272618+0000","last_became_peered":"2023-10-18T19:34:21.272618+0000","last_unstale":"2023-10-18T19:34:38.280240+0000","last_undegraded":"2023-10-18T19:34:38.280240+0000","last_fullsized":"2023-10-18T19:34:38.280240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430950+0000","last_change":"2023-10-18T19:34:20.828547+0000","last_active":"2023-10-18T19:37:15.430950+0000","last_peered":"2023-10-18T19:37:15.430950+0000","last_clean":"2023-10-18T19:37:15.430950+0000","last_became_active":"2023-10-18T19:34:20.828036+0000","last_became_peered":"2023-10-18T19:34:20.828036+0000","last_unstale":"2023-10-18T19:37:15.430950+0000","last_undegraded":"2023-10-18T19:37:15.430950+0000","last_fullsized":"2023-10-18T19:37:15.430950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432549+0000","last_change":"2023-10-18T19:34:21.265823+0000","last_active":"2023-10-18T19:37:15.432549+0000","last_peered":"2023-10-18T19:37:15.432549+0000","last_clean":"2023-10-18T19:37:15.432549+0000","last_became_active":"2023-10-18T19:34:21.265276+0000","last_became_peered":"2023-10-18T19:34:21.265276+0000","last_unstale":"2023-10-18T19:37:15.432549+0000","last_undegraded":"2023-10-18T19:37:15.432549+0000","last_fullsized":"2023-10-18T19:37:15.432549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734440+0000","last_change":"2023-10-18T19:34:20.856792+0000","last_active":"2023-10-18T19:34:38.734440+0000","last_peered":"2023-10-18T19:34:38.734440+0000","last_clean":"2023-10-18T19:34:38.734440+0000","last_became_active":"2023-10-18T19:34:20.856486+0000","last_became_peered":"2023-10-18T19:34:20.856486+0000","last_unstale":"2023-10-18T19:34:38.734440+0000","last_undegraded":"2023-10-18T19:34:38.734440+0000","last_fullsized":"2023-10-18T19:34:38.734440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734257+0000","last_change":"2023-10-18T19:34:21.265884+0000","last_active":"2023-10-18T19:34:38.734257+0000","last_peered":"2023-10-18T19:34:38.734257+0000","last_clean":"2023-10-18T19:34:38.734257+0000","last_became_active":"2023-10-18T19:34:21.265564+0000","last_became_peered":"2023-10-18T19:34:21.265564+0000","last_unstale":"2023-10-18T19:34:38.734257+0000","last_undegraded":"2023-10-18T19:34:38.734257+0000","last_fullsized":"2023-10-18T19:34:38.734257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432913+0000","last_change":"2023-10-18T19:34:20.858811+0000","last_active":"2023-10-18T19:37:15.432913+0000","last_peered":"2023-10-18T19:37:15.432913+0000","last_clean":"2023-10-18T19:37:15.432913+0000","last_became_active":"2023-10-18T19:34:20.858481+0000","last_became_peered":"2023-10-18T19:34:20.858481+0000","last_unstale":"2023-10-18T19:37:15.432913+0000","last_undegraded":"2023-10-18T19:37:15.432913+0000","last_fullsized":"2023-10-18T19:37:15.432913+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733566+0000","last_change":"2023-10-18T19:34:21.246195+0000","last_active":"2023-10-18T19:34:38.733566+0000","last_peered":"2023-10-18T19:34:38.733566+0000","last_clean":"2023-10-18T19:34:38.733566+0000","last_became_active":"2023-10-18T19:34:21.245896+0000","last_became_peered":"2023-10-18T19:34:21.245896+0000","last_unstale":"2023-10-18T19:34:38.733566+0000","last_undegraded":"2023-10-18T19:34:38.733566+0000","last_fullsized":"2023-10-18T19:34:38.733566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281781+0000","last_change":"2023-10-18T19:34:20.855423+0000","last_active":"2023-10-18T19:34:38.281781+0000","last_peered":"2023-10-18T19:34:38.281781+0000","last_clean":"2023-10-18T19:34:38.281781+0000","last_became_active":"2023-10-18T19:34:20.854593+0000","last_became_peered":"2023-10-18T19:34:20.854593+0000","last_unstale":"2023-10-18T19:34:38.281781+0000","last_undegraded":"2023-10-18T19:34:38.281781+0000","last_fullsized":"2023-10-18T19:34:38.281781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282176+0000","last_change":"2023-10-18T19:34:21.256949+0000","last_active":"2023-10-18T19:34:38.282176+0000","last_peered":"2023-10-18T19:34:38.282176+0000","last_clean":"2023-10-18T19:34:38.282176+0000","last_became_active":"2023-10-18T19:34:21.256623+0000","last_became_peered":"2023-10-18T19:34:21.256623+0000","last_unstale":"2023-10-18T19:34:38.282176+0000","last_undegraded":"2023-10-18T19:34:38.282176+0000","last_fullsized":"2023-10-18T19:34:38.282176+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433109+0000","last_change":"2023-10-18T19:34:20.846802+0000","last_active":"2023-10-18T19:37:15.433109+0000","last_peered":"2023-10-18T19:37:15.433109+0000","last_clean":"2023-10-18T19:37:15.433109+0000","last_became_active":"2023-10-18T19:34:20.846249+0000","last_became_peered":"2023-10-18T19:34:20.846249+0000","last_unstale":"2023-10-18T19:37:15.433109+0000","last_undegraded":"2023-10-18T19:37:15.433109+0000","last_fullsized":"2023-10-18T19:37:15.433109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280549+0000","last_change":"2023-10-18T19:34:21.258895+0000","last_active":"2023-10-18T19:34:38.280549+0000","last_peered":"2023-10-18T19:34:38.280549+0000","last_clean":"2023-10-18T19:34:38.280549+0000","last_became_active":"2023-10-18T19:34:21.256384+0000","last_became_peered":"2023-10-18T19:34:21.256384+0000","last_unstale":"2023-10-18T19:34:38.280549+0000","last_undegraded":"2023-10-18T19:34:38.280549+0000","last_fullsized":"2023-10-18T19:34:38.280549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280964+0000","last_change":"2023-10-18T19:34:20.850016+0000","last_active":"2023-10-18T19:34:38.280964+0000","last_peered":"2023-10-18T19:34:38.280964+0000","last_clean":"2023-10-18T19:34:38.280964+0000","last_became_active":"2023-10-18T19:34:20.849501+0000","last_became_peered":"2023-10-18T19:34:20.849501+0000","last_unstale":"2023-10-18T19:34:38.280964+0000","last_undegraded":"2023-10-18T19:34:38.280964+0000","last_fullsized":"2023-10-18T19:34:38.280964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281151+0000","last_change":"2023-10-18T19:34:21.258646+0000","last_active":"2023-10-18T19:34:38.281151+0000","last_peered":"2023-10-18T19:34:38.281151+0000","last_clean":"2023-10-18T19:34:38.281151+0000","last_became_active":"2023-10-18T19:34:21.257999+0000","last_became_peered":"2023-10-18T19:34:21.257999+0000","last_unstale":"2023-10-18T19:34:38.281151+0000","last_undegraded":"2023-10-18T19:34:38.281151+0000","last_fullsized":"2023-10-18T19:34:38.281151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281871+0000","last_change":"2023-10-18T19:34:20.856264+0000","last_active":"2023-10-18T19:34:38.281871+0000","last_peered":"2023-10-18T19:34:38.281871+0000","last_clean":"2023-10-18T19:34:38.281871+0000","last_became_active":"2023-10-18T19:34:20.856072+0000","last_became_peered":"2023-10-18T19:34:20.856072+0000","last_unstale":"2023-10-18T19:34:38.281871+0000","last_undegraded":"2023-10-18T19:34:38.281871+0000","last_fullsized":"2023-10-18T19:34:38.281871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279415+0000","last_change":"2023-10-18T19:34:21.242536+0000","last_active":"2023-10-18T19:34:38.279415+0000","last_peered":"2023-10-18T19:34:38.279415+0000","last_clean":"2023-10-18T19:34:38.279415+0000","last_became_active":"2023-10-18T19:34:21.242187+0000","last_became_peered":"2023-10-18T19:34:21.242187+0000","last_unstale":"2023-10-18T19:34:38.279415+0000","last_undegraded":"2023-10-18T19:34:38.279415+0000","last_fullsized":"2023-10-18T19:34:38.279415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281401+0000","last_change":"2023-10-18T19:34:20.844847+0000","last_active":"2023-10-18T19:34:38.281401+0000","last_peered":"2023-10-18T19:34:38.281401+0000","last_clean":"2023-10-18T19:34:38.281401+0000","last_became_active":"2023-10-18T19:34:20.844528+0000","last_became_peered":"2023-10-18T19:34:20.844528+0000","last_unstale":"2023-10-18T19:34:38.281401+0000","last_undegraded":"2023-10-18T19:34:38.281401+0000","last_fullsized":"2023-10-18T19:34:38.281401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280217+0000","last_change":"2023-10-18T19:34:21.272824+0000","last_active":"2023-10-18T19:34:38.280217+0000","last_peered":"2023-10-18T19:34:38.280217+0000","last_clean":"2023-10-18T19:34:38.280217+0000","last_became_active":"2023-10-18T19:34:21.272631+0000","last_became_peered":"2023-10-18T19:34:21.272631+0000","last_unstale":"2023-10-18T19:34:38.280217+0000","last_undegraded":"2023-10-18T19:34:38.280217+0000","last_fullsized":"2023-10-18T19:34:38.280217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732827+0000","last_change":"2023-10-18T19:34:20.833452+0000","last_active":"2023-10-18T19:34:38.732827+0000","last_peered":"2023-10-18T19:34:38.732827+0000","last_clean":"2023-10-18T19:34:38.732827+0000","last_became_active":"2023-10-18T19:34:20.832840+0000","last_became_peered":"2023-10-18T19:34:20.832840+0000","last_unstale":"2023-10-18T19:34:38.732827+0000","last_undegraded":"2023-10-18T19:34:38.732827+0000","last_fullsized":"2023-10-18T19:34:38.732827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-18T19:37:16.342037+0000","last_change":"2023-10-18T19:37:16.342037+0000","last_active":"2023-10-18T19:37:16.342037+0000","last_peered":"2023-10-18T19:37:16.342037+0000","last_clean":"2023-10-18T19:37:16.342037+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-18T19:37:16.342037+0000","last_undegraded":"2023-10-18T19:37:16.342037+0000","last_fullsized":"2023-10-18T19:37:16.342037+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282848+0000","last_change":"2023-10-18T19:34:21.255174+0000","last_active":"2023-10-18T19:34:38.282848+0000","last_peered":"2023-10-18T19:34:38.282848+0000","last_clean":"2023-10-18T19:34:38.282848+0000","last_became_active":"2023-10-18T19:34:21.252377+0000","last_became_peered":"2023-10-18T19:34:21.252377+0000","last_unstale":"2023-10-18T19:34:38.282848+0000","last_undegraded":"2023-10-18T19:34:38.282848+0000","last_fullsized":"2023-10-18T19:34:38.282848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432775+0000","last_change":"2023-10-18T19:34:11.535715+0000","last_active":"2023-10-18T19:37:15.432775+0000","last_peered":"2023-10-18T19:37:15.432775+0000","last_clean":"2023-10-18T19:37:15.432775+0000","last_became_active":"2023-10-18T19:34:11.534518+0000","last_became_peered":"2023-10-18T19:34:11.534518+0000","last_unstale":"2023-10-18T19:37:15.432775+0000","last_undegraded":"2023-10-18T19:37:15.432775+0000","last_fullsized":"2023-10-18T19:37:15.432775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282276+0000","last_change":"2023-10-18T19:34:20.857782+0000","last_active":"2023-10-18T19:34:38.282276+0000","last_peered":"2023-10-18T19:34:38.282276+0000","last_clean":"2023-10-18T19:34:38.282276+0000","last_became_active":"2023-10-18T19:34:20.853192+0000","last_became_peered":"2023-10-18T19:34:20.853192+0000","last_unstale":"2023-10-18T19:34:38.282276+0000","last_undegraded":"2023-10-18T19:34:38.282276+0000","last_fullsized":"2023-10-18T19:34:38.282276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734825+0000","last_change":"2023-10-18T19:34:21.257423+0000","last_active":"2023-10-18T19:34:38.734825+0000","last_peered":"2023-10-18T19:34:38.734825+0000","last_clean":"2023-10-18T19:34:38.734825+0000","last_became_active":"2023-10-18T19:34:21.256448+0000","last_became_peered":"2023-10-18T19:34:21.256448+0000","last_unstale":"2023-10-18T19:34:38.734825+0000","last_undegraded":"2023-10-18T19:34:38.734825+0000","last_fullsized":"2023-10-18T19:34:38.734825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282069+0000","last_change":"2023-10-18T19:34:11.532756+0000","last_active":"2023-10-18T19:34:38.282069+0000","last_peered":"2023-10-18T19:34:38.282069+0000","last_clean":"2023-10-18T19:34:38.282069+0000","last_became_active":"2023-10-18T19:34:11.532425+0000","last_became_peered":"2023-10-18T19:34:11.532425+0000","last_unstale":"2023-10-18T19:34:38.282069+0000","last_undegraded":"2023-10-18T19:34:38.282069+0000","last_fullsized":"2023-10-18T19:34:38.282069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.852964+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.852642+0000","last_became_peered":"2023-10-18T19:34:20.852642+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281876+0000","last_change":"2023-10-18T19:34:11.534856+0000","last_active":"2023-10-18T19:34:38.281876+0000","last_peered":"2023-10-18T19:34:38.281876+0000","last_clean":"2023-10-18T19:34:38.281876+0000","last_became_active":"2023-10-18T19:34:11.534541+0000","last_became_peered":"2023-10-18T19:34:11.534541+0000","last_unstale":"2023-10-18T19:34:38.281876+0000","last_undegraded":"2023-10-18T19:34:38.281876+0000","last_fullsized":"2023-10-18T19:34:38.281876+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279117+0000","last_change":"2023-10-18T19:34:20.847678+0000","last_active":"2023-10-18T19:34:38.279117+0000","last_peered":"2023-10-18T19:34:38.279117+0000","last_clean":"2023-10-18T19:34:38.279117+0000","last_became_active":"2023-10-18T19:34:20.847107+0000","last_became_peered":"2023-10-18T19:34:20.847107+0000","last_unstale":"2023-10-18T19:34:38.279117+0000","last_undegraded":"2023-10-18T19:34:38.279117+0000","last_fullsized":"2023-10-18T19:34:38.279117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733124+0000","last_change":"2023-10-18T19:34:21.255564+0000","last_active":"2023-10-18T19:34:38.733124+0000","last_peered":"2023-10-18T19:34:38.733124+0000","last_clean":"2023-10-18T19:34:38.733124+0000","last_became_active":"2023-10-18T19:34:21.255230+0000","last_became_peered":"2023-10-18T19:34:21.255230+0000","last_unstale":"2023-10-18T19:34:38.733124+0000","last_undegraded":"2023-10-18T19:34:38.733124+0000","last_fullsized":"2023-10-18T19:34:38.733124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733197+0000","last_change":"2023-10-18T19:34:11.535128+0000","last_active":"2023-10-18T19:34:38.733197+0000","last_peered":"2023-10-18T19:34:38.733197+0000","last_clean":"2023-10-18T19:34:38.733197+0000","last_became_active":"2023-10-18T19:34:11.534248+0000","last_became_peered":"2023-10-18T19:34:11.534248+0000","last_unstale":"2023-10-18T19:34:38.733197+0000","last_undegraded":"2023-10-18T19:34:38.733197+0000","last_fullsized":"2023-10-18T19:34:38.733197+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431228+0000","last_change":"2023-10-18T19:34:20.855194+0000","last_active":"2023-10-18T19:37:15.431228+0000","last_peered":"2023-10-18T19:37:15.431228+0000","last_clean":"2023-10-18T19:37:15.431228+0000","last_became_active":"2023-10-18T19:34:20.854897+0000","last_became_peered":"2023-10-18T19:34:20.854897+0000","last_unstale":"2023-10-18T19:37:15.431228+0000","last_undegraded":"2023-10-18T19:37:15.431228+0000","last_fullsized":"2023-10-18T19:37:15.431228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281390+0000","last_change":"2023-10-18T19:34:21.270017+0000","last_active":"2023-10-18T19:34:38.281390+0000","last_peered":"2023-10-18T19:34:38.281390+0000","last_clean":"2023-10-18T19:34:38.281390+0000","last_became_active":"2023-10-18T19:34:21.269485+0000","last_became_peered":"2023-10-18T19:34:21.269485+0000","last_unstale":"2023-10-18T19:34:38.281390+0000","last_undegraded":"2023-10-18T19:34:38.281390+0000","last_fullsized":"2023-10-18T19:34:38.281390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281541+0000","last_change":"2023-10-18T19:34:11.532872+0000","last_active":"2023-10-18T19:34:38.281541+0000","last_peered":"2023-10-18T19:34:38.281541+0000","last_clean":"2023-10-18T19:34:38.281541+0000","last_became_active":"2023-10-18T19:34:11.531562+0000","last_became_peered":"2023-10-18T19:34:11.531562+0000","last_unstale":"2023-10-18T19:34:38.281541+0000","last_undegraded":"2023-10-18T19:34:38.281541+0000","last_fullsized":"2023-10-18T19:34:38.281541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:06.799201+0000","last_change":"2023-10-18T19:34:20.852891+0000","last_active":"2023-10-18T19:35:06.799201+0000","last_peered":"2023-10-18T19:35:06.799201+0000","last_clean":"2023-10-18T19:35:06.799201+0000","last_became_active":"2023-10-18T19:34:20.852426+0000","last_became_peered":"2023-10-18T19:34:20.852426+0000","last_unstale":"2023-10-18T19:35:06.799201+0000","last_undegraded":"2023-10-18T19:35:06.799201+0000","last_fullsized":"2023-10-18T19:35:06.799201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280643+0000","last_change":"2023-10-18T19:34:21.266390+0000","last_active":"2023-10-18T19:34:38.280643+0000","last_peered":"2023-10-18T19:34:38.280643+0000","last_clean":"2023-10-18T19:34:38.280643+0000","last_became_active":"2023-10-18T19:34:21.266089+0000","last_became_peered":"2023-10-18T19:34:21.266089+0000","last_unstale":"2023-10-18T19:34:38.280643+0000","last_undegraded":"2023-10-18T19:34:38.280643+0000","last_fullsized":"2023-10-18T19:34:38.280643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279963+0000","last_change":"2023-10-18T19:34:11.532565+0000","last_active":"2023-10-18T19:34:38.279963+0000","last_peered":"2023-10-18T19:34:38.279963+0000","last_clean":"2023-10-18T19:34:38.279963+0000","last_became_active":"2023-10-18T19:34:11.532168+0000","last_became_peered":"2023-10-18T19:34:11.532168+0000","last_unstale":"2023-10-18T19:34:38.279963+0000","last_undegraded":"2023-10-18T19:34:38.279963+0000","last_fullsized":"2023-10-18T19:34:38.279963+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280817+0000","last_change":"2023-10-18T19:34:20.852330+0000","last_active":"2023-10-18T19:34:38.280817+0000","last_peered":"2023-10-18T19:34:38.280817+0000","last_clean":"2023-10-18T19:34:38.280817+0000","last_became_active":"2023-10-18T19:34:20.851992+0000","last_became_peered":"2023-10-18T19:34:20.851992+0000","last_unstale":"2023-10-18T19:34:38.280817+0000","last_undegraded":"2023-10-18T19:34:38.280817+0000","last_fullsized":"2023-10-18T19:34:38.280817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733604+0000","last_change":"2023-10-18T19:34:21.264314+0000","last_active":"2023-10-18T19:34:38.733604+0000","last_peered":"2023-10-18T19:34:38.733604+0000","last_clean":"2023-10-18T19:34:38.733604+0000","last_became_active":"2023-10-18T19:34:21.263937+0000","last_became_peered":"2023-10-18T19:34:21.263937+0000","last_unstale":"2023-10-18T19:34:38.733604+0000","last_undegraded":"2023-10-18T19:34:38.733604+0000","last_fullsized":"2023-10-18T19:34:38.733604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282680+0000","last_change":"2023-10-18T19:34:11.533453+0000","last_active":"2023-10-18T19:34:38.282680+0000","last_peered":"2023-10-18T19:34:38.282680+0000","last_clean":"2023-10-18T19:34:38.282680+0000","last_became_active":"2023-10-18T19:34:11.532769+0000","last_became_peered":"2023-10-18T19:34:11.532769+0000","last_unstale":"2023-10-18T19:34:38.282680+0000","last_undegraded":"2023-10-18T19:34:38.282680+0000","last_fullsized":"2023-10-18T19:34:38.282680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282101+0000","last_change":"2023-10-18T19:34:20.853145+0000","last_active":"2023-10-18T19:34:38.282101+0000","last_peered":"2023-10-18T19:34:38.282101+0000","last_clean":"2023-10-18T19:34:38.282101+0000","last_became_active":"2023-10-18T19:34:20.852683+0000","last_became_peered":"2023-10-18T19:34:20.852683+0000","last_unstale":"2023-10-18T19:34:38.282101+0000","last_undegraded":"2023-10-18T19:34:38.282101+0000","last_fullsized":"2023-10-18T19:34:38.282101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282182+0000","last_change":"2023-10-18T19:34:21.266346+0000","last_active":"2023-10-18T19:34:38.282182+0000","last_peered":"2023-10-18T19:34:38.282182+0000","last_clean":"2023-10-18T19:34:38.282182+0000","last_became_active":"2023-10-18T19:34:21.265950+0000","last_became_peered":"2023-10-18T19:34:21.265950+0000","last_unstale":"2023-10-18T19:34:38.282182+0000","last_undegraded":"2023-10-18T19:34:38.282182+0000","last_fullsized":"2023-10-18T19:34:38.282182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282658+0000","last_change":"2023-10-18T19:34:11.533454+0000","last_active":"2023-10-18T19:34:38.282658+0000","last_peered":"2023-10-18T19:34:38.282658+0000","last_clean":"2023-10-18T19:34:38.282658+0000","last_became_active":"2023-10-18T19:34:11.533123+0000","last_became_peered":"2023-10-18T19:34:11.533123+0000","last_unstale":"2023-10-18T19:34:38.282658+0000","last_undegraded":"2023-10-18T19:34:38.282658+0000","last_fullsized":"2023-10-18T19:34:38.282658+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281898+0000","last_change":"2023-10-18T19:34:20.844955+0000","last_active":"2023-10-18T19:34:38.281898+0000","last_peered":"2023-10-18T19:34:38.281898+0000","last_clean":"2023-10-18T19:34:38.281898+0000","last_became_active":"2023-10-18T19:34:20.844711+0000","last_became_peered":"2023-10-18T19:34:20.844711+0000","last_unstale":"2023-10-18T19:34:38.281898+0000","last_undegraded":"2023-10-18T19:34:38.281898+0000","last_fullsized":"2023-10-18T19:34:38.281898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431387+0000","last_change":"2023-10-18T19:34:21.256370+0000","last_active":"2023-10-18T19:37:15.431387+0000","last_peered":"2023-10-18T19:37:15.431387+0000","last_clean":"2023-10-18T19:37:15.431387+0000","last_became_active":"2023-10-18T19:34:21.256084+0000","last_became_peered":"2023-10-18T19:34:21.256084+0000","last_unstale":"2023-10-18T19:37:15.431387+0000","last_undegraded":"2023-10-18T19:37:15.431387+0000","last_fullsized":"2023-10-18T19:37:15.431387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282545+0000","last_change":"2023-10-18T19:34:21.253778+0000","last_active":"2023-10-18T19:34:38.282545+0000","last_peered":"2023-10-18T19:34:38.282545+0000","last_clean":"2023-10-18T19:34:38.282545+0000","last_became_active":"2023-10-18T19:34:21.251946+0000","last_became_peered":"2023-10-18T19:34:21.251946+0000","last_unstale":"2023-10-18T19:34:38.282545+0000","last_undegraded":"2023-10-18T19:34:38.282545+0000","last_fullsized":"2023-10-18T19:34:38.282545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733900+0000","last_change":"2023-10-18T19:34:20.862585+0000","last_active":"2023-10-18T19:34:38.733900+0000","last_peered":"2023-10-18T19:34:38.733900+0000","last_clean":"2023-10-18T19:34:38.733900+0000","last_became_active":"2023-10-18T19:34:20.862326+0000","last_became_peered":"2023-10-18T19:34:20.862326+0000","last_unstale":"2023-10-18T19:34:38.733900+0000","last_undegraded":"2023-10-18T19:34:38.733900+0000","last_fullsized":"2023-10-18T19:34:38.733900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281804+0000","last_change":"2023-10-18T19:34:21.259196+0000","last_active":"2023-10-18T19:34:38.281804+0000","last_peered":"2023-10-18T19:34:38.281804+0000","last_clean":"2023-10-18T19:34:38.281804+0000","last_became_active":"2023-10-18T19:34:21.258884+0000","last_became_peered":"2023-10-18T19:34:21.258884+0000","last_unstale":"2023-10-18T19:34:38.281804+0000","last_undegraded":"2023-10-18T19:34:38.281804+0000","last_fullsized":"2023-10-18T19:34:38.281804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733897+0000","last_change":"2023-10-18T19:34:20.863893+0000","last_active":"2023-10-18T19:34:38.733897+0000","last_peered":"2023-10-18T19:34:38.733897+0000","last_clean":"2023-10-18T19:34:38.733897+0000","last_became_active":"2023-10-18T19:34:20.863549+0000","last_became_peered":"2023-10-18T19:34:20.863549+0000","last_unstale":"2023-10-18T19:34:38.733897+0000","last_undegraded":"2023-10-18T19:34:38.733897+0000","last_fullsized":"2023-10-18T19:34:38.733897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734602+0000","last_change":"2023-10-18T19:34:21.261264+0000","last_active":"2023-10-18T19:34:38.734602+0000","last_peered":"2023-10-18T19:34:38.734602+0000","last_clean":"2023-10-18T19:34:38.734602+0000","last_became_active":"2023-10-18T19:34:21.260951+0000","last_became_peered":"2023-10-18T19:34:21.260951+0000","last_unstale":"2023-10-18T19:34:38.734602+0000","last_undegraded":"2023-10-18T19:34:38.734602+0000","last_fullsized":"2023-10-18T19:34:38.734602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282655+0000","last_change":"2023-10-18T19:34:20.853421+0000","last_active":"2023-10-18T19:34:38.282655+0000","last_peered":"2023-10-18T19:34:38.282655+0000","last_clean":"2023-10-18T19:34:38.282655+0000","last_became_active":"2023-10-18T19:34:20.853091+0000","last_became_peered":"2023-10-18T19:34:20.853091+0000","last_unstale":"2023-10-18T19:34:38.282655+0000","last_undegraded":"2023-10-18T19:34:38.282655+0000","last_fullsized":"2023-10-18T19:34:38.282655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282564+0000","last_change":"2023-10-18T19:34:21.274214+0000","last_active":"2023-10-18T19:34:38.282564+0000","last_peered":"2023-10-18T19:34:38.282564+0000","last_clean":"2023-10-18T19:34:38.282564+0000","last_became_active":"2023-10-18T19:34:21.273899+0000","last_became_peered":"2023-10-18T19:34:21.273899+0000","last_unstale":"2023-10-18T19:34:38.282564+0000","last_undegraded":"2023-10-18T19:34:38.282564+0000","last_fullsized":"2023-10-18T19:34:38.282564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734358+0000","last_change":"2023-10-18T19:34:20.860150+0000","last_active":"2023-10-18T19:34:38.734358+0000","last_peered":"2023-10-18T19:34:38.734358+0000","last_clean":"2023-10-18T19:34:38.734358+0000","last_became_active":"2023-10-18T19:34:20.859836+0000","last_became_peered":"2023-10-18T19:34:20.859836+0000","last_unstale":"2023-10-18T19:34:38.734358+0000","last_undegraded":"2023-10-18T19:34:38.734358+0000","last_fullsized":"2023-10-18T19:34:38.734358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432488+0000","last_change":"2023-10-18T19:34:21.260022+0000","last_active":"2023-10-18T19:37:15.432488+0000","last_peered":"2023-10-18T19:37:15.432488+0000","last_clean":"2023-10-18T19:37:15.432488+0000","last_became_active":"2023-10-18T19:34:21.259630+0000","last_became_peered":"2023-10-18T19:34:21.259630+0000","last_unstale":"2023-10-18T19:37:15.432488+0000","last_undegraded":"2023-10-18T19:37:15.432488+0000","last_fullsized":"2023-10-18T19:37:15.432488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279207+0000","last_change":"2023-10-18T19:34:20.832124+0000","last_active":"2023-10-18T19:34:38.279207+0000","last_peered":"2023-10-18T19:34:38.279207+0000","last_clean":"2023-10-18T19:34:38.279207+0000","last_became_active":"2023-10-18T19:34:20.831830+0000","last_became_peered":"2023-10-18T19:34:20.831830+0000","last_unstale":"2023-10-18T19:34:38.279207+0000","last_undegraded":"2023-10-18T19:34:38.279207+0000","last_fullsized":"2023-10-18T19:34:38.279207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.430926+0000","last_change":"2023-10-18T19:34:21.263372+0000","last_active":"2023-10-18T19:37:15.430926+0000","last_peered":"2023-10-18T19:37:15.430926+0000","last_clean":"2023-10-18T19:37:15.430926+0000","last_became_active":"2023-10-18T19:34:21.256876+0000","last_became_peered":"2023-10-18T19:34:21.256876+0000","last_unstale":"2023-10-18T19:37:15.430926+0000","last_undegraded":"2023-10-18T19:37:15.430926+0000","last_fullsized":"2023-10-18T19:37:15.430926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431460+0000","last_change":"2023-10-18T19:34:20.846546+0000","last_active":"2023-10-18T19:37:15.431460+0000","last_peered":"2023-10-18T19:37:15.431460+0000","last_clean":"2023-10-18T19:37:15.431460+0000","last_became_active":"2023-10-18T19:34:20.846229+0000","last_became_peered":"2023-10-18T19:34:20.846229+0000","last_unstale":"2023-10-18T19:37:15.431460+0000","last_undegraded":"2023-10-18T19:37:15.431460+0000","last_fullsized":"2023-10-18T19:37:15.431460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733497+0000","last_change":"2023-10-18T19:34:21.248032+0000","last_active":"2023-10-18T19:34:38.733497+0000","last_peered":"2023-10-18T19:34:38.733497+0000","last_clean":"2023-10-18T19:34:38.733497+0000","last_became_active":"2023-10-18T19:34:21.247196+0000","last_became_peered":"2023-10-18T19:34:21.247196+0000","last_unstale":"2023-10-18T19:34:38.733497+0000","last_undegraded":"2023-10-18T19:34:38.733497+0000","last_fullsized":"2023-10-18T19:34:38.733497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280987+0000","last_change":"2023-10-18T19:34:20.847408+0000","last_active":"2023-10-18T19:34:38.280987+0000","last_peered":"2023-10-18T19:34:38.280987+0000","last_clean":"2023-10-18T19:34:38.280987+0000","last_became_active":"2023-10-18T19:34:20.847100+0000","last_became_peered":"2023-10-18T19:34:20.847100+0000","last_unstale":"2023-10-18T19:34:38.280987+0000","last_undegraded":"2023-10-18T19:34:38.280987+0000","last_fullsized":"2023-10-18T19:34:38.280987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280644+0000","last_change":"2023-10-18T19:34:21.256724+0000","last_active":"2023-10-18T19:34:38.280644+0000","last_peered":"2023-10-18T19:34:38.280644+0000","last_clean":"2023-10-18T19:34:38.280644+0000","last_became_active":"2023-10-18T19:34:21.256252+0000","last_became_peered":"2023-10-18T19:34:21.256252+0000","last_unstale":"2023-10-18T19:34:38.280644+0000","last_undegraded":"2023-10-18T19:34:38.280644+0000","last_fullsized":"2023-10-18T19:34:38.280644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281329+0000","last_change":"2023-10-18T19:34:20.846959+0000","last_active":"2023-10-18T19:34:38.281329+0000","last_peered":"2023-10-18T19:34:38.281329+0000","last_clean":"2023-10-18T19:34:38.281329+0000","last_became_active":"2023-10-18T19:34:20.846541+0000","last_became_peered":"2023-10-18T19:34:20.846541+0000","last_unstale":"2023-10-18T19:34:38.281329+0000","last_undegraded":"2023-10-18T19:34:38.281329+0000","last_fullsized":"2023-10-18T19:34:38.281329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282350+0000","last_change":"2023-10-18T19:34:21.251998+0000","last_active":"2023-10-18T19:34:38.282350+0000","last_peered":"2023-10-18T19:34:38.282350+0000","last_clean":"2023-10-18T19:34:38.282350+0000","last_became_active":"2023-10-18T19:34:21.251641+0000","last_became_peered":"2023-10-18T19:34:21.251641+0000","last_unstale":"2023-10-18T19:34:38.282350+0000","last_undegraded":"2023-10-18T19:34:38.282350+0000","last_fullsized":"2023-10-18T19:34:38.282350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281984+0000","last_change":"2023-10-18T19:34:20.844433+0000","last_active":"2023-10-18T19:34:38.281984+0000","last_peered":"2023-10-18T19:34:38.281984+0000","last_clean":"2023-10-18T19:34:38.281984+0000","last_became_active":"2023-10-18T19:34:20.843767+0000","last_became_peered":"2023-10-18T19:34:20.843767+0000","last_unstale":"2023-10-18T19:34:38.281984+0000","last_undegraded":"2023-10-18T19:34:38.281984+0000","last_fullsized":"2023-10-18T19:34:38.281984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282148+0000","last_change":"2023-10-18T19:34:21.259590+0000","last_active":"2023-10-18T19:34:38.282148+0000","last_peered":"2023-10-18T19:34:38.282148+0000","last_clean":"2023-10-18T19:34:38.282148+0000","last_became_active":"2023-10-18T19:34:21.257762+0000","last_became_peered":"2023-10-18T19:34:21.257762+0000","last_unstale":"2023-10-18T19:34:38.282148+0000","last_undegraded":"2023-10-18T19:34:38.282148+0000","last_fullsized":"2023-10-18T19:34:38.282148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432829+0000","last_change":"2023-10-18T19:34:20.845853+0000","last_active":"2023-10-18T19:37:15.432829+0000","last_peered":"2023-10-18T19:37:15.432829+0000","last_clean":"2023-10-18T19:37:15.432829+0000","last_became_active":"2023-10-18T19:34:20.845487+0000","last_became_peered":"2023-10-18T19:34:20.845487+0000","last_unstale":"2023-10-18T19:37:15.432829+0000","last_undegraded":"2023-10-18T19:37:15.432829+0000","last_fullsized":"2023-10-18T19:37:15.432829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282909+0000","last_change":"2023-10-18T19:34:21.255163+0000","last_active":"2023-10-18T19:34:38.282909+0000","last_peered":"2023-10-18T19:34:38.282909+0000","last_clean":"2023-10-18T19:34:38.282909+0000","last_became_active":"2023-10-18T19:34:21.252262+0000","last_became_peered":"2023-10-18T19:34:21.252262+0000","last_unstale":"2023-10-18T19:34:38.282909+0000","last_undegraded":"2023-10-18T19:34:38.282909+0000","last_fullsized":"2023-10-18T19:34:38.282909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:56.775862+0000","last_change":"2023-10-18T19:34:20.861998+0000","last_active":"2023-10-18T19:34:56.775862+0000","last_peered":"2023-10-18T19:34:56.775862+0000","last_clean":"2023-10-18T19:34:56.775862+0000","last_became_active":"2023-10-18T19:34:20.860333+0000","last_became_peered":"2023-10-18T19:34:20.860333+0000","last_unstale":"2023-10-18T19:34:56.775862+0000","last_undegraded":"2023-10-18T19:34:56.775862+0000","last_fullsized":"2023-10-18T19:34:56.775862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433015+0000","last_change":"2023-10-18T19:34:21.258083+0000","last_active":"2023-10-18T19:37:15.433015+0000","last_peered":"2023-10-18T19:37:15.433015+0000","last_clean":"2023-10-18T19:37:15.433015+0000","last_became_active":"2023-10-18T19:34:21.257626+0000","last_became_peered":"2023-10-18T19:34:21.257626+0000","last_unstale":"2023-10-18T19:37:15.433015+0000","last_undegraded":"2023-10-18T19:37:15.433015+0000","last_fullsized":"2023-10-18T19:37:15.433015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282770+0000","last_change":"2023-10-18T19:34:20.855980+0000","last_active":"2023-10-18T19:34:38.282770+0000","last_peered":"2023-10-18T19:34:38.282770+0000","last_clean":"2023-10-18T19:34:38.282770+0000","last_became_active":"2023-10-18T19:34:20.855446+0000","last_became_peered":"2023-10-18T19:34:20.855446+0000","last_unstale":"2023-10-18T19:34:38.282770+0000","last_undegraded":"2023-10-18T19:34:38.282770+0000","last_fullsized":"2023-10-18T19:34:38.282770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.280057+0000","last_change":"2023-10-18T19:34:21.267157+0000","last_active":"2023-10-18T19:34:38.280057+0000","last_peered":"2023-10-18T19:34:38.280057+0000","last_clean":"2023-10-18T19:34:38.280057+0000","last_became_active":"2023-10-18T19:34:21.266854+0000","last_became_peered":"2023-10-18T19:34:21.266854+0000","last_unstale":"2023-10-18T19:34:38.280057+0000","last_undegraded":"2023-10-18T19:34:38.280057+0000","last_fullsized":"2023-10-18T19:34:38.280057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279385+0000","last_change":"2023-10-18T19:34:20.847879+0000","last_active":"2023-10-18T19:34:38.279385+0000","last_peered":"2023-10-18T19:34:38.279385+0000","last_clean":"2023-10-18T19:34:38.279385+0000","last_became_active":"2023-10-18T19:34:20.847368+0000","last_became_peered":"2023-10-18T19:34:20.847368+0000","last_unstale":"2023-10-18T19:34:38.279385+0000","last_undegraded":"2023-10-18T19:34:38.279385+0000","last_fullsized":"2023-10-18T19:34:38.279385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279012+0000","last_change":"2023-10-18T19:34:21.271229+0000","last_active":"2023-10-18T19:34:38.279012+0000","last_peered":"2023-10-18T19:34:38.279012+0000","last_clean":"2023-10-18T19:34:38.279012+0000","last_became_active":"2023-10-18T19:34:21.270946+0000","last_became_peered":"2023-10-18T19:34:21.270946+0000","last_unstale":"2023-10-18T19:34:38.279012+0000","last_undegraded":"2023-10-18T19:34:38.279012+0000","last_fullsized":"2023-10-18T19:34:38.279012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281579+0000","last_change":"2023-10-18T19:34:20.857540+0000","last_active":"2023-10-18T19:34:38.281579+0000","last_peered":"2023-10-18T19:34:38.281579+0000","last_clean":"2023-10-18T19:34:38.281579+0000","last_became_active":"2023-10-18T19:34:20.857056+0000","last_became_peered":"2023-10-18T19:34:20.857056+0000","last_unstale":"2023-10-18T19:34:38.281579+0000","last_undegraded":"2023-10-18T19:34:38.281579+0000","last_fullsized":"2023-10-18T19:34:38.281579+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733162+0000","last_change":"2023-10-18T19:34:21.264597+0000","last_active":"2023-10-18T19:34:38.733162+0000","last_peered":"2023-10-18T19:34:38.733162+0000","last_clean":"2023-10-18T19:34:38.733162+0000","last_became_active":"2023-10-18T19:34:21.264304+0000","last_became_peered":"2023-10-18T19:34:21.264304+0000","last_unstale":"2023-10-18T19:34:38.733162+0000","last_undegraded":"2023-10-18T19:34:38.733162+0000","last_fullsized":"2023-10-18T19:34:38.733162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:35:01.798950+0000","last_change":"2023-10-18T19:34:20.830160+0000","last_active":"2023-10-18T19:35:01.798950+0000","last_peered":"2023-10-18T19:35:01.798950+0000","last_clean":"2023-10-18T19:35:01.798950+0000","last_became_active":"2023-10-18T19:34:20.829821+0000","last_became_peered":"2023-10-18T19:34:20.829821+0000","last_unstale":"2023-10-18T19:35:01.798950+0000","last_undegraded":"2023-10-18T19:35:01.798950+0000","last_fullsized":"2023-10-18T19:35:01.798950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282061+0000","last_change":"2023-10-18T19:34:21.250388+0000","last_active":"2023-10-18T19:34:38.282061+0000","last_peered":"2023-10-18T19:34:38.282061+0000","last_clean":"2023-10-18T19:34:38.282061+0000","last_became_active":"2023-10-18T19:34:21.250098+0000","last_became_peered":"2023-10-18T19:34:21.250098+0000","last_unstale":"2023-10-18T19:34:38.282061+0000","last_undegraded":"2023-10-18T19:34:38.282061+0000","last_fullsized":"2023-10-18T19:34:38.282061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431970+0000","last_change":"2023-10-18T19:34:20.857726+0000","last_active":"2023-10-18T19:37:15.431970+0000","last_peered":"2023-10-18T19:37:15.431970+0000","last_clean":"2023-10-18T19:37:15.431970+0000","last_became_active":"2023-10-18T19:34:20.856983+0000","last_became_peered":"2023-10-18T19:34:20.856983+0000","last_unstale":"2023-10-18T19:37:15.431970+0000","last_undegraded":"2023-10-18T19:37:15.431970+0000","last_fullsized":"2023-10-18T19:37:15.431970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282838+0000","last_change":"2023-10-18T19:34:21.270485+0000","last_active":"2023-10-18T19:34:38.282838+0000","last_peered":"2023-10-18T19:34:38.282838+0000","last_clean":"2023-10-18T19:34:38.282838+0000","last_became_active":"2023-10-18T19:34:21.270140+0000","last_became_peered":"2023-10-18T19:34:21.270140+0000","last_unstale":"2023-10-18T19:34:38.282838+0000","last_undegraded":"2023-10-18T19:34:38.282838+0000","last_fullsized":"2023-10-18T19:34:38.282838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432509+0000","last_change":"2023-10-18T19:34:20.847009+0000","last_active":"2023-10-18T19:37:15.432509+0000","last_peered":"2023-10-18T19:37:15.432509+0000","last_clean":"2023-10-18T19:37:15.432509+0000","last_became_active":"2023-10-18T19:34:20.846481+0000","last_became_peered":"2023-10-18T19:34:20.846481+0000","last_unstale":"2023-10-18T19:37:15.432509+0000","last_undegraded":"2023-10-18T19:37:15.432509+0000","last_fullsized":"2023-10-18T19:37:15.432509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733909+0000","last_change":"2023-10-18T19:34:21.256060+0000","last_active":"2023-10-18T19:34:38.733909+0000","last_peered":"2023-10-18T19:34:38.733909+0000","last_clean":"2023-10-18T19:34:38.733909+0000","last_became_active":"2023-10-18T19:34:21.255703+0000","last_became_peered":"2023-10-18T19:34:21.255703+0000","last_unstale":"2023-10-18T19:34:38.733909+0000","last_undegraded":"2023-10-18T19:34:38.733909+0000","last_fullsized":"2023-10-18T19:34:38.733909+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282443+0000","last_change":"2023-10-18T19:34:20.849799+0000","last_active":"2023-10-18T19:34:38.282443+0000","last_peered":"2023-10-18T19:34:38.282443+0000","last_clean":"2023-10-18T19:34:38.282443+0000","last_became_active":"2023-10-18T19:34:20.849488+0000","last_became_peered":"2023-10-18T19:34:20.849488+0000","last_unstale":"2023-10-18T19:34:38.282443+0000","last_undegraded":"2023-10-18T19:34:38.282443+0000","last_fullsized":"2023-10-18T19:34:38.282443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282561+0000","last_change":"2023-10-18T19:34:21.260006+0000","last_active":"2023-10-18T19:34:38.282561+0000","last_peered":"2023-10-18T19:34:38.282561+0000","last_clean":"2023-10-18T19:34:38.282561+0000","last_became_active":"2023-10-18T19:34:21.259689+0000","last_became_peered":"2023-10-18T19:34:21.259689+0000","last_unstale":"2023-10-18T19:34:38.282561+0000","last_undegraded":"2023-10-18T19:34:38.282561+0000","last_fullsized":"2023-10-18T19:34:38.282561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282357+0000","last_change":"2023-10-18T19:34:20.858108+0000","last_active":"2023-10-18T19:34:38.282357+0000","last_peered":"2023-10-18T19:34:38.282357+0000","last_clean":"2023-10-18T19:34:38.282357+0000","last_became_active":"2023-10-18T19:34:20.854784+0000","last_became_peered":"2023-10-18T19:34:20.854784+0000","last_unstale":"2023-10-18T19:34:38.282357+0000","last_undegraded":"2023-10-18T19:34:38.282357+0000","last_fullsized":"2023-10-18T19:34:38.282357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.433066+0000","last_change":"2023-10-18T19:34:21.257919+0000","last_active":"2023-10-18T19:37:15.433066+0000","last_peered":"2023-10-18T19:37:15.433066+0000","last_clean":"2023-10-18T19:37:15.433066+0000","last_became_active":"2023-10-18T19:34:21.257409+0000","last_became_peered":"2023-10-18T19:34:21.257409+0000","last_unstale":"2023-10-18T19:37:15.433066+0000","last_undegraded":"2023-10-18T19:37:15.433066+0000","last_fullsized":"2023-10-18T19:37:15.433066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282854+0000","last_change":"2023-10-18T19:34:20.847577+0000","last_active":"2023-10-18T19:34:38.282854+0000","last_peered":"2023-10-18T19:34:38.282854+0000","last_clean":"2023-10-18T19:34:38.282854+0000","last_became_active":"2023-10-18T19:34:20.842013+0000","last_became_peered":"2023-10-18T19:34:20.842013+0000","last_unstale":"2023-10-18T19:34:38.282854+0000","last_undegraded":"2023-10-18T19:34:38.282854+0000","last_fullsized":"2023-10-18T19:34:38.282854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281875+0000","last_change":"2023-10-18T19:34:21.251747+0000","last_active":"2023-10-18T19:34:38.281875+0000","last_peered":"2023-10-18T19:34:38.281875+0000","last_clean":"2023-10-18T19:34:38.281875+0000","last_became_active":"2023-10-18T19:34:21.251325+0000","last_became_peered":"2023-10-18T19:34:21.251325+0000","last_unstale":"2023-10-18T19:34:38.281875+0000","last_undegraded":"2023-10-18T19:34:38.281875+0000","last_fullsized":"2023-10-18T19:34:38.281875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732897+0000","last_change":"2023-10-18T19:34:20.832572+0000","last_active":"2023-10-18T19:34:38.732897+0000","last_peered":"2023-10-18T19:34:38.732897+0000","last_clean":"2023-10-18T19:34:38.732897+0000","last_became_active":"2023-10-18T19:34:20.832216+0000","last_became_peered":"2023-10-18T19:34:20.832216+0000","last_unstale":"2023-10-18T19:34:38.732897+0000","last_undegraded":"2023-10-18T19:34:38.732897+0000","last_fullsized":"2023-10-18T19:34:38.732897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279223+0000","last_change":"2023-10-18T19:34:21.272247+0000","last_active":"2023-10-18T19:34:38.279223+0000","last_peered":"2023-10-18T19:34:38.279223+0000","last_clean":"2023-10-18T19:34:38.279223+0000","last_became_active":"2023-10-18T19:34:21.271930+0000","last_became_peered":"2023-10-18T19:34:21.271930+0000","last_unstale":"2023-10-18T19:34:38.279223+0000","last_undegraded":"2023-10-18T19:34:38.279223+0000","last_fullsized":"2023-10-18T19:34:38.279223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733403+0000","last_change":"2023-10-18T19:34:20.840841+0000","last_active":"2023-10-18T19:34:38.733403+0000","last_peered":"2023-10-18T19:34:38.733403+0000","last_clean":"2023-10-18T19:34:38.733403+0000","last_became_active":"2023-10-18T19:34:20.840351+0000","last_became_peered":"2023-10-18T19:34:20.840351+0000","last_unstale":"2023-10-18T19:34:38.733403+0000","last_undegraded":"2023-10-18T19:34:38.733403+0000","last_fullsized":"2023-10-18T19:34:38.733403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281107+0000","last_change":"2023-10-18T19:34:21.258445+0000","last_active":"2023-10-18T19:34:38.281107+0000","last_peered":"2023-10-18T19:34:38.281107+0000","last_clean":"2023-10-18T19:34:38.281107+0000","last_became_active":"2023-10-18T19:34:21.257747+0000","last_became_peered":"2023-10-18T19:34:21.257747+0000","last_unstale":"2023-10-18T19:34:38.281107+0000","last_undegraded":"2023-10-18T19:34:38.281107+0000","last_fullsized":"2023-10-18T19:34:38.281107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431681+0000","last_change":"2023-10-18T19:34:20.856638+0000","last_active":"2023-10-18T19:37:15.431681+0000","last_peered":"2023-10-18T19:37:15.431681+0000","last_clean":"2023-10-18T19:37:15.431681+0000","last_became_active":"2023-10-18T19:34:20.856094+0000","last_became_peered":"2023-10-18T19:34:20.856094+0000","last_unstale":"2023-10-18T19:37:15.431681+0000","last_undegraded":"2023-10-18T19:37:15.431681+0000","last_fullsized":"2023-10-18T19:37:15.431681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733334+0000","last_change":"2023-10-18T19:34:21.249180+0000","last_active":"2023-10-18T19:34:38.733334+0000","last_peered":"2023-10-18T19:34:38.733334+0000","last_clean":"2023-10-18T19:34:38.733334+0000","last_became_active":"2023-10-18T19:34:21.245370+0000","last_became_peered":"2023-10-18T19:34:21.245370+0000","last_unstale":"2023-10-18T19:34:38.733334+0000","last_undegraded":"2023-10-18T19:34:38.733334+0000","last_fullsized":"2023-10-18T19:34:38.733334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281765+0000","last_change":"2023-10-18T19:34:20.823278+0000","last_active":"2023-10-18T19:34:38.281765+0000","last_peered":"2023-10-18T19:34:38.281765+0000","last_clean":"2023-10-18T19:34:38.281765+0000","last_became_active":"2023-10-18T19:34:20.823003+0000","last_became_peered":"2023-10-18T19:34:20.823003+0000","last_unstale":"2023-10-18T19:34:38.281765+0000","last_undegraded":"2023-10-18T19:34:38.281765+0000","last_fullsized":"2023-10-18T19:34:38.281765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734049+0000","last_change":"2023-10-18T19:34:21.246335+0000","last_active":"2023-10-18T19:34:38.734049+0000","last_peered":"2023-10-18T19:34:38.734049+0000","last_clean":"2023-10-18T19:34:38.734049+0000","last_became_active":"2023-10-18T19:34:21.246040+0000","last_became_peered":"2023-10-18T19:34:21.246040+0000","last_unstale":"2023-10-18T19:34:38.734049+0000","last_undegraded":"2023-10-18T19:34:38.734049+0000","last_fullsized":"2023-10-18T19:34:38.734049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.404885+0000","last_change":"2023-10-18T19:34:20.855032+0000","last_active":"2023-10-18T19:37:15.404885+0000","last_peered":"2023-10-18T19:37:15.404885+0000","last_clean":"2023-10-18T19:37:15.404885+0000","last_became_active":"2023-10-18T19:34:20.854673+0000","last_became_peered":"2023-10-18T19:34:20.854673+0000","last_unstale":"2023-10-18T19:37:15.404885+0000","last_undegraded":"2023-10-18T19:37:15.404885+0000","last_fullsized":"2023-10-18T19:37:15.404885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734255+0000","last_change":"2023-10-18T19:34:21.254232+0000","last_active":"2023-10-18T19:34:38.734255+0000","last_peered":"2023-10-18T19:34:38.734255+0000","last_clean":"2023-10-18T19:34:38.734255+0000","last_became_active":"2023-10-18T19:34:21.253932+0000","last_became_peered":"2023-10-18T19:34:21.253932+0000","last_unstale":"2023-10-18T19:34:38.734255+0000","last_undegraded":"2023-10-18T19:34:38.734255+0000","last_fullsized":"2023-10-18T19:34:38.734255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282242+0000","last_change":"2023-10-18T19:34:20.855559+0000","last_active":"2023-10-18T19:34:38.282242+0000","last_peered":"2023-10-18T19:34:38.282242+0000","last_clean":"2023-10-18T19:34:38.282242+0000","last_became_active":"2023-10-18T19:34:20.854845+0000","last_became_peered":"2023-10-18T19:34:20.854845+0000","last_unstale":"2023-10-18T19:34:38.282242+0000","last_undegraded":"2023-10-18T19:34:38.282242+0000","last_fullsized":"2023-10-18T19:34:38.282242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282827+0000","last_change":"2023-10-18T19:34:21.248190+0000","last_active":"2023-10-18T19:34:38.282827+0000","last_peered":"2023-10-18T19:34:38.282827+0000","last_clean":"2023-10-18T19:34:38.282827+0000","last_became_active":"2023-10-18T19:34:21.247102+0000","last_became_peered":"2023-10-18T19:34:21.247102+0000","last_unstale":"2023-10-18T19:34:38.282827+0000","last_undegraded":"2023-10-18T19:34:38.282827+0000","last_fullsized":"2023-10-18T19:34:38.282827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282185+0000","last_change":"2023-10-18T19:34:20.857956+0000","last_active":"2023-10-18T19:34:38.282185+0000","last_peered":"2023-10-18T19:34:38.282185+0000","last_clean":"2023-10-18T19:34:38.282185+0000","last_became_active":"2023-10-18T19:34:20.855051+0000","last_became_peered":"2023-10-18T19:34:20.855051+0000","last_unstale":"2023-10-18T19:34:38.282185+0000","last_undegraded":"2023-10-18T19:34:38.282185+0000","last_fullsized":"2023-10-18T19:34:38.282185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734496+0000","last_change":"2023-10-18T19:34:21.266700+0000","last_active":"2023-10-18T19:34:38.734496+0000","last_peered":"2023-10-18T19:34:38.734496+0000","last_clean":"2023-10-18T19:34:38.734496+0000","last_became_active":"2023-10-18T19:34:21.266409+0000","last_became_peered":"2023-10-18T19:34:21.266409+0000","last_unstale":"2023-10-18T19:34:38.734496+0000","last_undegraded":"2023-10-18T19:34:38.734496+0000","last_fullsized":"2023-10-18T19:34:38.734496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734439+0000","last_change":"2023-10-18T19:34:20.851465+0000","last_active":"2023-10-18T19:34:38.734439+0000","last_peered":"2023-10-18T19:34:38.734439+0000","last_clean":"2023-10-18T19:34:38.734439+0000","last_became_active":"2023-10-18T19:34:20.851166+0000","last_became_peered":"2023-10-18T19:34:20.851166+0000","last_unstale":"2023-10-18T19:34:38.734439+0000","last_undegraded":"2023-10-18T19:34:38.734439+0000","last_fullsized":"2023-10-18T19:34:38.734439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733028+0000","last_change":"2023-10-18T19:34:21.245529+0000","last_active":"2023-10-18T19:34:38.733028+0000","last_peered":"2023-10-18T19:34:38.733028+0000","last_clean":"2023-10-18T19:34:38.733028+0000","last_became_active":"2023-10-18T19:34:21.245217+0000","last_became_peered":"2023-10-18T19:34:21.245217+0000","last_unstale":"2023-10-18T19:34:38.733028+0000","last_undegraded":"2023-10-18T19:34:38.733028+0000","last_fullsized":"2023-10-18T19:34:38.733028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.732935+0000","last_change":"2023-10-18T19:34:20.837517+0000","last_active":"2023-10-18T19:34:38.732935+0000","last_peered":"2023-10-18T19:34:38.732935+0000","last_clean":"2023-10-18T19:34:38.732935+0000","last_became_active":"2023-10-18T19:34:20.837192+0000","last_became_peered":"2023-10-18T19:34:20.837192+0000","last_unstale":"2023-10-18T19:34:38.732935+0000","last_undegraded":"2023-10-18T19:34:38.732935+0000","last_fullsized":"2023-10-18T19:34:38.732935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.279330+0000","last_change":"2023-10-18T19:34:21.262649+0000","last_active":"2023-10-18T19:34:38.279330+0000","last_peered":"2023-10-18T19:34:38.279330+0000","last_clean":"2023-10-18T19:34:38.279330+0000","last_became_active":"2023-10-18T19:34:21.262175+0000","last_became_peered":"2023-10-18T19:34:21.262175+0000","last_unstale":"2023-10-18T19:34:38.279330+0000","last_undegraded":"2023-10-18T19:34:38.279330+0000","last_fullsized":"2023-10-18T19:34:38.279330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.281496+0000","last_change":"2023-10-18T19:34:20.821558+0000","last_active":"2023-10-18T19:34:38.281496+0000","last_peered":"2023-10-18T19:34:38.281496+0000","last_clean":"2023-10-18T19:34:38.281496+0000","last_became_active":"2023-10-18T19:34:20.821225+0000","last_became_peered":"2023-10-18T19:34:20.821225+0000","last_unstale":"2023-10-18T19:34:38.281496+0000","last_undegraded":"2023-10-18T19:34:38.281496+0000","last_fullsized":"2023-10-18T19:34:38.281496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733138+0000","last_change":"2023-10-18T19:34:21.268630+0000","last_active":"2023-10-18T19:34:38.733138+0000","last_peered":"2023-10-18T19:34:38.733138+0000","last_clean":"2023-10-18T19:34:38.733138+0000","last_became_active":"2023-10-18T19:34:21.268347+0000","last_became_peered":"2023-10-18T19:34:21.268347+0000","last_unstale":"2023-10-18T19:34:38.733138+0000","last_undegraded":"2023-10-18T19:34:38.733138+0000","last_fullsized":"2023-10-18T19:34:38.733138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431765+0000","last_change":"2023-10-18T19:34:20.856427+0000","last_active":"2023-10-18T19:37:15.431765+0000","last_peered":"2023-10-18T19:37:15.431765+0000","last_clean":"2023-10-18T19:37:15.431765+0000","last_became_active":"2023-10-18T19:34:20.855877+0000","last_became_peered":"2023-10-18T19:34:20.855877+0000","last_unstale":"2023-10-18T19:37:15.431765+0000","last_undegraded":"2023-10-18T19:37:15.431765+0000","last_fullsized":"2023-10-18T19:37:15.431765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.431545+0000","last_change":"2023-10-18T19:34:21.259142+0000","last_active":"2023-10-18T19:37:15.431545+0000","last_peered":"2023-10-18T19:37:15.431545+0000","last_clean":"2023-10-18T19:37:15.431545+0000","last_became_active":"2023-10-18T19:34:21.258709+0000","last_became_peered":"2023-10-18T19:34:21.258709+0000","last_unstale":"2023-10-18T19:37:15.431545+0000","last_undegraded":"2023-10-18T19:37:15.431545+0000","last_fullsized":"2023-10-18T19:37:15.431545+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733304+0000","last_change":"2023-10-18T19:34:20.861616+0000","last_active":"2023-10-18T19:34:38.733304+0000","last_peered":"2023-10-18T19:34:38.733304+0000","last_clean":"2023-10-18T19:34:38.733304+0000","last_became_active":"2023-10-18T19:34:20.861363+0000","last_became_peered":"2023-10-18T19:34:20.861363+0000","last_unstale":"2023-10-18T19:34:38.733304+0000","last_undegraded":"2023-10-18T19:34:38.733304+0000","last_fullsized":"2023-10-18T19:34:38.733304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.733725+0000","last_change":"2023-10-18T19:34:21.267981+0000","last_active":"2023-10-18T19:34:38.733725+0000","last_peered":"2023-10-18T19:34:38.733725+0000","last_clean":"2023-10-18T19:34:38.733725+0000","last_became_active":"2023-10-18T19:34:21.267584+0000","last_became_peered":"2023-10-18T19:34:21.267584+0000","last_unstale":"2023-10-18T19:34:38.733725+0000","last_undegraded":"2023-10-18T19:34:38.733725+0000","last_fullsized":"2023-10-18T19:34:38.733725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734167+0000","last_change":"2023-10-18T19:34:20.855045+0000","last_active":"2023-10-18T19:34:38.734167+0000","last_peered":"2023-10-18T19:34:38.734167+0000","last_clean":"2023-10-18T19:34:38.734167+0000","last_became_active":"2023-10-18T19:34:20.854724+0000","last_became_peered":"2023-10-18T19:34:20.854724+0000","last_unstale":"2023-10-18T19:34:38.734167+0000","last_undegraded":"2023-10-18T19:34:38.734167+0000","last_fullsized":"2023-10-18T19:34:38.734167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-10-18T19:37:15.432660+0000","last_change":"2023-10-18T19:34:21.262741+0000","last_active":"2023-10-18T19:37:15.432660+0000","last_peered":"2023-10-18T19:37:15.432660+0000","last_clean":"2023-10-18T19:37:15.432660+0000","last_became_active":"2023-10-18T19:34:21.262435+0000","last_became_peered":"2023-10-18T19:34:21.262435+0000","last_unstale":"2023-10-18T19:37:15.432660+0000","last_undegraded":"2023-10-18T19:37:15.432660+0000","last_fullsized":"2023-10-18T19:37:15.432660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282043+0000","last_change":"2023-10-18T19:34:20.850195+0000","last_active":"2023-10-18T19:34:38.282043+0000","last_peered":"2023-10-18T19:34:38.282043+0000","last_clean":"2023-10-18T19:34:38.282043+0000","last_became_active":"2023-10-18T19:34:20.849885+0000","last_became_peered":"2023-10-18T19:34:20.849885+0000","last_unstale":"2023-10-18T19:34:38.282043+0000","last_undegraded":"2023-10-18T19:34:38.282043+0000","last_fullsized":"2023-10-18T19:34:38.282043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734093+0000","last_change":"2023-10-18T19:34:21.248730+0000","last_active":"2023-10-18T19:34:38.734093+0000","last_peered":"2023-10-18T19:34:38.734093+0000","last_clean":"2023-10-18T19:34:38.734093+0000","last_became_active":"2023-10-18T19:34:21.248420+0000","last_became_peered":"2023-10-18T19:34:21.248420+0000","last_unstale":"2023-10-18T19:34:38.734093+0000","last_undegraded":"2023-10-18T19:34:38.734093+0000","last_fullsized":"2023-10-18T19:34:38.734093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.734685+0000","last_change":"2023-10-18T19:34:20.862008+0000","last_active":"2023-10-18T19:34:38.734685+0000","last_peered":"2023-10-18T19:34:38.734685+0000","last_clean":"2023-10-18T19:34:38.734685+0000","last_became_active":"2023-10-18T19:34:20.858973+0000","last_became_peered":"2023-10-18T19:34:20.858973+0000","last_unstale":"2023-10-18T19:34:38.734685+0000","last_undegraded":"2023-10-18T19:34:38.734685+0000","last_fullsized":"2023-10-18T19:34:38.734685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282092+0000","last_change":"2023-10-18T19:34:21.259920+0000","last_active":"2023-10-18T19:34:38.282092+0000","last_peered":"2023-10-18T19:34:38.282092+0000","last_clean":"2023-10-18T19:34:38.282092+0000","last_became_active":"2023-10-18T19:34:21.259474+0000","last_became_peered":"2023-10-18T19:34:21.259474+0000","last_unstale":"2023-10-18T19:34:38.282092+0000","last_undegraded":"2023-10-18T19:34:38.282092+0000","last_fullsized":"2023-10-18T19:34:38.282092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-18T19:34:38.282747+0000","last_change":"2023-10-18T19:34:20.842664+0000","last_active":"2023-10-18T19:34:38.282747+0000","last_peered":"2023-10-18T19:34:38.282747+0000","last_clean":"2023-10-18T19:34:38.282747+0000","last_became_active":"2023-10-18T19:34:20.842341+0000","last_became_peered":"2023-10-18T19:34:20.842341+0000","last_unstale":"2023-10-18T19:34:38.282747+0000","last_undegraded":"2023-10-18T19:34:38.282747+0000","last_fullsized":"2023-10-18T19:34:38.282747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705704,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":54653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35999999999999999,"15min":0.376},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.48099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37}]},{"osd":1,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.41799999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.357,"15min":1.357},"last":0.32600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705704,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39400000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38300000000000001}]},{"osd":1,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.377},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.45300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40200000000000002}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.375},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.43099999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.41899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.42799999999999999}]},{"osd":3,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39500000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705704,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":44912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.375},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40699999999999997}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56699999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:24.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:24.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.399+0000 7ff9495ff700 1 Processor -- start 2023-10-18T19:37:24.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 -- start start 2023-10-18T19:37:24.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440af970 0x7ff944135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9440a1790 0x7ff944136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440afd50 con 0x7ff9440a4c50 2023-10-18T19:37:24.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440a47a0 con 0x7ff9440a1790 2023-10-18T19:37:24.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.400+0000 7ff9495ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a3a10 con 0x7ff9440af970 2023-10-18T19:37:24.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9440a1790 0x7ff944136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff942ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440af970 0x7ff944135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9440a1790 0x7ff944136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36504/0 (socket says 172.21.15.88:36504) 2023-10-18T19:37:24.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 -- 172.21.15.88:0/2913725511 learned_addr learned my addr 172.21.15.88:0/2913725511 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:24.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 -- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440af970 msgr2=0x7ff944135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:24.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440af970 0x7ff944135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 -- 172.21.15.88:0/2913725511 >> v1:172.21.15.88:6789/0 conn(0x7ff9440a4c50 legacy=0x7ff94413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 -- 172.21.15.88:0/2913725511 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440a32d0 con 0x7ff9440a1790 2023-10-18T19:37:24.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a1790 0x7ff944136220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff938006fd0 tx=0x7ff9380090f0).ready entity=mon.0 client_cookie=e9a7aa1a56863b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:24.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.401+0000 7ff941ffb700 1 -- 172.21.15.88:0/2913725511 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800b580 con 0x7ff9440a1790 2023-10-18T19:37:24.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff941ffb700 1 -- 172.21.15.88:0/2913725511 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93800b6e0 con 0x7ff9440a1790 2023-10-18T19:37:24.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff941ffb700 1 -- 172.21.15.88:0/2913725511 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800ba60 con 0x7ff9440a1790 2023-10-18T19:37:24.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 -- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a1790 msgr2=0x7ff944136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a1790 0x7ff944136220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff938006fd0 tx=0x7ff9380090f0).stop 2023-10-18T19:37:24.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 -- 172.21.15.88:0/2913725511 shutdown_connections 2023-10-18T19:37:24.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440af970 0x7ff944135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2913725511 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a1790 0x7ff944136220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 -- 172.21.15.88:0/2913725511 >> 172.21.15.88:0/2913725511 conn(0x7ff94405eb60 msgr2=0x7ff9440af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:24.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 -- 172.21.15.88:0/2913725511 shutdown_connections 2023-10-18T19:37:24.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.402+0000 7ff9495ff700 1 -- 172.21.15.88:0/2913725511 wait complete. 2023-10-18T19:37:24.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.403+0000 7ff9495ff700 1 Processor -- start 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 -- start start 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 0x7ff9440a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 0x7ff9441493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9440af970 0x7ff9440a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944148fc0 con 0x7ff9440a4c50 2023-10-18T19:37:24.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a6560 con 0x7ff9440af970 2023-10-18T19:37:24.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff9495ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a7a90 con 0x7ff9440a1790 2023-10-18T19:37:24.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.404+0000 7ff942ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 0x7ff9440a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff942ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 0x7ff9440a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56382/0 (socket says 172.21.15.88:56382) 2023-10-18T19:37:24.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff942ffd700 1 -- 172.21.15.88:0/2561868538 learned_addr learned my addr 172.21.15.88:0/2561868538 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:24.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 0x7ff9441493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9437fe700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9440af970 0x7ff9440a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 -- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 msgr2=0x7ff9440a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 0x7ff9440a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 -- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9440af970 msgr2=0x7ff9440a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9440af970 0x7ff9440a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 -- 172.21.15.88:0/2561868538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009370 con 0x7ff9440a4c50 2023-10-18T19:37:24.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9427fc700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 0x7ff9441493f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff944063930 tx=0x7ff938017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:24.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938006a40 con 0x7ff9440a4c50 2023-10-18T19:37:24.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff938000bc0 con 0x7ff9440a4c50 2023-10-18T19:37:24.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440a6790 con 0x7ff9440a4c50 2023-10-18T19:37:24.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.405+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93801c420 con 0x7ff9440a4c50 2023-10-18T19:37:24.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.406+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9441498e0 con 0x7ff9440a4c50 2023-10-18T19:37:24.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.407+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94405f270 con 0x7ff9440a4c50 2023-10-18T19:37:24.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.407+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7ff93801c810 con 0x7ff9440a4c50 2023-10-18T19:37:24.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.407+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7ff9380572a0 con 0x7ff9440a4c50 2023-10-18T19:37:24.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.410+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ff9380266a0 con 0x7ff9440a4c50 2023-10-18T19:37:24.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.554+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff94409eb40 con 0x7ff930041ce0 2023-10-18T19:37:24.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.564+0000 7ff92affd700 1 -- 172.21.15.88:0/2561868538 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+326499 (unknown 2965378022 0 2108799798) 0x7ff94409eb40 con 0x7ff930041ce0 2023-10-18T19:37:24.571 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:24.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 >> v1:172.21.15.88:6800/113625 conn(0x7ff930041ce0 legacy=0x7ff9300441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 msgr2=0x7ff9441493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 0x7ff9441493f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff944063930 tx=0x7ff938017000).stop 2023-10-18T19:37:24.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 shutdown_connections 2023-10-18T19:37:24.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9440af970 0x7ff9440a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff9440a1790 0x7ff9440a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 --2- 172.21.15.88:0/2561868538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9440a4c50 0x7ff9441493f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 >> 172.21.15.88:0/2561868538 conn(0x7ff94405eb60 msgr2=0x7ff9440ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:24.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 shutdown_connections 2023-10-18T19:37:24.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.568+0000 7ff9495ff700 1 -- 172.21.15.88:0/2561868538 wait complete. 2023-10-18T19:37:24.576 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:24.587 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-10-18T19:37:23.355774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195152,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292208,"statfs":{"total":386547056640,"available":382251220992,"internally_reserved":4294967296,"allocated":835584,"data_stored":256164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.994617"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354419+0000","last_change":"2023-10-18T19:34:21.266064+0000","last_active":"2023-10-18T19:37:17.354419+0000","last_peered":"2023-10-18T19:37:17.354419+0000","last_clean":"2023-10-18T19:37:17.354419+0000","last_became_active":"2023-10-18T19:34:21.265745+0000","last_became_peered":"2023-10-18T19:34:21.265745+0000","last_unstale":"2023-10-18T19:37:17.354419+0000","last_undegraded":"2023-10-18T19:37:17.354419+0000","last_fullsized":"2023-10-18T19:37:17.354419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356903+0000","last_change":"2023-10-18T19:34:20.848544+0000","last_active":"2023-10-18T19:37:17.356903+0000","last_peered":"2023-10-18T19:37:17.356903+0000","last_clean":"2023-10-18T19:37:17.356903+0000","last_became_active":"2023-10-18T19:34:20.848186+0000","last_became_peered":"2023-10-18T19:34:20.848186+0000","last_unstale":"2023-10-18T19:37:17.356903+0000","last_undegraded":"2023-10-18T19:37:17.356903+0000","last_fullsized":"2023-10-18T19:37:17.356903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356826+0000","last_change":"2023-10-18T19:34:21.249452+0000","last_active":"2023-10-18T19:37:18.356826+0000","last_peered":"2023-10-18T19:37:18.356826+0000","last_clean":"2023-10-18T19:37:18.356826+0000","last_became_active":"2023-10-18T19:34:21.249103+0000","last_became_peered":"2023-10-18T19:34:21.249103+0000","last_unstale":"2023-10-18T19:37:18.356826+0000","last_undegraded":"2023-10-18T19:37:18.356826+0000","last_fullsized":"2023-10-18T19:37:18.356826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357673+0000","last_change":"2023-10-18T19:34:20.835459+0000","last_active":"2023-10-18T19:37:17.357673+0000","last_peered":"2023-10-18T19:37:17.357673+0000","last_clean":"2023-10-18T19:37:17.357673+0000","last_became_active":"2023-10-18T19:34:20.835145+0000","last_became_peered":"2023-10-18T19:34:20.835145+0000","last_unstale":"2023-10-18T19:37:17.357673+0000","last_undegraded":"2023-10-18T19:37:17.357673+0000","last_fullsized":"2023-10-18T19:37:17.357673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356508+0000","last_change":"2023-10-18T19:34:21.262486+0000","last_active":"2023-10-18T19:37:17.356508+0000","last_peered":"2023-10-18T19:37:17.356508+0000","last_clean":"2023-10-18T19:37:17.356508+0000","last_became_active":"2023-10-18T19:34:21.261956+0000","last_became_peered":"2023-10-18T19:34:21.261956+0000","last_unstale":"2023-10-18T19:37:17.356508+0000","last_undegraded":"2023-10-18T19:37:17.356508+0000","last_fullsized":"2023-10-18T19:37:17.356508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356459+0000","last_change":"2023-10-18T19:34:20.854649+0000","last_active":"2023-10-18T19:37:17.356459+0000","last_peered":"2023-10-18T19:37:17.356459+0000","last_clean":"2023-10-18T19:37:17.356459+0000","last_became_active":"2023-10-18T19:34:20.854333+0000","last_became_peered":"2023-10-18T19:34:20.854333+0000","last_unstale":"2023-10-18T19:37:17.356459+0000","last_undegraded":"2023-10-18T19:37:17.356459+0000","last_fullsized":"2023-10-18T19:37:17.356459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354353+0000","last_change":"2023-10-18T19:34:21.246025+0000","last_active":"2023-10-18T19:37:17.354353+0000","last_peered":"2023-10-18T19:37:17.354353+0000","last_clean":"2023-10-18T19:37:17.354353+0000","last_became_active":"2023-10-18T19:34:21.245735+0000","last_became_peered":"2023-10-18T19:34:21.245735+0000","last_unstale":"2023-10-18T19:37:17.354353+0000","last_undegraded":"2023-10-18T19:37:17.354353+0000","last_fullsized":"2023-10-18T19:37:17.354353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355816+0000","last_change":"2023-10-18T19:34:20.853312+0000","last_active":"2023-10-18T19:37:17.355816+0000","last_peered":"2023-10-18T19:37:17.355816+0000","last_clean":"2023-10-18T19:37:17.355816+0000","last_became_active":"2023-10-18T19:34:20.852964+0000","last_became_peered":"2023-10-18T19:34:20.852964+0000","last_unstale":"2023-10-18T19:37:17.355816+0000","last_undegraded":"2023-10-18T19:37:17.355816+0000","last_fullsized":"2023-10-18T19:37:17.355816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357255+0000","last_change":"2023-10-18T19:34:21.265408+0000","last_active":"2023-10-18T19:37:18.357255+0000","last_peered":"2023-10-18T19:37:18.357255+0000","last_clean":"2023-10-18T19:37:18.357255+0000","last_became_active":"2023-10-18T19:34:21.265029+0000","last_became_peered":"2023-10-18T19:34:21.265029+0000","last_unstale":"2023-10-18T19:37:18.357255+0000","last_undegraded":"2023-10-18T19:37:18.357255+0000","last_fullsized":"2023-10-18T19:37:18.357255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355355+0000","last_change":"2023-10-18T19:34:20.825709+0000","last_active":"2023-10-18T19:37:17.355355+0000","last_peered":"2023-10-18T19:37:17.355355+0000","last_clean":"2023-10-18T19:37:17.355355+0000","last_became_active":"2023-10-18T19:34:20.825364+0000","last_became_peered":"2023-10-18T19:34:20.825364+0000","last_unstale":"2023-10-18T19:37:17.355355+0000","last_undegraded":"2023-10-18T19:37:17.355355+0000","last_fullsized":"2023-10-18T19:37:17.355355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358670+0000","last_change":"2023-10-18T19:34:21.250032+0000","last_active":"2023-10-18T19:37:18.358670+0000","last_peered":"2023-10-18T19:37:18.358670+0000","last_clean":"2023-10-18T19:37:18.358670+0000","last_became_active":"2023-10-18T19:34:21.245104+0000","last_became_peered":"2023-10-18T19:34:21.245104+0000","last_unstale":"2023-10-18T19:37:18.358670+0000","last_undegraded":"2023-10-18T19:37:18.358670+0000","last_fullsized":"2023-10-18T19:37:18.358670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.359232+0000","last_change":"2023-10-18T19:34:20.862583+0000","last_active":"2023-10-18T19:37:18.359232+0000","last_peered":"2023-10-18T19:37:18.359232+0000","last_clean":"2023-10-18T19:37:18.359232+0000","last_became_active":"2023-10-18T19:34:20.862262+0000","last_became_peered":"2023-10-18T19:34:20.862262+0000","last_unstale":"2023-10-18T19:37:18.359232+0000","last_undegraded":"2023-10-18T19:37:18.359232+0000","last_fullsized":"2023-10-18T19:37:18.359232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357197+0000","last_change":"2023-10-18T19:34:21.265750+0000","last_active":"2023-10-18T19:37:17.357197+0000","last_peered":"2023-10-18T19:37:17.357197+0000","last_clean":"2023-10-18T19:37:17.357197+0000","last_became_active":"2023-10-18T19:34:21.265449+0000","last_became_peered":"2023-10-18T19:34:21.265449+0000","last_unstale":"2023-10-18T19:37:17.357197+0000","last_undegraded":"2023-10-18T19:37:17.357197+0000","last_fullsized":"2023-10-18T19:37:17.357197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354916+0000","last_change":"2023-10-18T19:34:20.855201+0000","last_active":"2023-10-18T19:37:17.354916+0000","last_peered":"2023-10-18T19:37:17.354916+0000","last_clean":"2023-10-18T19:37:17.354916+0000","last_became_active":"2023-10-18T19:34:20.854344+0000","last_became_peered":"2023-10-18T19:34:20.854344+0000","last_unstale":"2023-10-18T19:37:17.354916+0000","last_undegraded":"2023-10-18T19:37:17.354916+0000","last_fullsized":"2023-10-18T19:37:17.354916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358539+0000","last_change":"2023-10-18T19:34:21.249688+0000","last_active":"2023-10-18T19:37:18.358539+0000","last_peered":"2023-10-18T19:37:18.358539+0000","last_clean":"2023-10-18T19:37:18.358539+0000","last_became_active":"2023-10-18T19:34:21.246078+0000","last_became_peered":"2023-10-18T19:34:21.246078+0000","last_unstale":"2023-10-18T19:37:18.358539+0000","last_undegraded":"2023-10-18T19:37:18.358539+0000","last_fullsized":"2023-10-18T19:37:18.358539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357674+0000","last_change":"2023-10-18T19:34:20.857791+0000","last_active":"2023-10-18T19:37:18.357674+0000","last_peered":"2023-10-18T19:37:18.357674+0000","last_clean":"2023-10-18T19:37:18.357674+0000","last_became_active":"2023-10-18T19:34:20.857489+0000","last_became_peered":"2023-10-18T19:34:20.857489+0000","last_unstale":"2023-10-18T19:37:18.357674+0000","last_undegraded":"2023-10-18T19:37:18.357674+0000","last_fullsized":"2023-10-18T19:37:18.357674+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356462+0000","last_change":"2023-10-18T19:34:21.245879+0000","last_active":"2023-10-18T19:37:18.356462+0000","last_peered":"2023-10-18T19:37:18.356462+0000","last_clean":"2023-10-18T19:37:18.356462+0000","last_became_active":"2023-10-18T19:34:21.245587+0000","last_became_peered":"2023-10-18T19:34:21.245587+0000","last_unstale":"2023-10-18T19:37:18.356462+0000","last_undegraded":"2023-10-18T19:37:18.356462+0000","last_fullsized":"2023-10-18T19:37:18.356462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357515+0000","last_change":"2023-10-18T19:34:20.857559+0000","last_active":"2023-10-18T19:37:18.357515+0000","last_peered":"2023-10-18T19:37:18.357515+0000","last_clean":"2023-10-18T19:37:18.357515+0000","last_became_active":"2023-10-18T19:34:20.857227+0000","last_became_peered":"2023-10-18T19:34:20.857227+0000","last_unstale":"2023-10-18T19:37:18.357515+0000","last_undegraded":"2023-10-18T19:37:18.357515+0000","last_fullsized":"2023-10-18T19:37:18.357515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356938+0000","last_change":"2023-10-18T19:34:21.258745+0000","last_active":"2023-10-18T19:37:17.356938+0000","last_peered":"2023-10-18T19:37:17.356938+0000","last_clean":"2023-10-18T19:37:17.356938+0000","last_became_active":"2023-10-18T19:34:21.258295+0000","last_became_peered":"2023-10-18T19:34:21.258295+0000","last_unstale":"2023-10-18T19:37:17.356938+0000","last_undegraded":"2023-10-18T19:37:17.356938+0000","last_fullsized":"2023-10-18T19:37:17.356938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357440+0000","last_change":"2023-10-18T19:34:20.836255+0000","last_active":"2023-10-18T19:37:17.357440+0000","last_peered":"2023-10-18T19:37:17.357440+0000","last_clean":"2023-10-18T19:37:17.357440+0000","last_became_active":"2023-10-18T19:34:20.835941+0000","last_became_peered":"2023-10-18T19:34:20.835941+0000","last_unstale":"2023-10-18T19:37:17.357440+0000","last_undegraded":"2023-10-18T19:37:17.357440+0000","last_fullsized":"2023-10-18T19:37:17.357440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354053+0000","last_change":"2023-10-18T19:34:21.253538+0000","last_active":"2023-10-18T19:37:17.354053+0000","last_peered":"2023-10-18T19:37:17.354053+0000","last_clean":"2023-10-18T19:37:17.354053+0000","last_became_active":"2023-10-18T19:34:21.253274+0000","last_became_peered":"2023-10-18T19:34:21.253274+0000","last_unstale":"2023-10-18T19:37:17.354053+0000","last_undegraded":"2023-10-18T19:37:17.354053+0000","last_fullsized":"2023-10-18T19:37:17.354053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356298+0000","last_change":"2023-10-18T19:34:20.857139+0000","last_active":"2023-10-18T19:37:18.356298+0000","last_peered":"2023-10-18T19:37:18.356298+0000","last_clean":"2023-10-18T19:37:18.356298+0000","last_became_active":"2023-10-18T19:34:20.856766+0000","last_became_peered":"2023-10-18T19:34:20.856766+0000","last_unstale":"2023-10-18T19:37:18.356298+0000","last_undegraded":"2023-10-18T19:37:18.356298+0000","last_fullsized":"2023-10-18T19:37:18.356298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356654+0000","last_change":"2023-10-18T19:34:21.272980+0000","last_active":"2023-10-18T19:37:17.356654+0000","last_peered":"2023-10-18T19:37:17.356654+0000","last_clean":"2023-10-18T19:37:17.356654+0000","last_became_active":"2023-10-18T19:34:21.272618+0000","last_became_peered":"2023-10-18T19:34:21.272618+0000","last_unstale":"2023-10-18T19:37:17.356654+0000","last_undegraded":"2023-10-18T19:37:17.356654+0000","last_fullsized":"2023-10-18T19:37:17.356654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356121+0000","last_change":"2023-10-18T19:34:20.828547+0000","last_active":"2023-10-18T19:37:18.356121+0000","last_peered":"2023-10-18T19:37:18.356121+0000","last_clean":"2023-10-18T19:37:18.356121+0000","last_became_active":"2023-10-18T19:34:20.828036+0000","last_became_peered":"2023-10-18T19:34:20.828036+0000","last_unstale":"2023-10-18T19:37:18.356121+0000","last_undegraded":"2023-10-18T19:37:18.356121+0000","last_fullsized":"2023-10-18T19:37:18.356121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357169+0000","last_change":"2023-10-18T19:34:21.265823+0000","last_active":"2023-10-18T19:37:18.357169+0000","last_peered":"2023-10-18T19:37:18.357169+0000","last_clean":"2023-10-18T19:37:18.357169+0000","last_became_active":"2023-10-18T19:34:21.265276+0000","last_became_peered":"2023-10-18T19:34:21.265276+0000","last_unstale":"2023-10-18T19:37:18.357169+0000","last_undegraded":"2023-10-18T19:37:18.357169+0000","last_fullsized":"2023-10-18T19:37:18.357169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358834+0000","last_change":"2023-10-18T19:34:20.856792+0000","last_active":"2023-10-18T19:37:18.358834+0000","last_peered":"2023-10-18T19:37:18.358834+0000","last_clean":"2023-10-18T19:37:18.358834+0000","last_became_active":"2023-10-18T19:34:20.856486+0000","last_became_peered":"2023-10-18T19:34:20.856486+0000","last_unstale":"2023-10-18T19:37:18.358834+0000","last_undegraded":"2023-10-18T19:37:18.358834+0000","last_fullsized":"2023-10-18T19:37:18.358834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358717+0000","last_change":"2023-10-18T19:34:21.265884+0000","last_active":"2023-10-18T19:37:18.358717+0000","last_peered":"2023-10-18T19:37:18.358717+0000","last_clean":"2023-10-18T19:37:18.358717+0000","last_became_active":"2023-10-18T19:34:21.265564+0000","last_became_peered":"2023-10-18T19:34:21.265564+0000","last_unstale":"2023-10-18T19:37:18.358717+0000","last_undegraded":"2023-10-18T19:37:18.358717+0000","last_fullsized":"2023-10-18T19:37:18.358717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357258+0000","last_change":"2023-10-18T19:34:20.858811+0000","last_active":"2023-10-18T19:37:18.357258+0000","last_peered":"2023-10-18T19:37:18.357258+0000","last_clean":"2023-10-18T19:37:18.357258+0000","last_became_active":"2023-10-18T19:34:20.858481+0000","last_became_peered":"2023-10-18T19:34:20.858481+0000","last_unstale":"2023-10-18T19:37:18.357258+0000","last_undegraded":"2023-10-18T19:37:18.357258+0000","last_fullsized":"2023-10-18T19:37:18.357258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.355731+0000","last_change":"2023-10-18T19:34:21.246195+0000","last_active":"2023-10-18T19:37:18.355731+0000","last_peered":"2023-10-18T19:37:18.355731+0000","last_clean":"2023-10-18T19:37:18.355731+0000","last_became_active":"2023-10-18T19:34:21.245896+0000","last_became_peered":"2023-10-18T19:34:21.245896+0000","last_unstale":"2023-10-18T19:37:18.355731+0000","last_undegraded":"2023-10-18T19:37:18.355731+0000","last_fullsized":"2023-10-18T19:37:18.355731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354992+0000","last_change":"2023-10-18T19:34:20.855423+0000","last_active":"2023-10-18T19:37:17.354992+0000","last_peered":"2023-10-18T19:37:17.354992+0000","last_clean":"2023-10-18T19:37:17.354992+0000","last_became_active":"2023-10-18T19:34:20.854593+0000","last_became_peered":"2023-10-18T19:34:20.854593+0000","last_unstale":"2023-10-18T19:37:17.354992+0000","last_undegraded":"2023-10-18T19:37:17.354992+0000","last_fullsized":"2023-10-18T19:37:17.354992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357922+0000","last_change":"2023-10-18T19:34:21.256949+0000","last_active":"2023-10-18T19:37:17.357922+0000","last_peered":"2023-10-18T19:37:17.357922+0000","last_clean":"2023-10-18T19:37:17.357922+0000","last_became_active":"2023-10-18T19:34:21.256623+0000","last_became_peered":"2023-10-18T19:34:21.256623+0000","last_unstale":"2023-10-18T19:37:17.357922+0000","last_undegraded":"2023-10-18T19:37:17.357922+0000","last_fullsized":"2023-10-18T19:37:17.357922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357666+0000","last_change":"2023-10-18T19:34:20.846802+0000","last_active":"2023-10-18T19:37:18.357666+0000","last_peered":"2023-10-18T19:37:18.357666+0000","last_clean":"2023-10-18T19:37:18.357666+0000","last_became_active":"2023-10-18T19:34:20.846249+0000","last_became_peered":"2023-10-18T19:34:20.846249+0000","last_unstale":"2023-10-18T19:37:18.357666+0000","last_undegraded":"2023-10-18T19:37:18.357666+0000","last_fullsized":"2023-10-18T19:37:18.357666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357127+0000","last_change":"2023-10-18T19:34:21.258895+0000","last_active":"2023-10-18T19:37:17.357127+0000","last_peered":"2023-10-18T19:37:17.357127+0000","last_clean":"2023-10-18T19:37:17.357127+0000","last_became_active":"2023-10-18T19:34:21.256384+0000","last_became_peered":"2023-10-18T19:34:21.256384+0000","last_unstale":"2023-10-18T19:37:17.357127+0000","last_undegraded":"2023-10-18T19:37:17.357127+0000","last_fullsized":"2023-10-18T19:37:17.357127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356552+0000","last_change":"2023-10-18T19:34:20.850016+0000","last_active":"2023-10-18T19:37:17.356552+0000","last_peered":"2023-10-18T19:37:17.356552+0000","last_clean":"2023-10-18T19:37:17.356552+0000","last_became_active":"2023-10-18T19:34:20.849501+0000","last_became_peered":"2023-10-18T19:34:20.849501+0000","last_unstale":"2023-10-18T19:37:17.356552+0000","last_undegraded":"2023-10-18T19:37:17.356552+0000","last_fullsized":"2023-10-18T19:37:17.356552+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356781+0000","last_change":"2023-10-18T19:34:21.258646+0000","last_active":"2023-10-18T19:37:17.356781+0000","last_peered":"2023-10-18T19:37:17.356781+0000","last_clean":"2023-10-18T19:37:17.356781+0000","last_became_active":"2023-10-18T19:34:21.257999+0000","last_became_peered":"2023-10-18T19:34:21.257999+0000","last_unstale":"2023-10-18T19:37:17.356781+0000","last_undegraded":"2023-10-18T19:37:17.356781+0000","last_fullsized":"2023-10-18T19:37:17.356781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354352+0000","last_change":"2023-10-18T19:34:20.856264+0000","last_active":"2023-10-18T19:37:17.354352+0000","last_peered":"2023-10-18T19:37:17.354352+0000","last_clean":"2023-10-18T19:37:17.354352+0000","last_became_active":"2023-10-18T19:34:20.856072+0000","last_became_peered":"2023-10-18T19:34:20.856072+0000","last_unstale":"2023-10-18T19:37:17.354352+0000","last_undegraded":"2023-10-18T19:37:17.354352+0000","last_fullsized":"2023-10-18T19:37:17.354352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356805+0000","last_change":"2023-10-18T19:34:21.242536+0000","last_active":"2023-10-18T19:37:17.356805+0000","last_peered":"2023-10-18T19:37:17.356805+0000","last_clean":"2023-10-18T19:37:17.356805+0000","last_became_active":"2023-10-18T19:34:21.242187+0000","last_became_peered":"2023-10-18T19:34:21.242187+0000","last_unstale":"2023-10-18T19:37:17.356805+0000","last_undegraded":"2023-10-18T19:37:17.356805+0000","last_fullsized":"2023-10-18T19:37:17.356805+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354055+0000","last_change":"2023-10-18T19:34:20.844847+0000","last_active":"2023-10-18T19:37:17.354055+0000","last_peered":"2023-10-18T19:37:17.354055+0000","last_clean":"2023-10-18T19:37:17.354055+0000","last_became_active":"2023-10-18T19:34:20.844528+0000","last_became_peered":"2023-10-18T19:34:20.844528+0000","last_unstale":"2023-10-18T19:37:17.354055+0000","last_undegraded":"2023-10-18T19:37:17.354055+0000","last_fullsized":"2023-10-18T19:37:17.354055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356560+0000","last_change":"2023-10-18T19:34:21.272824+0000","last_active":"2023-10-18T19:37:17.356560+0000","last_peered":"2023-10-18T19:37:17.356560+0000","last_clean":"2023-10-18T19:37:17.356560+0000","last_became_active":"2023-10-18T19:34:21.272631+0000","last_became_peered":"2023-10-18T19:34:21.272631+0000","last_unstale":"2023-10-18T19:37:17.356560+0000","last_undegraded":"2023-10-18T19:37:17.356560+0000","last_fullsized":"2023-10-18T19:37:17.356560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.355475+0000","last_change":"2023-10-18T19:34:20.833452+0000","last_active":"2023-10-18T19:37:18.355475+0000","last_peered":"2023-10-18T19:37:18.355475+0000","last_clean":"2023-10-18T19:37:18.355475+0000","last_became_active":"2023-10-18T19:34:20.832840+0000","last_became_peered":"2023-10-18T19:34:20.832840+0000","last_unstale":"2023-10-18T19:37:18.355475+0000","last_undegraded":"2023-10-18T19:37:18.355475+0000","last_fullsized":"2023-10-18T19:37:18.355475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.528245+0000","last_change":"2023-10-18T19:37:17.360311+0000","last_active":"2023-10-18T19:37:17.528245+0000","last_peered":"2023-10-18T19:37:17.528245+0000","last_clean":"2023-10-18T19:37:17.528245+0000","last_became_active":"2023-10-18T19:37:17.359914+0000","last_became_peered":"2023-10-18T19:37:17.359914+0000","last_unstale":"2023-10-18T19:37:17.528245+0000","last_undegraded":"2023-10-18T19:37:17.528245+0000","last_fullsized":"2023-10-18T19:37:17.528245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360491+0000","last_change":"2023-10-18T19:34:21.255174+0000","last_active":"2023-10-18T19:37:17.360491+0000","last_peered":"2023-10-18T19:37:17.360491+0000","last_clean":"2023-10-18T19:37:17.360491+0000","last_became_active":"2023-10-18T19:34:21.252377+0000","last_became_peered":"2023-10-18T19:34:21.252377+0000","last_unstale":"2023-10-18T19:37:17.360491+0000","last_undegraded":"2023-10-18T19:37:17.360491+0000","last_fullsized":"2023-10-18T19:37:17.360491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357934+0000","last_change":"2023-10-18T19:34:11.535715+0000","last_active":"2023-10-18T19:37:18.357934+0000","last_peered":"2023-10-18T19:37:18.357934+0000","last_clean":"2023-10-18T19:37:18.357934+0000","last_became_active":"2023-10-18T19:34:11.534518+0000","last_became_peered":"2023-10-18T19:34:11.534518+0000","last_unstale":"2023-10-18T19:37:18.357934+0000","last_undegraded":"2023-10-18T19:37:18.357934+0000","last_fullsized":"2023-10-18T19:37:18.357934+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355627+0000","last_change":"2023-10-18T19:34:20.857782+0000","last_active":"2023-10-18T19:37:17.355627+0000","last_peered":"2023-10-18T19:37:17.355627+0000","last_clean":"2023-10-18T19:37:17.355627+0000","last_became_active":"2023-10-18T19:34:20.853192+0000","last_became_peered":"2023-10-18T19:34:20.853192+0000","last_unstale":"2023-10-18T19:37:17.355627+0000","last_undegraded":"2023-10-18T19:37:17.355627+0000","last_fullsized":"2023-10-18T19:37:17.355627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358462+0000","last_change":"2023-10-18T19:34:21.257423+0000","last_active":"2023-10-18T19:37:18.358462+0000","last_peered":"2023-10-18T19:37:18.358462+0000","last_clean":"2023-10-18T19:37:18.358462+0000","last_became_active":"2023-10-18T19:34:21.256448+0000","last_became_peered":"2023-10-18T19:34:21.256448+0000","last_unstale":"2023-10-18T19:37:18.358462+0000","last_undegraded":"2023-10-18T19:37:18.358462+0000","last_fullsized":"2023-10-18T19:37:18.358462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357306+0000","last_change":"2023-10-18T19:34:11.532756+0000","last_active":"2023-10-18T19:37:17.357306+0000","last_peered":"2023-10-18T19:37:17.357306+0000","last_clean":"2023-10-18T19:37:17.357306+0000","last_became_active":"2023-10-18T19:34:11.532425+0000","last_became_peered":"2023-10-18T19:34:11.532425+0000","last_unstale":"2023-10-18T19:37:17.357306+0000","last_undegraded":"2023-10-18T19:37:17.357306+0000","last_fullsized":"2023-10-18T19:37:17.357306+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360184+0000","last_change":"2023-10-18T19:34:20.852964+0000","last_active":"2023-10-18T19:37:17.360184+0000","last_peered":"2023-10-18T19:37:17.360184+0000","last_clean":"2023-10-18T19:37:17.360184+0000","last_became_active":"2023-10-18T19:34:20.852642+0000","last_became_peered":"2023-10-18T19:34:20.852642+0000","last_unstale":"2023-10-18T19:37:17.360184+0000","last_undegraded":"2023-10-18T19:37:17.360184+0000","last_fullsized":"2023-10-18T19:37:17.360184+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354772+0000","last_change":"2023-10-18T19:34:11.534856+0000","last_active":"2023-10-18T19:37:17.354772+0000","last_peered":"2023-10-18T19:37:17.354772+0000","last_clean":"2023-10-18T19:37:17.354772+0000","last_became_active":"2023-10-18T19:34:11.534541+0000","last_became_peered":"2023-10-18T19:34:11.534541+0000","last_unstale":"2023-10-18T19:37:17.354772+0000","last_undegraded":"2023-10-18T19:37:17.354772+0000","last_fullsized":"2023-10-18T19:37:17.354772+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356193+0000","last_change":"2023-10-18T19:34:20.847678+0000","last_active":"2023-10-18T19:37:17.356193+0000","last_peered":"2023-10-18T19:37:17.356193+0000","last_clean":"2023-10-18T19:37:17.356193+0000","last_became_active":"2023-10-18T19:34:20.847107+0000","last_became_peered":"2023-10-18T19:34:20.847107+0000","last_unstale":"2023-10-18T19:37:17.356193+0000","last_undegraded":"2023-10-18T19:37:17.356193+0000","last_fullsized":"2023-10-18T19:37:17.356193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356055+0000","last_change":"2023-10-18T19:34:21.255564+0000","last_active":"2023-10-18T19:37:18.356055+0000","last_peered":"2023-10-18T19:37:18.356055+0000","last_clean":"2023-10-18T19:37:18.356055+0000","last_became_active":"2023-10-18T19:34:21.255230+0000","last_became_peered":"2023-10-18T19:34:21.255230+0000","last_unstale":"2023-10-18T19:37:18.356055+0000","last_undegraded":"2023-10-18T19:37:18.356055+0000","last_fullsized":"2023-10-18T19:37:18.356055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356134+0000","last_change":"2023-10-18T19:34:11.535128+0000","last_active":"2023-10-18T19:37:18.356134+0000","last_peered":"2023-10-18T19:37:18.356134+0000","last_clean":"2023-10-18T19:37:18.356134+0000","last_became_active":"2023-10-18T19:34:11.534248+0000","last_became_peered":"2023-10-18T19:34:11.534248+0000","last_unstale":"2023-10-18T19:37:18.356134+0000","last_undegraded":"2023-10-18T19:37:18.356134+0000","last_fullsized":"2023-10-18T19:37:18.356134+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356578+0000","last_change":"2023-10-18T19:34:20.855194+0000","last_active":"2023-10-18T19:37:18.356578+0000","last_peered":"2023-10-18T19:37:18.356578+0000","last_clean":"2023-10-18T19:37:18.356578+0000","last_became_active":"2023-10-18T19:34:20.854897+0000","last_became_peered":"2023-10-18T19:34:20.854897+0000","last_unstale":"2023-10-18T19:37:18.356578+0000","last_undegraded":"2023-10-18T19:37:18.356578+0000","last_fullsized":"2023-10-18T19:37:18.356578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354012+0000","last_change":"2023-10-18T19:34:21.270017+0000","last_active":"2023-10-18T19:37:17.354012+0000","last_peered":"2023-10-18T19:37:17.354012+0000","last_clean":"2023-10-18T19:37:17.354012+0000","last_became_active":"2023-10-18T19:34:21.269485+0000","last_became_peered":"2023-10-18T19:34:21.269485+0000","last_unstale":"2023-10-18T19:37:17.354012+0000","last_undegraded":"2023-10-18T19:37:17.354012+0000","last_fullsized":"2023-10-18T19:37:17.354012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354158+0000","last_change":"2023-10-18T19:34:11.532872+0000","last_active":"2023-10-18T19:37:17.354158+0000","last_peered":"2023-10-18T19:37:17.354158+0000","last_clean":"2023-10-18T19:37:17.354158+0000","last_became_active":"2023-10-18T19:34:11.531562+0000","last_became_peered":"2023-10-18T19:34:11.531562+0000","last_unstale":"2023-10-18T19:37:17.354158+0000","last_undegraded":"2023-10-18T19:37:17.354158+0000","last_fullsized":"2023-10-18T19:37:17.354158+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356782+0000","last_change":"2023-10-18T19:34:20.852891+0000","last_active":"2023-10-18T19:37:17.356782+0000","last_peered":"2023-10-18T19:37:17.356782+0000","last_clean":"2023-10-18T19:37:17.356782+0000","last_became_active":"2023-10-18T19:34:20.852426+0000","last_became_peered":"2023-10-18T19:34:20.852426+0000","last_unstale":"2023-10-18T19:37:17.356782+0000","last_undegraded":"2023-10-18T19:37:17.356782+0000","last_fullsized":"2023-10-18T19:37:17.356782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357227+0000","last_change":"2023-10-18T19:34:21.266390+0000","last_active":"2023-10-18T19:37:17.357227+0000","last_peered":"2023-10-18T19:37:17.357227+0000","last_clean":"2023-10-18T19:37:17.357227+0000","last_became_active":"2023-10-18T19:34:21.266089+0000","last_became_peered":"2023-10-18T19:34:21.266089+0000","last_unstale":"2023-10-18T19:37:17.357227+0000","last_undegraded":"2023-10-18T19:37:17.357227+0000","last_fullsized":"2023-10-18T19:37:17.357227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356247+0000","last_change":"2023-10-18T19:34:11.532565+0000","last_active":"2023-10-18T19:37:17.356247+0000","last_peered":"2023-10-18T19:37:17.356247+0000","last_clean":"2023-10-18T19:37:17.356247+0000","last_became_active":"2023-10-18T19:34:11.532168+0000","last_became_peered":"2023-10-18T19:34:11.532168+0000","last_unstale":"2023-10-18T19:37:17.356247+0000","last_undegraded":"2023-10-18T19:37:17.356247+0000","last_fullsized":"2023-10-18T19:37:17.356247+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357588+0000","last_change":"2023-10-18T19:34:20.852330+0000","last_active":"2023-10-18T19:37:17.357588+0000","last_peered":"2023-10-18T19:37:17.357588+0000","last_clean":"2023-10-18T19:37:17.357588+0000","last_became_active":"2023-10-18T19:34:20.851992+0000","last_became_peered":"2023-10-18T19:34:20.851992+0000","last_unstale":"2023-10-18T19:37:17.357588+0000","last_undegraded":"2023-10-18T19:37:17.357588+0000","last_fullsized":"2023-10-18T19:37:17.357588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357726+0000","last_change":"2023-10-18T19:34:21.264314+0000","last_active":"2023-10-18T19:37:18.357726+0000","last_peered":"2023-10-18T19:37:18.357726+0000","last_clean":"2023-10-18T19:37:18.357726+0000","last_became_active":"2023-10-18T19:34:21.263937+0000","last_became_peered":"2023-10-18T19:34:21.263937+0000","last_unstale":"2023-10-18T19:37:18.357726+0000","last_undegraded":"2023-10-18T19:37:18.357726+0000","last_fullsized":"2023-10-18T19:37:18.357726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.359545+0000","last_change":"2023-10-18T19:34:11.533453+0000","last_active":"2023-10-18T19:37:17.359545+0000","last_peered":"2023-10-18T19:37:17.359545+0000","last_clean":"2023-10-18T19:37:17.359545+0000","last_became_active":"2023-10-18T19:34:11.532769+0000","last_became_peered":"2023-10-18T19:34:11.532769+0000","last_unstale":"2023-10-18T19:37:17.359545+0000","last_undegraded":"2023-10-18T19:37:17.359545+0000","last_fullsized":"2023-10-18T19:37:17.359545+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357829+0000","last_change":"2023-10-18T19:34:20.853145+0000","last_active":"2023-10-18T19:37:17.357829+0000","last_peered":"2023-10-18T19:37:17.357829+0000","last_clean":"2023-10-18T19:37:17.357829+0000","last_became_active":"2023-10-18T19:34:20.852683+0000","last_became_peered":"2023-10-18T19:34:20.852683+0000","last_unstale":"2023-10-18T19:37:17.357829+0000","last_undegraded":"2023-10-18T19:37:17.357829+0000","last_fullsized":"2023-10-18T19:37:17.357829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355682+0000","last_change":"2023-10-18T19:34:21.266346+0000","last_active":"2023-10-18T19:37:17.355682+0000","last_peered":"2023-10-18T19:37:17.355682+0000","last_clean":"2023-10-18T19:37:17.355682+0000","last_became_active":"2023-10-18T19:34:21.265950+0000","last_became_peered":"2023-10-18T19:34:21.265950+0000","last_unstale":"2023-10-18T19:37:17.355682+0000","last_undegraded":"2023-10-18T19:37:17.355682+0000","last_fullsized":"2023-10-18T19:37:17.355682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355444+0000","last_change":"2023-10-18T19:34:11.533454+0000","last_active":"2023-10-18T19:37:17.355444+0000","last_peered":"2023-10-18T19:37:17.355444+0000","last_clean":"2023-10-18T19:37:17.355444+0000","last_became_active":"2023-10-18T19:34:11.533123+0000","last_became_peered":"2023-10-18T19:34:11.533123+0000","last_unstale":"2023-10-18T19:37:17.355444+0000","last_undegraded":"2023-10-18T19:37:17.355444+0000","last_fullsized":"2023-10-18T19:37:17.355444+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355524+0000","last_change":"2023-10-18T19:34:20.844955+0000","last_active":"2023-10-18T19:37:17.355524+0000","last_peered":"2023-10-18T19:37:17.355524+0000","last_clean":"2023-10-18T19:37:17.355524+0000","last_became_active":"2023-10-18T19:34:20.844711+0000","last_became_peered":"2023-10-18T19:34:20.844711+0000","last_unstale":"2023-10-18T19:37:17.355524+0000","last_undegraded":"2023-10-18T19:37:17.355524+0000","last_fullsized":"2023-10-18T19:37:17.355524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357754+0000","last_change":"2023-10-18T19:34:21.256370+0000","last_active":"2023-10-18T19:37:18.357754+0000","last_peered":"2023-10-18T19:37:18.357754+0000","last_clean":"2023-10-18T19:37:18.357754+0000","last_became_active":"2023-10-18T19:34:21.256084+0000","last_became_peered":"2023-10-18T19:34:21.256084+0000","last_unstale":"2023-10-18T19:37:18.357754+0000","last_undegraded":"2023-10-18T19:37:18.357754+0000","last_fullsized":"2023-10-18T19:37:18.357754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.358267+0000","last_change":"2023-10-18T19:34:21.253778+0000","last_active":"2023-10-18T19:37:17.358267+0000","last_peered":"2023-10-18T19:37:17.358267+0000","last_clean":"2023-10-18T19:37:17.358267+0000","last_became_active":"2023-10-18T19:34:21.251946+0000","last_became_peered":"2023-10-18T19:34:21.251946+0000","last_unstale":"2023-10-18T19:37:17.358267+0000","last_undegraded":"2023-10-18T19:37:17.358267+0000","last_fullsized":"2023-10-18T19:37:17.358267+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357005+0000","last_change":"2023-10-18T19:34:20.862585+0000","last_active":"2023-10-18T19:37:18.357005+0000","last_peered":"2023-10-18T19:37:18.357005+0000","last_clean":"2023-10-18T19:37:18.357005+0000","last_became_active":"2023-10-18T19:34:20.862326+0000","last_became_peered":"2023-10-18T19:34:20.862326+0000","last_unstale":"2023-10-18T19:37:18.357005+0000","last_undegraded":"2023-10-18T19:37:18.357005+0000","last_fullsized":"2023-10-18T19:37:18.357005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354757+0000","last_change":"2023-10-18T19:34:21.259196+0000","last_active":"2023-10-18T19:37:17.354757+0000","last_peered":"2023-10-18T19:37:17.354757+0000","last_clean":"2023-10-18T19:37:17.354757+0000","last_became_active":"2023-10-18T19:34:21.258884+0000","last_became_peered":"2023-10-18T19:34:21.258884+0000","last_unstale":"2023-10-18T19:37:17.354757+0000","last_undegraded":"2023-10-18T19:37:17.354757+0000","last_fullsized":"2023-10-18T19:37:17.354757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358465+0000","last_change":"2023-10-18T19:34:20.863893+0000","last_active":"2023-10-18T19:37:18.358465+0000","last_peered":"2023-10-18T19:37:18.358465+0000","last_clean":"2023-10-18T19:37:18.358465+0000","last_became_active":"2023-10-18T19:34:20.863549+0000","last_became_peered":"2023-10-18T19:34:20.863549+0000","last_unstale":"2023-10-18T19:37:18.358465+0000","last_undegraded":"2023-10-18T19:37:18.358465+0000","last_fullsized":"2023-10-18T19:37:18.358465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.359071+0000","last_change":"2023-10-18T19:34:21.261264+0000","last_active":"2023-10-18T19:37:18.359071+0000","last_peered":"2023-10-18T19:37:18.359071+0000","last_clean":"2023-10-18T19:37:18.359071+0000","last_became_active":"2023-10-18T19:34:21.260951+0000","last_became_peered":"2023-10-18T19:34:21.260951+0000","last_unstale":"2023-10-18T19:37:18.359071+0000","last_undegraded":"2023-10-18T19:37:18.359071+0000","last_fullsized":"2023-10-18T19:37:18.359071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.359458+0000","last_change":"2023-10-18T19:34:20.853421+0000","last_active":"2023-10-18T19:37:17.359458+0000","last_peered":"2023-10-18T19:37:17.359458+0000","last_clean":"2023-10-18T19:37:17.359458+0000","last_became_active":"2023-10-18T19:34:20.853091+0000","last_became_peered":"2023-10-18T19:34:20.853091+0000","last_unstale":"2023-10-18T19:37:17.359458+0000","last_undegraded":"2023-10-18T19:37:17.359458+0000","last_fullsized":"2023-10-18T19:37:17.359458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.359311+0000","last_change":"2023-10-18T19:34:21.274214+0000","last_active":"2023-10-18T19:37:17.359311+0000","last_peered":"2023-10-18T19:37:17.359311+0000","last_clean":"2023-10-18T19:37:17.359311+0000","last_became_active":"2023-10-18T19:34:21.273899+0000","last_became_peered":"2023-10-18T19:34:21.273899+0000","last_unstale":"2023-10-18T19:37:17.359311+0000","last_undegraded":"2023-10-18T19:37:17.359311+0000","last_fullsized":"2023-10-18T19:37:17.359311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358773+0000","last_change":"2023-10-18T19:34:20.860150+0000","last_active":"2023-10-18T19:37:18.358773+0000","last_peered":"2023-10-18T19:37:18.358773+0000","last_clean":"2023-10-18T19:37:18.358773+0000","last_became_active":"2023-10-18T19:34:20.859836+0000","last_became_peered":"2023-10-18T19:34:20.859836+0000","last_unstale":"2023-10-18T19:37:18.358773+0000","last_undegraded":"2023-10-18T19:37:18.358773+0000","last_fullsized":"2023-10-18T19:37:18.358773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357763+0000","last_change":"2023-10-18T19:34:21.260022+0000","last_active":"2023-10-18T19:37:18.357763+0000","last_peered":"2023-10-18T19:37:18.357763+0000","last_clean":"2023-10-18T19:37:18.357763+0000","last_became_active":"2023-10-18T19:34:21.259630+0000","last_became_peered":"2023-10-18T19:34:21.259630+0000","last_unstale":"2023-10-18T19:37:18.357763+0000","last_undegraded":"2023-10-18T19:37:18.357763+0000","last_fullsized":"2023-10-18T19:37:18.357763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356410+0000","last_change":"2023-10-18T19:34:20.832124+0000","last_active":"2023-10-18T19:37:17.356410+0000","last_peered":"2023-10-18T19:37:17.356410+0000","last_clean":"2023-10-18T19:37:17.356410+0000","last_became_active":"2023-10-18T19:34:20.831830+0000","last_became_peered":"2023-10-18T19:34:20.831830+0000","last_unstale":"2023-10-18T19:37:17.356410+0000","last_undegraded":"2023-10-18T19:37:17.356410+0000","last_fullsized":"2023-10-18T19:37:17.356410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356020+0000","last_change":"2023-10-18T19:34:21.263372+0000","last_active":"2023-10-18T19:37:18.356020+0000","last_peered":"2023-10-18T19:37:18.356020+0000","last_clean":"2023-10-18T19:37:18.356020+0000","last_became_active":"2023-10-18T19:34:21.256876+0000","last_became_peered":"2023-10-18T19:34:21.256876+0000","last_unstale":"2023-10-18T19:37:18.356020+0000","last_undegraded":"2023-10-18T19:37:18.356020+0000","last_fullsized":"2023-10-18T19:37:18.356020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357953+0000","last_change":"2023-10-18T19:34:20.846546+0000","last_active":"2023-10-18T19:37:18.357953+0000","last_peered":"2023-10-18T19:37:18.357953+0000","last_clean":"2023-10-18T19:37:18.357953+0000","last_became_active":"2023-10-18T19:34:20.846229+0000","last_became_peered":"2023-10-18T19:34:20.846229+0000","last_unstale":"2023-10-18T19:37:18.357953+0000","last_undegraded":"2023-10-18T19:37:18.357953+0000","last_fullsized":"2023-10-18T19:37:18.357953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357332+0000","last_change":"2023-10-18T19:34:21.248032+0000","last_active":"2023-10-18T19:37:18.357332+0000","last_peered":"2023-10-18T19:37:18.357332+0000","last_clean":"2023-10-18T19:37:18.357332+0000","last_became_active":"2023-10-18T19:34:21.247196+0000","last_became_peered":"2023-10-18T19:34:21.247196+0000","last_unstale":"2023-10-18T19:37:18.357332+0000","last_undegraded":"2023-10-18T19:37:18.357332+0000","last_fullsized":"2023-10-18T19:37:18.357332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357776+0000","last_change":"2023-10-18T19:34:20.847408+0000","last_active":"2023-10-18T19:37:17.357776+0000","last_peered":"2023-10-18T19:37:17.357776+0000","last_clean":"2023-10-18T19:37:17.357776+0000","last_became_active":"2023-10-18T19:34:20.847100+0000","last_became_peered":"2023-10-18T19:34:20.847100+0000","last_unstale":"2023-10-18T19:37:17.357776+0000","last_undegraded":"2023-10-18T19:37:17.357776+0000","last_fullsized":"2023-10-18T19:37:17.357776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357332+0000","last_change":"2023-10-18T19:34:21.256724+0000","last_active":"2023-10-18T19:37:17.357332+0000","last_peered":"2023-10-18T19:37:17.357332+0000","last_clean":"2023-10-18T19:37:17.357332+0000","last_became_active":"2023-10-18T19:34:21.256252+0000","last_became_peered":"2023-10-18T19:34:21.256252+0000","last_unstale":"2023-10-18T19:37:17.357332+0000","last_undegraded":"2023-10-18T19:37:17.357332+0000","last_fullsized":"2023-10-18T19:37:17.357332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357003+0000","last_change":"2023-10-18T19:34:20.846959+0000","last_active":"2023-10-18T19:37:17.357003+0000","last_peered":"2023-10-18T19:37:17.357003+0000","last_clean":"2023-10-18T19:37:17.357003+0000","last_became_active":"2023-10-18T19:34:20.846541+0000","last_became_peered":"2023-10-18T19:34:20.846541+0000","last_unstale":"2023-10-18T19:37:17.357003+0000","last_undegraded":"2023-10-18T19:37:17.357003+0000","last_fullsized":"2023-10-18T19:37:17.357003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355279+0000","last_change":"2023-10-18T19:34:21.251998+0000","last_active":"2023-10-18T19:37:17.355279+0000","last_peered":"2023-10-18T19:37:17.355279+0000","last_clean":"2023-10-18T19:37:17.355279+0000","last_became_active":"2023-10-18T19:34:21.251641+0000","last_became_peered":"2023-10-18T19:34:21.251641+0000","last_unstale":"2023-10-18T19:37:17.355279+0000","last_undegraded":"2023-10-18T19:37:17.355279+0000","last_fullsized":"2023-10-18T19:37:17.355279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354865+0000","last_change":"2023-10-18T19:34:20.844433+0000","last_active":"2023-10-18T19:37:17.354865+0000","last_peered":"2023-10-18T19:37:17.354865+0000","last_clean":"2023-10-18T19:37:17.354865+0000","last_became_active":"2023-10-18T19:34:20.843767+0000","last_became_peered":"2023-10-18T19:34:20.843767+0000","last_unstale":"2023-10-18T19:37:17.354865+0000","last_undegraded":"2023-10-18T19:37:17.354865+0000","last_fullsized":"2023-10-18T19:37:17.354865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357402+0000","last_change":"2023-10-18T19:34:21.259590+0000","last_active":"2023-10-18T19:37:17.357402+0000","last_peered":"2023-10-18T19:37:17.357402+0000","last_clean":"2023-10-18T19:37:17.357402+0000","last_became_active":"2023-10-18T19:34:21.257762+0000","last_became_peered":"2023-10-18T19:34:21.257762+0000","last_unstale":"2023-10-18T19:37:17.357402+0000","last_undegraded":"2023-10-18T19:37:17.357402+0000","last_fullsized":"2023-10-18T19:37:17.357402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358130+0000","last_change":"2023-10-18T19:34:20.845853+0000","last_active":"2023-10-18T19:37:18.358130+0000","last_peered":"2023-10-18T19:37:18.358130+0000","last_clean":"2023-10-18T19:37:18.358130+0000","last_became_active":"2023-10-18T19:34:20.845487+0000","last_became_peered":"2023-10-18T19:34:20.845487+0000","last_unstale":"2023-10-18T19:37:18.358130+0000","last_undegraded":"2023-10-18T19:37:18.358130+0000","last_fullsized":"2023-10-18T19:37:18.358130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360540+0000","last_change":"2023-10-18T19:34:21.255163+0000","last_active":"2023-10-18T19:37:17.360540+0000","last_peered":"2023-10-18T19:37:17.360540+0000","last_clean":"2023-10-18T19:37:17.360540+0000","last_became_active":"2023-10-18T19:34:21.252262+0000","last_became_peered":"2023-10-18T19:34:21.252262+0000","last_unstale":"2023-10-18T19:37:17.360540+0000","last_undegraded":"2023-10-18T19:37:17.360540+0000","last_fullsized":"2023-10-18T19:37:17.360540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.359370+0000","last_change":"2023-10-18T19:34:20.861998+0000","last_active":"2023-10-18T19:37:18.359370+0000","last_peered":"2023-10-18T19:37:18.359370+0000","last_clean":"2023-10-18T19:37:18.359370+0000","last_became_active":"2023-10-18T19:34:20.860333+0000","last_became_peered":"2023-10-18T19:34:20.860333+0000","last_unstale":"2023-10-18T19:37:18.359370+0000","last_undegraded":"2023-10-18T19:37:18.359370+0000","last_fullsized":"2023-10-18T19:37:18.359370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358100+0000","last_change":"2023-10-18T19:34:21.258083+0000","last_active":"2023-10-18T19:37:18.358100+0000","last_peered":"2023-10-18T19:37:18.358100+0000","last_clean":"2023-10-18T19:37:18.358100+0000","last_became_active":"2023-10-18T19:34:21.257626+0000","last_became_peered":"2023-10-18T19:34:21.257626+0000","last_unstale":"2023-10-18T19:37:18.358100+0000","last_undegraded":"2023-10-18T19:37:18.358100+0000","last_fullsized":"2023-10-18T19:37:18.358100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360376+0000","last_change":"2023-10-18T19:34:20.855980+0000","last_active":"2023-10-18T19:37:17.360376+0000","last_peered":"2023-10-18T19:37:17.360376+0000","last_clean":"2023-10-18T19:37:17.360376+0000","last_became_active":"2023-10-18T19:34:20.855446+0000","last_became_peered":"2023-10-18T19:34:20.855446+0000","last_unstale":"2023-10-18T19:37:17.360376+0000","last_undegraded":"2023-10-18T19:37:17.360376+0000","last_fullsized":"2023-10-18T19:37:17.360376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356362+0000","last_change":"2023-10-18T19:34:21.267157+0000","last_active":"2023-10-18T19:37:17.356362+0000","last_peered":"2023-10-18T19:37:17.356362+0000","last_clean":"2023-10-18T19:37:17.356362+0000","last_became_active":"2023-10-18T19:34:21.266854+0000","last_became_peered":"2023-10-18T19:34:21.266854+0000","last_unstale":"2023-10-18T19:37:17.356362+0000","last_undegraded":"2023-10-18T19:37:17.356362+0000","last_fullsized":"2023-10-18T19:37:17.356362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356701+0000","last_change":"2023-10-18T19:34:20.847879+0000","last_active":"2023-10-18T19:37:17.356701+0000","last_peered":"2023-10-18T19:37:17.356701+0000","last_clean":"2023-10-18T19:37:17.356701+0000","last_became_active":"2023-10-18T19:34:20.847368+0000","last_became_peered":"2023-10-18T19:34:20.847368+0000","last_unstale":"2023-10-18T19:37:17.356701+0000","last_undegraded":"2023-10-18T19:37:17.356701+0000","last_fullsized":"2023-10-18T19:37:17.356701+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355720+0000","last_change":"2023-10-18T19:34:21.271229+0000","last_active":"2023-10-18T19:37:17.355720+0000","last_peered":"2023-10-18T19:37:17.355720+0000","last_clean":"2023-10-18T19:37:17.355720+0000","last_became_active":"2023-10-18T19:34:21.270946+0000","last_became_peered":"2023-10-18T19:34:21.270946+0000","last_unstale":"2023-10-18T19:37:17.355720+0000","last_undegraded":"2023-10-18T19:37:17.355720+0000","last_fullsized":"2023-10-18T19:37:17.355720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354156+0000","last_change":"2023-10-18T19:34:20.857540+0000","last_active":"2023-10-18T19:37:17.354156+0000","last_peered":"2023-10-18T19:37:17.354156+0000","last_clean":"2023-10-18T19:37:17.354156+0000","last_became_active":"2023-10-18T19:34:20.857056+0000","last_became_peered":"2023-10-18T19:34:20.857056+0000","last_unstale":"2023-10-18T19:37:17.354156+0000","last_undegraded":"2023-10-18T19:37:17.354156+0000","last_fullsized":"2023-10-18T19:37:17.354156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356212+0000","last_change":"2023-10-18T19:34:21.264597+0000","last_active":"2023-10-18T19:37:18.356212+0000","last_peered":"2023-10-18T19:37:18.356212+0000","last_clean":"2023-10-18T19:37:18.356212+0000","last_became_active":"2023-10-18T19:34:21.264304+0000","last_became_peered":"2023-10-18T19:34:21.264304+0000","last_unstale":"2023-10-18T19:37:18.356212+0000","last_undegraded":"2023-10-18T19:37:18.356212+0000","last_fullsized":"2023-10-18T19:37:18.356212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354323+0000","last_change":"2023-10-18T19:34:20.830160+0000","last_active":"2023-10-18T19:37:17.354323+0000","last_peered":"2023-10-18T19:37:17.354323+0000","last_clean":"2023-10-18T19:37:17.354323+0000","last_became_active":"2023-10-18T19:34:20.829821+0000","last_became_peered":"2023-10-18T19:34:20.829821+0000","last_unstale":"2023-10-18T19:37:17.354323+0000","last_undegraded":"2023-10-18T19:37:17.354323+0000","last_fullsized":"2023-10-18T19:37:17.354323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354433+0000","last_change":"2023-10-18T19:34:21.250388+0000","last_active":"2023-10-18T19:37:17.354433+0000","last_peered":"2023-10-18T19:37:17.354433+0000","last_clean":"2023-10-18T19:37:17.354433+0000","last_became_active":"2023-10-18T19:34:21.250098+0000","last_became_peered":"2023-10-18T19:34:21.250098+0000","last_unstale":"2023-10-18T19:37:17.354433+0000","last_undegraded":"2023-10-18T19:37:17.354433+0000","last_fullsized":"2023-10-18T19:37:17.354433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357455+0000","last_change":"2023-10-18T19:34:20.857726+0000","last_active":"2023-10-18T19:37:18.357455+0000","last_peered":"2023-10-18T19:37:18.357455+0000","last_clean":"2023-10-18T19:37:18.357455+0000","last_became_active":"2023-10-18T19:34:20.856983+0000","last_became_peered":"2023-10-18T19:34:20.856983+0000","last_unstale":"2023-10-18T19:37:18.357455+0000","last_undegraded":"2023-10-18T19:37:18.357455+0000","last_fullsized":"2023-10-18T19:37:18.357455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.358182+0000","last_change":"2023-10-18T19:34:21.270485+0000","last_active":"2023-10-18T19:37:17.358182+0000","last_peered":"2023-10-18T19:37:17.358182+0000","last_clean":"2023-10-18T19:37:17.358182+0000","last_became_active":"2023-10-18T19:34:21.270140+0000","last_became_peered":"2023-10-18T19:34:21.270140+0000","last_unstale":"2023-10-18T19:37:17.358182+0000","last_undegraded":"2023-10-18T19:37:17.358182+0000","last_fullsized":"2023-10-18T19:37:17.358182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356840+0000","last_change":"2023-10-18T19:34:20.847009+0000","last_active":"2023-10-18T19:37:18.356840+0000","last_peered":"2023-10-18T19:37:18.356840+0000","last_clean":"2023-10-18T19:37:18.356840+0000","last_became_active":"2023-10-18T19:34:20.846481+0000","last_became_peered":"2023-10-18T19:34:20.846481+0000","last_unstale":"2023-10-18T19:37:18.356840+0000","last_undegraded":"2023-10-18T19:37:18.356840+0000","last_fullsized":"2023-10-18T19:37:18.356840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356055+0000","last_change":"2023-10-18T19:34:21.256060+0000","last_active":"2023-10-18T19:37:18.356055+0000","last_peered":"2023-10-18T19:37:18.356055+0000","last_clean":"2023-10-18T19:37:18.356055+0000","last_became_active":"2023-10-18T19:34:21.255703+0000","last_became_peered":"2023-10-18T19:34:21.255703+0000","last_unstale":"2023-10-18T19:37:18.356055+0000","last_undegraded":"2023-10-18T19:37:18.356055+0000","last_fullsized":"2023-10-18T19:37:18.356055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.358247+0000","last_change":"2023-10-18T19:34:20.849799+0000","last_active":"2023-10-18T19:37:17.358247+0000","last_peered":"2023-10-18T19:37:17.358247+0000","last_clean":"2023-10-18T19:37:17.358247+0000","last_became_active":"2023-10-18T19:34:20.849488+0000","last_became_peered":"2023-10-18T19:34:20.849488+0000","last_unstale":"2023-10-18T19:37:17.358247+0000","last_undegraded":"2023-10-18T19:37:17.358247+0000","last_fullsized":"2023-10-18T19:37:17.358247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360103+0000","last_change":"2023-10-18T19:34:21.260006+0000","last_active":"2023-10-18T19:37:17.360103+0000","last_peered":"2023-10-18T19:37:17.360103+0000","last_clean":"2023-10-18T19:37:17.360103+0000","last_became_active":"2023-10-18T19:34:21.259689+0000","last_became_peered":"2023-10-18T19:34:21.259689+0000","last_unstale":"2023-10-18T19:37:17.360103+0000","last_undegraded":"2023-10-18T19:37:17.360103+0000","last_fullsized":"2023-10-18T19:37:17.360103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355488+0000","last_change":"2023-10-18T19:34:20.858108+0000","last_active":"2023-10-18T19:37:17.355488+0000","last_peered":"2023-10-18T19:37:17.355488+0000","last_clean":"2023-10-18T19:37:17.355488+0000","last_became_active":"2023-10-18T19:34:20.854784+0000","last_became_peered":"2023-10-18T19:34:20.854784+0000","last_unstale":"2023-10-18T19:37:17.355488+0000","last_undegraded":"2023-10-18T19:37:17.355488+0000","last_fullsized":"2023-10-18T19:37:17.355488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357382+0000","last_change":"2023-10-18T19:34:21.257919+0000","last_active":"2023-10-18T19:37:18.357382+0000","last_peered":"2023-10-18T19:37:18.357382+0000","last_clean":"2023-10-18T19:37:18.357382+0000","last_became_active":"2023-10-18T19:34:21.257409+0000","last_became_peered":"2023-10-18T19:34:21.257409+0000","last_unstale":"2023-10-18T19:37:18.357382+0000","last_undegraded":"2023-10-18T19:37:18.357382+0000","last_fullsized":"2023-10-18T19:37:18.357382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.360396+0000","last_change":"2023-10-18T19:34:20.847577+0000","last_active":"2023-10-18T19:37:17.360396+0000","last_peered":"2023-10-18T19:37:17.360396+0000","last_clean":"2023-10-18T19:37:17.360396+0000","last_became_active":"2023-10-18T19:34:20.842013+0000","last_became_peered":"2023-10-18T19:34:20.842013+0000","last_unstale":"2023-10-18T19:37:17.360396+0000","last_undegraded":"2023-10-18T19:37:17.360396+0000","last_fullsized":"2023-10-18T19:37:17.360396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.353946+0000","last_change":"2023-10-18T19:34:21.251747+0000","last_active":"2023-10-18T19:37:17.353946+0000","last_peered":"2023-10-18T19:37:17.353946+0000","last_clean":"2023-10-18T19:37:17.353946+0000","last_became_active":"2023-10-18T19:34:21.251325+0000","last_became_peered":"2023-10-18T19:34:21.251325+0000","last_unstale":"2023-10-18T19:37:17.353946+0000","last_undegraded":"2023-10-18T19:37:17.353946+0000","last_fullsized":"2023-10-18T19:37:17.353946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.355827+0000","last_change":"2023-10-18T19:34:20.832572+0000","last_active":"2023-10-18T19:37:18.355827+0000","last_peered":"2023-10-18T19:37:18.355827+0000","last_clean":"2023-10-18T19:37:18.355827+0000","last_became_active":"2023-10-18T19:34:20.832216+0000","last_became_peered":"2023-10-18T19:34:20.832216+0000","last_unstale":"2023-10-18T19:37:18.355827+0000","last_undegraded":"2023-10-18T19:37:18.355827+0000","last_fullsized":"2023-10-18T19:37:18.355827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356309+0000","last_change":"2023-10-18T19:34:21.272247+0000","last_active":"2023-10-18T19:37:17.356309+0000","last_peered":"2023-10-18T19:37:17.356309+0000","last_clean":"2023-10-18T19:37:17.356309+0000","last_became_active":"2023-10-18T19:34:21.271930+0000","last_became_peered":"2023-10-18T19:34:21.271930+0000","last_unstale":"2023-10-18T19:37:17.356309+0000","last_undegraded":"2023-10-18T19:37:17.356309+0000","last_fullsized":"2023-10-18T19:37:17.356309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356746+0000","last_change":"2023-10-18T19:34:20.840841+0000","last_active":"2023-10-18T19:37:18.356746+0000","last_peered":"2023-10-18T19:37:18.356746+0000","last_clean":"2023-10-18T19:37:18.356746+0000","last_became_active":"2023-10-18T19:34:20.840351+0000","last_became_peered":"2023-10-18T19:34:20.840351+0000","last_unstale":"2023-10-18T19:37:18.356746+0000","last_undegraded":"2023-10-18T19:37:18.356746+0000","last_fullsized":"2023-10-18T19:37:18.356746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356393+0000","last_change":"2023-10-18T19:34:21.258445+0000","last_active":"2023-10-18T19:37:17.356393+0000","last_peered":"2023-10-18T19:37:17.356393+0000","last_clean":"2023-10-18T19:37:17.356393+0000","last_became_active":"2023-10-18T19:34:21.257747+0000","last_became_peered":"2023-10-18T19:34:21.257747+0000","last_unstale":"2023-10-18T19:37:17.356393+0000","last_undegraded":"2023-10-18T19:37:17.356393+0000","last_fullsized":"2023-10-18T19:37:17.356393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358206+0000","last_change":"2023-10-18T19:34:20.856638+0000","last_active":"2023-10-18T19:37:18.358206+0000","last_peered":"2023-10-18T19:37:18.358206+0000","last_clean":"2023-10-18T19:37:18.358206+0000","last_became_active":"2023-10-18T19:34:20.856094+0000","last_became_peered":"2023-10-18T19:34:20.856094+0000","last_unstale":"2023-10-18T19:37:18.358206+0000","last_undegraded":"2023-10-18T19:37:18.358206+0000","last_fullsized":"2023-10-18T19:37:18.358206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356629+0000","last_change":"2023-10-18T19:34:21.249180+0000","last_active":"2023-10-18T19:37:18.356629+0000","last_peered":"2023-10-18T19:37:18.356629+0000","last_clean":"2023-10-18T19:37:18.356629+0000","last_became_active":"2023-10-18T19:34:21.245370+0000","last_became_peered":"2023-10-18T19:34:21.245370+0000","last_unstale":"2023-10-18T19:37:18.356629+0000","last_undegraded":"2023-10-18T19:37:18.356629+0000","last_fullsized":"2023-10-18T19:37:18.356629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354943+0000","last_change":"2023-10-18T19:34:20.823278+0000","last_active":"2023-10-18T19:37:17.354943+0000","last_peered":"2023-10-18T19:37:17.354943+0000","last_clean":"2023-10-18T19:37:17.354943+0000","last_became_active":"2023-10-18T19:34:20.823003+0000","last_became_peered":"2023-10-18T19:34:20.823003+0000","last_unstale":"2023-10-18T19:37:17.354943+0000","last_undegraded":"2023-10-18T19:37:17.354943+0000","last_fullsized":"2023-10-18T19:37:17.354943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358562+0000","last_change":"2023-10-18T19:34:21.246335+0000","last_active":"2023-10-18T19:37:18.358562+0000","last_peered":"2023-10-18T19:37:18.358562+0000","last_clean":"2023-10-18T19:37:18.358562+0000","last_became_active":"2023-10-18T19:34:21.246040+0000","last_became_peered":"2023-10-18T19:34:21.246040+0000","last_unstale":"2023-10-18T19:37:18.358562+0000","last_undegraded":"2023-10-18T19:37:18.358562+0000","last_fullsized":"2023-10-18T19:37:18.358562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.357097+0000","last_change":"2023-10-18T19:34:20.855032+0000","last_active":"2023-10-18T19:37:17.357097+0000","last_peered":"2023-10-18T19:37:17.357097+0000","last_clean":"2023-10-18T19:37:17.357097+0000","last_became_active":"2023-10-18T19:34:20.854673+0000","last_became_peered":"2023-10-18T19:34:20.854673+0000","last_unstale":"2023-10-18T19:37:17.357097+0000","last_undegraded":"2023-10-18T19:37:17.357097+0000","last_fullsized":"2023-10-18T19:37:17.357097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358249+0000","last_change":"2023-10-18T19:34:21.254232+0000","last_active":"2023-10-18T19:37:18.358249+0000","last_peered":"2023-10-18T19:37:18.358249+0000","last_clean":"2023-10-18T19:37:18.358249+0000","last_became_active":"2023-10-18T19:34:21.253932+0000","last_became_peered":"2023-10-18T19:34:21.253932+0000","last_unstale":"2023-10-18T19:37:18.358249+0000","last_undegraded":"2023-10-18T19:37:18.358249+0000","last_fullsized":"2023-10-18T19:37:18.358249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355187+0000","last_change":"2023-10-18T19:34:20.855559+0000","last_active":"2023-10-18T19:37:17.355187+0000","last_peered":"2023-10-18T19:37:17.355187+0000","last_clean":"2023-10-18T19:37:17.355187+0000","last_became_active":"2023-10-18T19:34:20.854845+0000","last_became_peered":"2023-10-18T19:34:20.854845+0000","last_unstale":"2023-10-18T19:37:17.355187+0000","last_undegraded":"2023-10-18T19:37:17.355187+0000","last_fullsized":"2023-10-18T19:37:17.355187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355531+0000","last_change":"2023-10-18T19:34:21.248190+0000","last_active":"2023-10-18T19:37:17.355531+0000","last_peered":"2023-10-18T19:37:17.355531+0000","last_clean":"2023-10-18T19:37:17.355531+0000","last_became_active":"2023-10-18T19:34:21.247102+0000","last_became_peered":"2023-10-18T19:34:21.247102+0000","last_unstale":"2023-10-18T19:37:17.355531+0000","last_undegraded":"2023-10-18T19:37:17.355531+0000","last_fullsized":"2023-10-18T19:37:17.355531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355357+0000","last_change":"2023-10-18T19:34:20.857956+0000","last_active":"2023-10-18T19:37:17.355357+0000","last_peered":"2023-10-18T19:37:17.355357+0000","last_clean":"2023-10-18T19:37:17.355357+0000","last_became_active":"2023-10-18T19:34:20.855051+0000","last_became_peered":"2023-10-18T19:34:20.855051+0000","last_unstale":"2023-10-18T19:37:17.355357+0000","last_undegraded":"2023-10-18T19:37:17.355357+0000","last_fullsized":"2023-10-18T19:37:17.355357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.359326+0000","last_change":"2023-10-18T19:34:21.266700+0000","last_active":"2023-10-18T19:37:18.359326+0000","last_peered":"2023-10-18T19:37:18.359326+0000","last_clean":"2023-10-18T19:37:18.359326+0000","last_became_active":"2023-10-18T19:34:21.266409+0000","last_became_peered":"2023-10-18T19:34:21.266409+0000","last_unstale":"2023-10-18T19:37:18.359326+0000","last_undegraded":"2023-10-18T19:37:18.359326+0000","last_fullsized":"2023-10-18T19:37:18.359326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358891+0000","last_change":"2023-10-18T19:34:20.851465+0000","last_active":"2023-10-18T19:37:18.358891+0000","last_peered":"2023-10-18T19:37:18.358891+0000","last_clean":"2023-10-18T19:37:18.358891+0000","last_became_active":"2023-10-18T19:34:20.851166+0000","last_became_peered":"2023-10-18T19:34:20.851166+0000","last_unstale":"2023-10-18T19:37:18.358891+0000","last_undegraded":"2023-10-18T19:37:18.358891+0000","last_fullsized":"2023-10-18T19:37:18.358891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356289+0000","last_change":"2023-10-18T19:34:21.245529+0000","last_active":"2023-10-18T19:37:18.356289+0000","last_peered":"2023-10-18T19:37:18.356289+0000","last_clean":"2023-10-18T19:37:18.356289+0000","last_became_active":"2023-10-18T19:34:21.245217+0000","last_became_peered":"2023-10-18T19:34:21.245217+0000","last_unstale":"2023-10-18T19:37:18.356289+0000","last_undegraded":"2023-10-18T19:37:18.356289+0000","last_fullsized":"2023-10-18T19:37:18.356289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.355621+0000","last_change":"2023-10-18T19:34:20.837517+0000","last_active":"2023-10-18T19:37:18.355621+0000","last_peered":"2023-10-18T19:37:18.355621+0000","last_clean":"2023-10-18T19:37:18.355621+0000","last_became_active":"2023-10-18T19:34:20.837192+0000","last_became_peered":"2023-10-18T19:34:20.837192+0000","last_unstale":"2023-10-18T19:37:18.355621+0000","last_undegraded":"2023-10-18T19:37:18.355621+0000","last_fullsized":"2023-10-18T19:37:18.355621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.356599+0000","last_change":"2023-10-18T19:34:21.262649+0000","last_active":"2023-10-18T19:37:17.356599+0000","last_peered":"2023-10-18T19:37:17.356599+0000","last_clean":"2023-10-18T19:37:17.356599+0000","last_became_active":"2023-10-18T19:34:21.262175+0000","last_became_peered":"2023-10-18T19:34:21.262175+0000","last_unstale":"2023-10-18T19:37:17.356599+0000","last_undegraded":"2023-10-18T19:37:17.356599+0000","last_fullsized":"2023-10-18T19:37:17.356599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.354126+0000","last_change":"2023-10-18T19:34:20.821558+0000","last_active":"2023-10-18T19:37:17.354126+0000","last_peered":"2023-10-18T19:37:17.354126+0000","last_clean":"2023-10-18T19:37:17.354126+0000","last_became_active":"2023-10-18T19:34:20.821225+0000","last_became_peered":"2023-10-18T19:34:20.821225+0000","last_unstale":"2023-10-18T19:37:17.354126+0000","last_undegraded":"2023-10-18T19:37:17.354126+0000","last_fullsized":"2023-10-18T19:37:17.354126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356057+0000","last_change":"2023-10-18T19:34:21.268630+0000","last_active":"2023-10-18T19:37:18.356057+0000","last_peered":"2023-10-18T19:37:18.356057+0000","last_clean":"2023-10-18T19:37:18.356057+0000","last_became_active":"2023-10-18T19:34:21.268347+0000","last_became_peered":"2023-10-18T19:34:21.268347+0000","last_unstale":"2023-10-18T19:37:18.356057+0000","last_undegraded":"2023-10-18T19:37:18.356057+0000","last_fullsized":"2023-10-18T19:37:18.356057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358311+0000","last_change":"2023-10-18T19:34:20.856427+0000","last_active":"2023-10-18T19:37:18.358311+0000","last_peered":"2023-10-18T19:37:18.358311+0000","last_clean":"2023-10-18T19:37:18.358311+0000","last_became_active":"2023-10-18T19:34:20.855877+0000","last_became_peered":"2023-10-18T19:34:20.855877+0000","last_unstale":"2023-10-18T19:37:18.358311+0000","last_undegraded":"2023-10-18T19:37:18.358311+0000","last_fullsized":"2023-10-18T19:37:18.358311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358410+0000","last_change":"2023-10-18T19:34:21.259142+0000","last_active":"2023-10-18T19:37:18.358410+0000","last_peered":"2023-10-18T19:37:18.358410+0000","last_clean":"2023-10-18T19:37:18.358410+0000","last_became_active":"2023-10-18T19:34:21.258709+0000","last_became_peered":"2023-10-18T19:34:21.258709+0000","last_unstale":"2023-10-18T19:37:18.358410+0000","last_undegraded":"2023-10-18T19:37:18.358410+0000","last_fullsized":"2023-10-18T19:37:18.358410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.356492+0000","last_change":"2023-10-18T19:34:20.861616+0000","last_active":"2023-10-18T19:37:18.356492+0000","last_peered":"2023-10-18T19:37:18.356492+0000","last_clean":"2023-10-18T19:37:18.356492+0000","last_became_active":"2023-10-18T19:34:20.861363+0000","last_became_peered":"2023-10-18T19:34:20.861363+0000","last_unstale":"2023-10-18T19:37:18.356492+0000","last_undegraded":"2023-10-18T19:37:18.356492+0000","last_fullsized":"2023-10-18T19:37:18.356492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357791+0000","last_change":"2023-10-18T19:34:21.267981+0000","last_active":"2023-10-18T19:37:18.357791+0000","last_peered":"2023-10-18T19:37:18.357791+0000","last_clean":"2023-10-18T19:37:18.357791+0000","last_became_active":"2023-10-18T19:34:21.267584+0000","last_became_peered":"2023-10-18T19:34:21.267584+0000","last_unstale":"2023-10-18T19:37:18.357791+0000","last_undegraded":"2023-10-18T19:37:18.357791+0000","last_fullsized":"2023-10-18T19:37:18.357791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357585+0000","last_change":"2023-10-18T19:34:20.855045+0000","last_active":"2023-10-18T19:37:18.357585+0000","last_peered":"2023-10-18T19:37:18.357585+0000","last_clean":"2023-10-18T19:37:18.357585+0000","last_became_active":"2023-10-18T19:34:20.854724+0000","last_became_peered":"2023-10-18T19:34:20.854724+0000","last_unstale":"2023-10-18T19:37:18.357585+0000","last_undegraded":"2023-10-18T19:37:18.357585+0000","last_fullsized":"2023-10-18T19:37:18.357585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.357137+0000","last_change":"2023-10-18T19:34:21.262741+0000","last_active":"2023-10-18T19:37:18.357137+0000","last_peered":"2023-10-18T19:37:18.357137+0000","last_clean":"2023-10-18T19:37:18.357137+0000","last_became_active":"2023-10-18T19:34:21.262435+0000","last_became_peered":"2023-10-18T19:34:21.262435+0000","last_unstale":"2023-10-18T19:37:18.357137+0000","last_undegraded":"2023-10-18T19:37:18.357137+0000","last_fullsized":"2023-10-18T19:37:18.357137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355014+0000","last_change":"2023-10-18T19:34:20.850195+0000","last_active":"2023-10-18T19:37:17.355014+0000","last_peered":"2023-10-18T19:37:17.355014+0000","last_clean":"2023-10-18T19:37:17.355014+0000","last_became_active":"2023-10-18T19:34:20.849885+0000","last_became_peered":"2023-10-18T19:34:20.849885+0000","last_unstale":"2023-10-18T19:37:17.355014+0000","last_undegraded":"2023-10-18T19:37:17.355014+0000","last_fullsized":"2023-10-18T19:37:17.355014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.358624+0000","last_change":"2023-10-18T19:34:21.248730+0000","last_active":"2023-10-18T19:37:18.358624+0000","last_peered":"2023-10-18T19:37:18.358624+0000","last_clean":"2023-10-18T19:37:18.358624+0000","last_became_active":"2023-10-18T19:34:21.248420+0000","last_became_peered":"2023-10-18T19:34:21.248420+0000","last_unstale":"2023-10-18T19:37:18.358624+0000","last_undegraded":"2023-10-18T19:37:18.358624+0000","last_fullsized":"2023-10-18T19:37:18.358624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:18.359403+0000","last_change":"2023-10-18T19:34:20.862008+0000","last_active":"2023-10-18T19:37:18.359403+0000","last_peered":"2023-10-18T19:37:18.359403+0000","last_clean":"2023-10-18T19:37:18.359403+0000","last_became_active":"2023-10-18T19:34:20.858973+0000","last_became_peered":"2023-10-18T19:34:20.858973+0000","last_unstale":"2023-10-18T19:37:18.359403+0000","last_undegraded":"2023-10-18T19:37:18.359403+0000","last_fullsized":"2023-10-18T19:37:18.359403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355369+0000","last_change":"2023-10-18T19:34:21.259920+0000","last_active":"2023-10-18T19:37:17.355369+0000","last_peered":"2023-10-18T19:37:17.355369+0000","last_clean":"2023-10-18T19:37:17.355369+0000","last_became_active":"2023-10-18T19:34:21.259474+0000","last_became_peered":"2023-10-18T19:34:21.259474+0000","last_unstale":"2023-10-18T19:37:17.355369+0000","last_undegraded":"2023-10-18T19:37:17.355369+0000","last_fullsized":"2023-10-18T19:37:17.355369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-18T19:37:17.355475+0000","last_change":"2023-10-18T19:34:20.842664+0000","last_active":"2023-10-18T19:37:17.355475+0000","last_peered":"2023-10-18T19:37:17.355475+0000","last_clean":"2023-10-18T19:37:17.355475+0000","last_became_active":"2023-10-18T19:34:20.842341+0000","last_became_peered":"2023-10-18T19:34:20.842341+0000","last_unstale":"2023-10-18T19:37:17.355475+0000","last_undegraded":"2023-10-18T19:37:17.355475+0000","last_fullsized":"2023-10-18T19:37:17.355475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705705,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048796,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323044,"statfs":{"total":96636764160,"available":95562797056,"internally_reserved":1073741824,"allocated":217088,"data_stored":67449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.35999999999999999,"15min":0.376},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.48099999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36699999999999999,"15min":0.379},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.32800000000000001}]},{"osd":1,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.39600000000000002,"15min":0.41199999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.54500000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39700000000000002,"15min":0.41799999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.53300000000000003,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.44}]},{"osd":2,"last update":"Wed Oct 18 19:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42699999999999999,"15min":0.44900000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56000000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.40899999999999997,"15min":0.439},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.357,"15min":1.357},"last":0.33900000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705705,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":60681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.251,"5min":0.221,"15min":0.221},"max":{"1min":0.47999999999999998,"5min":0.505,"15min":0.505},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.39400000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34999999999999998}]},{"osd":1,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34899999999999998,"15min":0.35299999999999998},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.502,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.31},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.377},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.45300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.40600000000000003}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.372,"15min":0.375},"min":{"1min":0.309,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.43099999999999999,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.48199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.47899999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":66789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34200000000000003,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.316},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33900000000000002}]},{"osd":2,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.40000000000000002,"15min":0.41399999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.58599999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Oct 18 19:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.39800000000000002,"15min":0.40899999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38800000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38800000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705705,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":61245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.54400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.27900000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.34999999999999998},"min":{"1min":0.255,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53300000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed Oct 18 19:37:12 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53000000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.41599999999999998},"min":{"1min":0.314,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56699999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:24.594 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T19:37:24.595 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T19:37:24.595 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T19:37:24.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:37:24.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.813+0000 7f8eee5ff700 1 Processor -- start 2023-10-18T19:37:24.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.813+0000 7f8eee5ff700 1 -- start start 2023-10-18T19:37:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ee80a13d0 0x7f8ee80a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee8135cb0 0x7f8ee8136130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80a0fc0 con 0x7f8ee80a13d0 2023-10-18T19:37:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80af5c0 con 0x7f8ee8135cb0 2023-10-18T19:37:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eee5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8136620 con 0x7f8ee80af1e0 2023-10-18T19:37:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56386/0 (socket says 172.21.15.88:56386) 2023-10-18T19:37:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8ee7fff700 1 -- 172.21.15.88:0/2901696912 learned_addr learned my addr 172.21.15.88:0/2901696912 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:24.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8eecb9c700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee8135cb0 0x7f8ee8136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.814+0000 7f8ee77fe700 1 --2- 172.21.15.88:0/2901696912 >> v2:172.21.15.88:3300/0 conn(0x7f8ee80a13d0 0x7f8ee80a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 -- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee8135cb0 msgr2=0x7f8ee8136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:24.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee8135cb0 0x7f8ee8136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 -- 172.21.15.88:0/2901696912 >> v2:172.21.15.88:3300/0 conn(0x7f8ee80a13d0 msgr2=0x7f8ee80a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:24.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/2901696912 >> v2:172.21.15.88:3300/0 conn(0x7f8ee80a13d0 0x7f8ee80a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 -- 172.21.15.88:0/2901696912 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80a4980 con 0x7f8ee80af1e0 2023-10-18T19:37:24.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ed8009830 tx=0x7f8ed80090f0).ready entity=mon.2 client_cookie=1857bc43eeb55de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:24.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee6ffd700 1 -- 172.21.15.88:0/2901696912 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800b530 con 0x7f8ee80af1e0 2023-10-18T19:37:24.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee6ffd700 1 -- 172.21.15.88:0/2901696912 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800b690 con 0x7f8ee80af1e0 2023-10-18T19:37:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.815+0000 7f8ee6ffd700 1 -- 172.21.15.88:0/2901696912 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800ba10 con 0x7f8ee80af1e0 2023-10-18T19:37:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 -- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 msgr2=0x7f8ee80ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ed8009830 tx=0x7f8ed80090f0).stop 2023-10-18T19:37:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 -- 172.21.15.88:0/2901696912 shutdown_connections 2023-10-18T19:37:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee80af1e0 0x7f8ee80ac830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/2901696912 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee8135cb0 0x7f8ee8136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/2901696912 >> v2:172.21.15.88:3300/0 conn(0x7f8ee80a13d0 0x7f8ee80a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 -- 172.21.15.88:0/2901696912 >> 172.21.15.88:0/2901696912 conn(0x7f8ee8064d50 msgr2=0x7f8ee8062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 -- 172.21.15.88:0/2901696912 shutdown_connections 2023-10-18T19:37:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.816+0000 7f8eee5ff700 1 -- 172.21.15.88:0/2901696912 wait complete. 2023-10-18T19:37:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.817+0000 7f8eee5ff700 1 Processor -- start 2023-10-18T19:37:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.817+0000 7f8eee5ff700 1 -- start start 2023-10-18T19:37:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee80af1e0 0x7f8ee8091b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee8135cb0 0x7f8ee814c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8148da0 con 0x7f8ee80af1e0 2023-10-18T19:37:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80abcc0 con 0x7f8ee80a13d0 2023-10-18T19:37:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eee5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8149720 con 0x7f8ee8135cb0 2023-10-18T19:37:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8ee7fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39010/0 (socket says 172.21.15.88:39010) 2023-10-18T19:37:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8ee7fff700 1 -- 172.21.15.88:0/1036361338 learned_addr learned my addr 172.21.15.88:0/1036361338 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8eecb9c700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee8135cb0 0x7f8ee814c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.818+0000 7f8ee77fe700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee80af1e0 0x7f8ee8091b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 -- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee8135cb0 msgr2=0x7f8ee814c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee8135cb0 0x7f8ee814c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 -- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee80af1e0 msgr2=0x7f8ee8091b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee80af1e0 0x7f8ee8091b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 -- 172.21.15.88:0/1036361338 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009370 con 0x7f8ee80a13d0 2023-10-18T19:37:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ee7fff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ed8009130 tx=0x7f8ed8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed800be50 con 0x7f8ee80a13d0 2023-10-18T19:37:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed800b800 con 0x7f8ee80a13d0 2023-10-18T19:37:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee814c100 con 0x7f8ee80a13d0 2023-10-18T19:37:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed801c670 con 0x7f8ee80a13d0 2023-10-18T19:37:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.819+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee80a92c0 con 0x7f8ee80a13d0 2023-10-18T19:37:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.820+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee805f270 con 0x7f8ee80a13d0 2023-10-18T19:37:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.821+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f8ed801c9e0 con 0x7f8ee80a13d0 2023-10-18T19:37:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.821+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f8ed8057080 con 0x7f8ee80a13d0 2023-10-18T19:37:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.825+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f8ed800b970 con 0x7f8ee80a13d0 2023-10-18T19:37:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.993+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ee814c0a0 con 0x7f8ee80a13d0 2023-10-18T19:37:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.993+0000 7f8ecffff700 1 -- 172.21.15.88:0/1036361338 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f8ed800b970 con 0x7f8ee80a13d0 2023-10-18T19:37:24.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 >> v1:172.21.15.88:6800/113625 conn(0x7f8ed4041ce0 legacy=0x7f8ed40441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 msgr2=0x7f8ee8149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ed8009130 tx=0x7f8ed8015000).stop 2023-10-18T19:37:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 shutdown_connections 2023-10-18T19:37:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ee8135cb0 0x7f8ee814c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ee80a13d0 0x7f8ee8149230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 --2- 172.21.15.88:0/1036361338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ee80af1e0 0x7f8ee8091b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 >> 172.21.15.88:0/1036361338 conn(0x7f8ee8064d50 msgr2=0x7f8ee80a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 shutdown_connections 2023-10-18T19:37:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:24.995+0000 7f8eee5ff700 1 -- 172.21.15.88:0/1036361338 wait complete. 2023-10-18T19:37:25.014 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-18T19:37:25.015 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-18T19:37:25.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.201+0000 7f6343dff700 1 Processor -- start 2023-10-18T19:37:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.201+0000 7f6343dff700 1 -- start start 2023-10-18T19:37:25.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f633c05e960 0x7f633c0a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 0x7f633c138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0a3a70 con 0x7f633c05e960 2023-10-18T19:37:25.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c05ed40 con 0x7f633c0a4a20 2023-10-18T19:37:25.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6343dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633c136670 con 0x7f633c1361c0 2023-10-18T19:37:25.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f634239c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 0x7f633c138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6341b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f633c05e960 0x7f633c0a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f634139a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f634239c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 0x7f633c138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56416/0 (socket says 172.21.15.88:56416) 2023-10-18T19:37:25.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f634139a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39014/0 (socket says 172.21.15.88:39014) 2023-10-18T19:37:25.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f634239c700 1 -- 172.21.15.88:0/1757324592 learned_addr learned my addr 172.21.15.88:0/1757324592 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:25.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.202+0000 7f6341b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f633c05e960 0x7f633c0a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36524/0 (socket says 172.21.15.88:36524) 2023-10-18T19:37:25.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 -- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 msgr2=0x7f633c138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:25.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 0x7f633c138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 -- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 msgr2=0x7f633c135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:25.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 -- 172.21.15.88:0/1757324592 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0a2ac0 con 0x7f633c05e960 2023-10-18T19:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f634139a700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6341b9b700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c05e960 0x7f633c0a3580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6338009790 tx=0x7f6338009060).ready entity=mon.0 client_cookie=e64ea5c25191ee73 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6340b99700 1 -- 172.21.15.88:0/1757324592 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800d4a0 con 0x7f633c05e960 2023-10-18T19:37:25.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6340b99700 1 -- 172.21.15.88:0/1757324592 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633800d600 con 0x7f633c05e960 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.203+0000 7f6340b99700 1 -- 172.21.15.88:0/1757324592 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800d980 con 0x7f633c05e960 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 -- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c05e960 msgr2=0x7f633c0a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c05e960 0x7f633c0a3580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6338009790 tx=0x7f6338009060).stop 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 -- 172.21.15.88:0/1757324592 shutdown_connections 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c1361c0 0x7f633c138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c05e960 0x7f633c0a3580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 --2- 172.21.15.88:0/1757324592 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 -- 172.21.15.88:0/1757324592 >> 172.21.15.88:0/1757324592 conn(0x7f633c064bb0 msgr2=0x7f633c05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 -- 172.21.15.88:0/1757324592 shutdown_connections 2023-10-18T19:37:25.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.204+0000 7f6343dff700 1 -- 172.21.15.88:0/1757324592 wait complete. 2023-10-18T19:37:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.205+0000 7f6343dff700 1 Processor -- start 2023-10-18T19:37:25.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.205+0000 7f6343dff700 1 -- start start 2023-10-18T19:37:25.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c05e960 0x7f633c0a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c1361c0 0x7f633c1385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1488e0 con 0x7f633c1361c0 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c148ac0 con 0x7f633c0a4a20 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6343dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0a88f0 con 0x7f633c05e960 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f634139a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f6341b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c05e960 0x7f633c0a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f634139a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39030/0 (socket says 172.21.15.88:39030) 2023-10-18T19:37:25.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f634139a700 1 -- 172.21.15.88:0/440954594 learned_addr learned my addr 172.21.15.88:0/440954594 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.206+0000 7f634239c700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c1361c0 0x7f633c1385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 -- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c05e960 msgr2=0x7f633c0a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c05e960 0x7f633c0a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 -- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c1361c0 msgr2=0x7f633c1385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c1361c0 0x7f633c1385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 -- 172.21.15.88:0/440954594 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0092a0 con 0x7f633c0a4a20 2023-10-18T19:37:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f634139a700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f632c00e9d0 tx=0x7f632c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00c6a0 con 0x7f633c0a4a20 2023-10-18T19:37:25.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00c800 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00cb80 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63380092a0 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.207+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c138ab0 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.209+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c05f270 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.209+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f632c01b400 con 0x7f633c0a4a20 2023-10-18T19:37:25.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.209+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f632c055d20 con 0x7f633c0a4a20 2023-10-18T19:37:25.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.213+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f632c036060 con 0x7f633c0a4a20 2023-10-18T19:37:25.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.363+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633c0a1100 con 0x7f633c0a4a20 2023-10-18T19:37:25.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.363+0000 7f6331ffb700 1 -- 172.21.15.88:0/440954594 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11325 (secure 0 0 0) 0x7f632c016020 con 0x7f633c0a4a20 2023-10-18T19:37:25.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:25.367 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":21,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:18.357291+0000","last_up_change":"2023-10-18T19:34:06.488799+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 >> v1:172.21.15.88:6800/113625 conn(0x7f6320041cb0 legacy=0x7f6320044170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 msgr2=0x7f633c0a69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f632c00e9d0 tx=0x7f632c009060).stop 2023-10-18T19:37:25.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 shutdown_connections 2023-10-18T19:37:25.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c1361c0 0x7f633c1385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f633c05e960 0x7f633c0a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 --2- 172.21.15.88:0/440954594 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f633c0a4a20 0x7f633c0a69e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 >> 172.21.15.88:0/440954594 conn(0x7f633c064bb0 msgr2=0x7f633c0a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.365+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 shutdown_connections 2023-10-18T19:37:25.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.366+0000 7f6343dff700 1 -- 172.21.15.88:0/440954594 wait complete. 2023-10-18T19:37:25.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18T19:34:09.738627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T19:34:18.877868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T19:34:20.222147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T19:37:15.428276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2023-10-18T19:37:25.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:37:25.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.575+0000 7f967bdff700 1 Processor -- start 2023-10-18T19:37:25.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.575+0000 7f967bdff700 1 -- start start 2023-10-18T19:37:25.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967bdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 0x7f9674067200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967bdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 0x7f96741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967bdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9674136520 con 0x7f96740a5760 2023-10-18T19:37:25.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967bdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740a78f0 con 0x7f967405e250 2023-10-18T19:37:25.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967bdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967405e630 con 0x7f96740a6ae0 2023-10-18T19:37:25.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f9679b9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 0x7f9674067200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967939a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 0x7f96741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967a39c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f96740a5760 0x7f967413c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35208/0 (socket says 172.21.15.88:35208) 2023-10-18T19:37:25.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.576+0000 7f967a39c700 1 -- 172.21.15.88:0/1037326173 learned_addr learned my addr 172.21.15.88:0/1037326173 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:25.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967939a700 1 -- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 msgr2=0x7f9674067200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:25.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967939a700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 0x7f9674067200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f9678b99700 1 -- 172.21.15.88:0/1037326173 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275726136 0 0) 0x7f9674136520 con 0x7f96740a5760 2023-10-18T19:37:25.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967939a700 1 -- 172.21.15.88:0/1037326173 >> v1:172.21.15.88:6789/0 conn(0x7f96740a5760 legacy=0x7f967413c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967939a700 1 -- 172.21.15.88:0/1037326173 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674138be0 con 0x7f96740a6ae0 2023-10-18T19:37:25.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f9679b9b700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 0x7f9674067200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:25.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967939a700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 0x7f96741393c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9664009790 tx=0x7f9664009060).ready entity=mon.2 client_cookie=bb46130f7e053e44 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f9678b99700 1 -- 172.21.15.88:0/1037326173 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400f510 con 0x7f96740a6ae0 2023-10-18T19:37:25.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f9678b99700 1 -- 172.21.15.88:0/1037326173 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400f670 con 0x7f96740a6ae0 2023-10-18T19:37:25.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f9678b99700 1 -- 172.21.15.88:0/1037326173 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400f9f0 con 0x7f96740a6ae0 2023-10-18T19:37:25.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967bdff700 1 -- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 msgr2=0x7f96741393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.577+0000 7f967bdff700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 0x7f96741393c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9664009790 tx=0x7f9664009060).stop 2023-10-18T19:37:25.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 -- 172.21.15.88:0/1037326173 shutdown_connections 2023-10-18T19:37:25.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f967405e250 0x7f9674067200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 --2- 172.21.15.88:0/1037326173 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a6ae0 0x7f96741393c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 -- 172.21.15.88:0/1037326173 >> 172.21.15.88:0/1037326173 conn(0x7f9674066570 msgr2=0x7f96740625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 -- 172.21.15.88:0/1037326173 shutdown_connections 2023-10-18T19:37:25.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.578+0000 7f967bdff700 1 -- 172.21.15.88:0/1037326173 wait complete. 2023-10-18T19:37:25.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.579+0000 7f967bdff700 1 Processor -- start 2023-10-18T19:37:25.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.580+0000 7f967bdff700 1 -- start start 2023-10-18T19:37:25.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a5760 0x7f9674114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96740a6ae0 0x7f9674148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9674114820 con 0x7f967405e250 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9674148310 con 0x7f96740a6ae0 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967bdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9674113880 con 0x7f96740a5760 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36552/0 (socket says 172.21.15.88:36552) 2023-10-18T19:37:25.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 -- 172.21.15.88:0/3516233561 learned_addr learned my addr 172.21.15.88:0/3516233561 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:25.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967a39c700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96740a6ae0 0x7f9674148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f967939a700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a5760 0x7f9674114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 -- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a5760 msgr2=0x7f9674114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a5760 0x7f9674114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 -- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96740a6ae0 msgr2=0x7f9674148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96740a6ae0 0x7f9674148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.581+0000 7f9679b9b700 1 -- 172.21.15.88:0/3516233561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700092a0 con 0x7f967405e250 2023-10-18T19:37:25.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f9679b9b700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f967000ea20 tx=0x7f9670009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000ee60 con 0x7f967405e250 2023-10-18T19:37:25.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967000c8e0 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000cc60 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96640092a0 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.582+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9674114550 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.583+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967405f270 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.583+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f967001b400 con 0x7f967405e250 2023-10-18T19:37:25.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.584+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f9670055d30 con 0x7f967405e250 2023-10-18T19:37:25.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.587+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9670036170 con 0x7f967405e250 2023-10-18T19:37:25.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.734+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9674067ac0 con 0x7f967405e250 2023-10-18T19:37:25.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.735+0000 7f9669ffb700 1 -- 172.21.15.88:0/3516233561 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9670039960 con 0x7f967405e250 2023-10-18T19:37:25.738 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:37:25.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 >> v1:172.21.15.88:6800/113625 conn(0x7f9658041ce0 legacy=0x7f96580441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 msgr2=0x7f9674137d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f967000ea20 tx=0x7f9670009060).stop 2023-10-18T19:37:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 shutdown_connections 2023-10-18T19:37:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96740a6ae0 0x7f9674148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f967405e250 0x7f9674137d40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.736+0000 7f967bdff700 1 --2- 172.21.15.88:0/3516233561 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96740a5760 0x7f9674114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.737+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 >> 172.21.15.88:0/3516233561 conn(0x7f9674066570 msgr2=0x7f9674069280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.737+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 shutdown_connections 2023-10-18T19:37:25.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.737+0000 7f967bdff700 1 -- 172.21.15.88:0/3516233561 wait complete. 2023-10-18T19:37:25.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T19:37:25.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.944+0000 7f0288dff700 1 Processor -- start 2023-10-18T19:37:25.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 -- start start 2023-10-18T19:37:25.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02840a3560 0x7f02840a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f02841381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02840a3940 con 0x7f02840a14a0 2023-10-18T19:37:25.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02840a46b0 con 0x7f02840a3560 2023-10-18T19:37:25.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.945+0000 7f0288dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02840a1020 con 0x7f0284137cf0 2023-10-18T19:37:25.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02840a3560 0x7f02840a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f0282d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f02841381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f0281d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f02840a14a0 0x7f02840af0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35210/0 (socket says 172.21.15.88:35210) 2023-10-18T19:37:25.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f0281d9b700 1 -- 172.21.15.88:0/3813423970 learned_addr learned my addr 172.21.15.88:0/3813423970 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:25.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 -- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 msgr2=0x7f02841381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:25.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f02841381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 -- 172.21.15.88:0/3813423970 >> v1:172.21.15.88:6789/0 conn(0x7f02840a14a0 legacy=0x7f02840af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 -- 172.21.15.88:0/3813423970 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840a4900 con 0x7f02840a3560 2023-10-18T19:37:25.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028159a700 1 -- 172.21.15.88:0/3813423970 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486087922 0 0) 0x7f02840a3940 con 0x7f02840a14a0 2023-10-18T19:37:25.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f0282d9d700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f02841381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:25.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.946+0000 7f028259c700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840a2c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0274006fd0 tx=0x7f0274006f40).ready entity=mon.0 client_cookie=fd82f4eb4b3324c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f028159a700 1 -- 172.21.15.88:0/3813423970 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274005880 con 0x7f02840a3560 2023-10-18T19:37:25.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f028159a700 1 -- 172.21.15.88:0/3813423970 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740059e0 con 0x7f02840a3560 2023-10-18T19:37:25.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f028159a700 1 -- 172.21.15.88:0/3813423970 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274005d60 con 0x7f02840a3560 2023-10-18T19:37:25.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 -- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 msgr2=0x7f02840a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840a2c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0274006fd0 tx=0x7f0274006f40).stop 2023-10-18T19:37:25.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 -- 172.21.15.88:0/3813423970 shutdown_connections 2023-10-18T19:37:25.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f02841381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 --2- 172.21.15.88:0/3813423970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840a2c40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 -- 172.21.15.88:0/3813423970 >> 172.21.15.88:0/3813423970 conn(0x7f0284064b70 msgr2=0x7f0284062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:25.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 -- 172.21.15.88:0/3813423970 shutdown_connections 2023-10-18T19:37:25.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.947+0000 7f0288dff700 1 -- 172.21.15.88:0/3813423970 wait complete. 2023-10-18T19:37:25.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 Processor -- start 2023-10-18T19:37:25.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 -- start start 2023-10-18T19:37:25.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840933a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f0284148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:25.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284091b00 con 0x7f02840a3560 2023-10-18T19:37:25.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02841488c0 con 0x7f0284137cf0 2023-10-18T19:37:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.949+0000 7f0288dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02840ac250 con 0x7f02840a14a0 2023-10-18T19:37:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56444/0 (socket says 172.21.15.88:56444) 2023-10-18T19:37:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 -- 172.21.15.88:0/1016339906 learned_addr learned my addr 172.21.15.88:0/1016339906 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f0282d9d700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f0284148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f0281d9b700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 -- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 msgr2=0x7f0284148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f0284148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 -- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 msgr2=0x7f02840933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 -- 172.21.15.88:0/1016339906 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009a20 con 0x7f02840a14a0 2023-10-18T19:37:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f0282d9d700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f0284148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.950+0000 7f028259c700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f02840a47f0 tx=0x7f0274016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.951+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400f720 con 0x7f02840a14a0 2023-10-18T19:37:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.951+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400f8a0 con 0x7f02840a14a0 2023-10-18T19:37:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.951+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400fc60 con 0x7f02840a14a0 2023-10-18T19:37:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.951+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274009250 con 0x7f02840a14a0 2023-10-18T19:37:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.951+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02840aa250 con 0x7f02840a14a0 2023-10-18T19:37:25.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.952+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028405f270 con 0x7f02840a14a0 2023-10-18T19:37:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.952+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f0274011650 con 0x7f02840a14a0 2023-10-18T19:37:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.953+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f0274056cc0 con 0x7f02840a14a0 2023-10-18T19:37:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:25.957+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f027400a800 con 0x7f02840a14a0 2023-10-18T19:37:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.104+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02840a4bc0 con 0x7f02840a14a0 2023-10-18T19:37:26.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.105+0000 7f02727fc700 1 -- 172.21.15.88:0/1016339906 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f027403a970 con 0x7f02840a14a0 2023-10-18T19:37:26.108 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:37:26.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.106+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 >> v1:172.21.15.88:6800/113625 conn(0x7f0264041ce0 legacy=0x7f02640441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.106+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 msgr2=0x7f0284091ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.106+0000 7f0288dff700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f02840a47f0 tx=0x7f0274016000).stop 2023-10-18T19:37:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 shutdown_connections 2023-10-18T19:37:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0284137cf0 0x7f0284148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f02840a14a0 0x7f0284091ff0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 --2- 172.21.15.88:0/1016339906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02840a3560 0x7f02840933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 >> 172.21.15.88:0/1016339906 conn(0x7f0284064b70 msgr2=0x7f0284062e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 shutdown_connections 2023-10-18T19:37:26.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.107+0000 7f0288dff700 1 -- 172.21.15.88:0/1016339906 wait complete. 2023-10-18T19:37:26.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T19:37:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.316+0000 7f63ee1ff700 1 Processor -- start 2023-10-18T19:37:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.316+0000 7f63ee1ff700 1 -- start start 2023-10-18T19:37:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63ee1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63ee1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 0x7f63e80af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63ee1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80a3940 con 0x7f63e8137cf0 2023-10-18T19:37:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63ee1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80a46b0 con 0x7f63e80a14a0 2023-10-18T19:37:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63ee1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80a1020 con 0x7f63e80a3560 2023-10-18T19:37:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 0x7f63e80af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40472/0 (socket says 172.21.15.88:40472) 2023-10-18T19:37:26.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 -- 172.21.15.88:0/2388877893 learned_addr learned my addr 172.21.15.88:0/2388877893 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:26.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 -- 172.21.15.88:0/2388877893 >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 msgr2=0x7f63e80af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:26.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 --2- 172.21.15.88:0/2388877893 >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 0x7f63e80af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 -- 172.21.15.88:0/2388877893 >> v1:172.21.15.88:6789/0 conn(0x7f63e8137cf0 legacy=0x7f63e8138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e77fe700 1 -- 172.21.15.88:0/2388877893 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80a4900 con 0x7f63e80a3560 2023-10-18T19:37:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.317+0000 7f63e6ffd700 1 --2- 172.21.15.88:0/2388877893 >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 0x7f63e80af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63e77fe700 1 --2- 172.21.15.88:0/2388877893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f63d8009810 tx=0x7f63d8009060).ready entity=mon.1 client_cookie=efd4d3453ba52916 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63e67fc700 1 -- 172.21.15.88:0/2388877893 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8005880 con 0x7f63e80a3560 2023-10-18T19:37:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63e67fc700 1 -- 172.21.15.88:0/2388877893 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80059e0 con 0x7f63e80a3560 2023-10-18T19:37:26.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63e67fc700 1 -- 172.21.15.88:0/2388877893 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8005d60 con 0x7f63e80a3560 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 -- 172.21.15.88:0/2388877893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 msgr2=0x7f63e80a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/2388877893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f63d8009810 tx=0x7f63d8009060).stop 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 -- 172.21.15.88:0/2388877893 shutdown_connections 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/2388877893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e80a3560 0x7f63e80a2c40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/2388877893 >> v2:172.21.15.88:3300/0 conn(0x7f63e80a14a0 0x7f63e80af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 -- 172.21.15.88:0/2388877893 >> 172.21.15.88:0/2388877893 conn(0x7f63e8064b70 msgr2=0x7f63e8062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:26.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 -- 172.21.15.88:0/2388877893 shutdown_connections 2023-10-18T19:37:26.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.318+0000 7f63ee1ff700 1 -- 172.21.15.88:0/2388877893 wait complete. 2023-10-18T19:37:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.320+0000 7f63ee1ff700 1 Processor -- start 2023-10-18T19:37:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.321+0000 7f63ee1ff700 1 -- start start 2023-10-18T19:37:26.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.321+0000 7f63ee1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63ee1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f63e80a3560 0x7f63e80ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63ee1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e8137cf0 0x7f63e80a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63ee1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80934a0 con 0x7f63e80a14a0 2023-10-18T19:37:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63ee1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8138330 con 0x7f63e8137cf0 2023-10-18T19:37:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63ee1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80aa5b0 con 0x7f63e80a3560 2023-10-18T19:37:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35940/0 (socket says 172.21.15.88:35940) 2023-10-18T19:37:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 -- 172.21.15.88:0/1054898038 learned_addr learned my addr 172.21.15.88:0/1054898038 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e6ffd700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f63e80a3560 0x7f63e80ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e7fff700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e8137cf0 0x7f63e80a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 -- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f63e80a3560 msgr2=0x7f63e80ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f63e80a3560 0x7f63e80ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 -- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e8137cf0 msgr2=0x7f63e80a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e8137cf0 0x7f63e80a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 -- 172.21.15.88:0/1054898038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc0092a0 con 0x7f63e80a14a0 2023-10-18T19:37:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.322+0000 7f63e77fe700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f63d8009eb0 tx=0x7f63d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.323+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8006770 con 0x7f63e80a14a0 2023-10-18T19:37:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.323+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800b820 con 0x7f63e80a14a0 2023-10-18T19:37:26.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.323+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d8009300 con 0x7f63e80a14a0 2023-10-18T19:37:26.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.323+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800bbc0 con 0x7f63e80a14a0 2023-10-18T19:37:26.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.323+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80a9e80 con 0x7f63e80a14a0 2023-10-18T19:37:26.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.324+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e805f270 con 0x7f63e80a14a0 2023-10-18T19:37:26.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.324+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f63d8018070 con 0x7f63e80a14a0 2023-10-18T19:37:26.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.325+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f63d8056780 con 0x7f63e80a14a0 2023-10-18T19:37:26.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.328+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f63d803a840 con 0x7f63e80a14a0 2023-10-18T19:37:26.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.477+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63e80a4bc0 con 0x7f63e80a14a0 2023-10-18T19:37:26.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.478+0000 7f63cf7fe700 1 -- 172.21.15.88:0/1054898038 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63d803a840 con 0x7f63e80a14a0 2023-10-18T19:37:26.481 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:37:26.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 >> v1:172.21.15.88:6800/113625 conn(0x7f63d4041d10 legacy=0x7f63d40441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 msgr2=0x7f63e8092ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f63d8009eb0 tx=0x7f63d8016000).stop 2023-10-18T19:37:26.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 shutdown_connections 2023-10-18T19:37:26.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f63e8137cf0 0x7f63e80a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63e80a14a0 0x7f63e8092ed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 --2- 172.21.15.88:0/1054898038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f63e80a3560 0x7f63e80ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 >> 172.21.15.88:0/1054898038 conn(0x7f63e8064b70 msgr2=0x7f63e80ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 shutdown_connections 2023-10-18T19:37:26.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.480+0000 7f63ee1ff700 1 -- 172.21.15.88:0/1054898038 wait complete. 2023-10-18T19:37:26.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-18T19:37:26.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.687+0000 7fd3bfbff700 1 Processor -- start 2023-10-18T19:37:26.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 -- start start 2023-10-18T19:37:26.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 0x7fd3b8138180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80a3940 con 0x7fd3b80a3560 2023-10-18T19:37:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80a46b0 con 0x7fd3b8137cf0 2023-10-18T19:37:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.688+0000 7fd3bfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80a1020 con 0x7fd3b80a14a0 2023-10-18T19:37:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd99b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd3b80a3560 0x7fd3b80af0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51086/0 (socket says 172.21.15.88:51086) 2023-10-18T19:37:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd99b700 1 -- 172.21.15.88:0/899989177 learned_addr learned my addr 172.21.15.88:0/899989177 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57640/0 (socket says 172.21.15.88:57640) 2023-10-18T19:37:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3be19c700 1 --2- 172.21.15.88:0/899989177 >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 0x7fd3b8138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 -- 172.21.15.88:0/899989177 >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 msgr2=0x7fd3b8138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 --2- 172.21.15.88:0/899989177 >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 0x7fd3b8138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bc999700 1 -- 172.21.15.88:0/899989177 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125201313 0 0) 0x7fd3b80a3940 con 0x7fd3b80a3560 2023-10-18T19:37:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 -- 172.21.15.88:0/899989177 >> v1:172.21.15.88:6789/0 conn(0x7fd3b80a3560 legacy=0x7fd3b80af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 -- 172.21.15.88:0/899989177 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80a4900 con 0x7fd3b80a14a0 2023-10-18T19:37:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3be19c700 1 --2- 172.21.15.88:0/899989177 >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 0x7fd3b8138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:26.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bd19a700 1 --2- 172.21.15.88:0/899989177 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd3a8009760 tx=0x7fd3a8009060).ready entity=mon.2 client_cookie=c449f7bc972a6bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.689+0000 7fd3bc999700 1 -- 172.21.15.88:0/899989177 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800f510 con 0x7fd3b80a14a0 2023-10-18T19:37:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bc999700 1 -- 172.21.15.88:0/899989177 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800f670 con 0x7fd3b80a14a0 2023-10-18T19:37:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bc999700 1 -- 172.21.15.88:0/899989177 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800f9f0 con 0x7fd3b80a14a0 2023-10-18T19:37:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 -- 172.21.15.88:0/899989177 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 msgr2=0x7fd3b80a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/899989177 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd3a8009760 tx=0x7fd3a8009060).stop 2023-10-18T19:37:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 -- 172.21.15.88:0/899989177 shutdown_connections 2023-10-18T19:37:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/899989177 >> v2:172.21.15.88:3300/0 conn(0x7fd3b8137cf0 0x7fd3b8138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/899989177 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b80a14a0 0x7fd3b80a2c40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 -- 172.21.15.88:0/899989177 >> 172.21.15.88:0/899989177 conn(0x7fd3b8064b70 msgr2=0x7fd3b8062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 -- 172.21.15.88:0/899989177 shutdown_connections 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.690+0000 7fd3bfbff700 1 -- 172.21.15.88:0/899989177 wait complete. 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.691+0000 7fd3bfbff700 1 Processor -- start 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 -- start start 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 0x7fd3b80abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b8137cf0 0x7fd3b8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8149620 con 0x7fd3b80a3560 2023-10-18T19:37:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80aa840 con 0x7fd3b80a14a0 2023-10-18T19:37:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.692+0000 7fd3bfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80a9310 con 0x7fd3b8137cf0 2023-10-18T19:37:26.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd99b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 0x7fd3b80abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35952/0 (socket says 172.21.15.88:35952) 2023-10-18T19:37:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 -- 172.21.15.88:0/2799293194 learned_addr learned my addr 172.21.15.88:0/2799293194 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3be19c700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b8137cf0 0x7fd3b8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:26.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 -- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b8137cf0 msgr2=0x7fd3b8148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b8137cf0 0x7fd3b8148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 -- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 msgr2=0x7fd3b80abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 0x7fd3b80abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 -- 172.21.15.88:0/2799293194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009a20 con 0x7fd3b80a3560 2023-10-18T19:37:26.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd99b700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 0x7fd3b80abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3bd19a700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd3a8009e00 tx=0x7fd3a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800f7e0 con 0x7fd3b80a3560 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800f940 con 0x7fd3b80a3560 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.693+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a801b660 con 0x7fd3b80a3560 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.694+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80092a0 con 0x7fd3b80a3560 2023-10-18T19:37:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.694+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8148600 con 0x7fd3b80a3560 2023-10-18T19:37:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.695+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b805f270 con 0x7fd3b80a3560 2023-10-18T19:37:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.695+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fd3a801ba50 con 0x7fd3b80a3560 2023-10-18T19:37:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.695+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fd3a8057310 con 0x7fd3b80a3560 2023-10-18T19:37:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.699+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fd3a8008d60 con 0x7fd3b80a3560 2023-10-18T19:37:26.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.842+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd3b80a50a0 con 0x7fd3b80a3560 2023-10-18T19:37:26.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.843+0000 7fd3adffb700 1 -- 172.21.15.88:0/2799293194 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd3a803b2b0 con 0x7fd3b80a3560 2023-10-18T19:37:26.846 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-10-18T19:37:26.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.844+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 >> v1:172.21.15.88:6800/113625 conn(0x7fd39c041ce0 legacy=0x7fd39c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.844+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 msgr2=0x7fd3b80ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.844+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd3a8009e00 tx=0x7fd3a8017000).stop 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.844+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 shutdown_connections 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd3b8137cf0 0x7fd3b8148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3b80a14a0 0x7fd3b80abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 --2- 172.21.15.88:0/2799293194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3b80a3560 0x7fd3b80ab190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:26.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 >> 172.21.15.88:0/2799293194 conn(0x7fd3b8064b70 msgr2=0x7fd3b81388c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:26.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 shutdown_connections 2023-10-18T19:37:26.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:26.845+0000 7fd3bfbff700 1 -- 172.21.15.88:0/2799293194 wait complete. 2023-10-18T19:37:26.866 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:37:27.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.051+0000 7ff15cdff700 1 Processor -- start 2023-10-18T19:37:27.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.051+0000 7ff15cdff700 1 -- start start 2023-10-18T19:37:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15cdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 0x7ff158135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15cdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1580afd50 con 0x7ff1580a4c50 2023-10-18T19:37:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15cdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1580a47a0 con 0x7ff1580af970 2023-10-18T19:37:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15cdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580a3a10 con 0x7ff1580a1790 2023-10-18T19:37:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 0x7ff158135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57664/0 (socket says 172.21.15.88:57664) 2023-10-18T19:37:27.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 -- 172.21.15.88:0/3383153179 learned_addr learned my addr 172.21.15.88:0/3383153179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:27.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 -- 172.21.15.88:0/3383153179 >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 msgr2=0x7ff158135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:27.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 --2- 172.21.15.88:0/3383153179 >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 0x7ff158135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 -- 172.21.15.88:0/3383153179 >> v1:172.21.15.88:6789/0 conn(0x7ff1580a4c50 legacy=0x7ff15813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff155d9b700 1 -- 172.21.15.88:0/3383153179 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580a32d0 con 0x7ff1580a1790 2023-10-18T19:37:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.053+0000 7ff15659c700 1 --2- 172.21.15.88:0/3383153179 >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 0x7ff158135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff155d9b700 1 --2- 172.21.15.88:0/3383153179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff14c006fd0 tx=0x7ff14c0090f0).ready entity=mon.2 client_cookie=a0c4c7fcab3ab696 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff15559a700 1 -- 172.21.15.88:0/3383153179 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00b580 con 0x7ff1580a1790 2023-10-18T19:37:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff15559a700 1 -- 172.21.15.88:0/3383153179 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00b6e0 con 0x7ff1580a1790 2023-10-18T19:37:27.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff15559a700 1 -- 172.21.15.88:0/3383153179 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00ba60 con 0x7ff1580a1790 2023-10-18T19:37:27.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff15cdff700 1 -- 172.21.15.88:0/3383153179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 msgr2=0x7ff158136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.054+0000 7ff15cdff700 1 --2- 172.21.15.88:0/3383153179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff14c006fd0 tx=0x7ff14c0090f0).stop 2023-10-18T19:37:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 -- 172.21.15.88:0/3383153179 shutdown_connections 2023-10-18T19:37:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 --2- 172.21.15.88:0/3383153179 >> v2:172.21.15.88:3300/0 conn(0x7ff1580af970 0x7ff158135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 --2- 172.21.15.88:0/3383153179 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580a1790 0x7ff158136220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 -- 172.21.15.88:0/3383153179 >> 172.21.15.88:0/3383153179 conn(0x7ff15805eb60 msgr2=0x7ff1580af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 -- 172.21.15.88:0/3383153179 shutdown_connections 2023-10-18T19:37:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.055+0000 7ff15cdff700 1 -- 172.21.15.88:0/3383153179 wait complete. 2023-10-18T19:37:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.056+0000 7ff15cdff700 1 Processor -- start 2023-10-18T19:37:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.056+0000 7ff15cdff700 1 -- start start 2023-10-18T19:37:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580af970 0x7ff1580a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580ab300 con 0x7ff1580a4c50 2023-10-18T19:37:27.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580aacf0 con 0x7ff1580a1790 2023-10-18T19:37:27.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15cdff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580a99d0 con 0x7ff1580af970 2023-10-18T19:37:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff155d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40510/0 (socket says 172.21.15.88:40510) 2023-10-18T19:37:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff155d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35978/0 (socket says 172.21.15.88:35978) 2023-10-18T19:37:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 -- 172.21.15.88:0/2737980256 learned_addr learned my addr 172.21.15.88:0/2737980256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff156d9d700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580af970 0x7ff1580a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 -- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580af970 msgr2=0x7ff1580a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580af970 0x7ff1580a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 -- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 msgr2=0x7ff1580ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.057+0000 7ff15659c700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff15659c700 1 -- 172.21.15.88:0/2737980256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480092a0 con 0x7ff1580a1790 2023-10-18T19:37:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff155d9b700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff15659c700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff14800e980 tx=0x7ff148009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148009560 con 0x7ff1580a1790 2023-10-18T19:37:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff148012600 con 0x7ff1580a1790 2023-10-18T19:37:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c009370 con 0x7ff1580a1790 2023-10-18T19:37:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148012980 con 0x7ff1580a1790 2023-10-18T19:37:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.058+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff158134c10 con 0x7ff1580a1790 2023-10-18T19:37:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.059+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15805f270 con 0x7ff1580a1790 2023-10-18T19:37:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.059+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7ff148012cf0 con 0x7ff1580a1790 2023-10-18T19:37:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.060+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7ff148055b20 con 0x7ff1580a1790 2023-10-18T19:37:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.064+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ff148035fc0 con 0x7ff1580a1790 2023-10-18T19:37:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.236+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1580a3010 con 0x7ff1580a1790 2023-10-18T19:37:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.236+0000 7ff1467fc700 1 -- 172.21.15.88:0/2737980256 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3553 (secure 0 0 0) 0x7ff148016070 con 0x7ff1580a1790 2023-10-18T19:37:27.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:27.239 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6819/1711023327","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":1711023327}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T19:34:21.213099+0000","modified":"2023-10-18T19:35:17.635104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:37:27.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 >> v1:172.21.15.88:6800/113625 conn(0x7ff138041d10 legacy=0x7ff1380441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 msgr2=0x7ff15809e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff14800e980 tx=0x7ff148009060).stop 2023-10-18T19:37:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 shutdown_connections 2023-10-18T19:37:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff1580af970 0x7ff1580a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff1580a1790 0x7ff15809e6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 --2- 172.21.15.88:0/2737980256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1580a4c50 0x7ff1580ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 >> 172.21.15.88:0/2737980256 conn(0x7ff15805eb60 msgr2=0x7ff158138230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 shutdown_connections 2023-10-18T19:37:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.238+0000 7ff15cdff700 1 -- 172.21.15.88:0/2737980256 wait complete. 2023-10-18T19:37:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2023-10-18T19:37:27.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:27.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.444+0000 7f9593bff700 1 Processor -- start 2023-10-18T19:37:27.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.444+0000 7f9593bff700 1 -- start start 2023-10-18T19:37:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f9593bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0ab590 0x7f958c139630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f9593bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06a310 0x7f958c136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f9593bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c0ab970 con 0x7f958c06aa30 2023-10-18T19:37:27.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f9593bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c135a50 con 0x7f958c0ab590 2023-10-18T19:37:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f9593bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c135cf0 con 0x7f958c06a310 2023-10-18T19:37:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f959199b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0ab590 0x7f958c139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f959219c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f958c06aa30 0x7f958c0682c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51090/0 (socket says 172.21.15.88:51090) 2023-10-18T19:37:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f959199b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0ab590 0x7f958c139630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35988/0 (socket says 172.21.15.88:35988) 2023-10-18T19:37:27.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.445+0000 7f959219c700 1 -- 172.21.15.88:0/3500914364 learned_addr learned my addr 172.21.15.88:0/3500914364 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959119a700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06a310 0x7f958c136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959199b700 1 -- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06a310 msgr2=0x7f958c136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959199b700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06a310 0x7f958c136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959199b700 1 -- 172.21.15.88:0/3500914364 >> v1:172.21.15.88:6789/0 conn(0x7f958c06aa30 legacy=0x7f958c0682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959199b700 1 -- 172.21.15.88:0/3500914364 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c139000 con 0x7f958c0ab590 2023-10-18T19:37:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f9590999700 1 -- 172.21.15.88:0/3500914364 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176647332 0 0) 0x7f958c0ab970 con 0x7f958c06aa30 2023-10-18T19:37:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f959199b700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0ab590 0x7f958c139630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9588009760 tx=0x7f9588009060).ready entity=mon.0 client_cookie=980ea794f4001796 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f9590999700 1 -- 172.21.15.88:0/3500914364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800f510 con 0x7f958c0ab590 2023-10-18T19:37:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f9590999700 1 -- 172.21.15.88:0/3500914364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958800f670 con 0x7f958c0ab590 2023-10-18T19:37:27.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.446+0000 7f9590999700 1 -- 172.21.15.88:0/3500914364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800f9f0 con 0x7f958c0ab590 2023-10-18T19:37:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 -- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0ab590 msgr2=0x7f958c139630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0ab590 0x7f958c139630 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9588009760 tx=0x7f9588009060).stop 2023-10-18T19:37:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 -- 172.21.15.88:0/3500914364 shutdown_connections 2023-10-18T19:37:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0ab590 0x7f958c139630 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 --2- 172.21.15.88:0/3500914364 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06a310 0x7f958c136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 -- 172.21.15.88:0/3500914364 >> 172.21.15.88:0/3500914364 conn(0x7f958c05eb30 msgr2=0x7f958c0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 -- 172.21.15.88:0/3500914364 shutdown_connections 2023-10-18T19:37:27.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.447+0000 7f9593bff700 1 -- 172.21.15.88:0/3500914364 wait complete. 2023-10-18T19:37:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.448+0000 7f9593bff700 1 Processor -- start 2023-10-18T19:37:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.448+0000 7f9593bff700 1 -- start start 2023-10-18T19:37:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c06a310 0x7f958c097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f958c0ab590 0x7f958c096350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c0972f0 con 0x7f958c06a310 2023-10-18T19:37:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c095c60 con 0x7f958c0ab590 2023-10-18T19:37:27.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f9593bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c095f00 con 0x7f958c06aa30 2023-10-18T19:37:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f959119a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f959119a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57696/0 (socket says 172.21.15.88:57696) 2023-10-18T19:37:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f959119a700 1 -- 172.21.15.88:0/3695011630 learned_addr learned my addr 172.21.15.88:0/3695011630 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.449+0000 7f959199b700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c06a310 0x7f958c097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959219c700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f958c0ab590 0x7f958c096350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 -- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f958c0ab590 msgr2=0x7f958c096350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f958c0ab590 0x7f958c096350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 -- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c06a310 msgr2=0x7f958c097ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c06a310 0x7f958c097ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 -- 172.21.15.88:0/3695011630 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880092a0 con 0x7f958c06aa30 2023-10-18T19:37:27.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f959119a700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f957c00e8d0 tx=0x7f957c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c0094d0 con 0x7f958c06aa30 2023-10-18T19:37:27.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c012600 con 0x7f958c06aa30 2023-10-18T19:37:27.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c012980 con 0x7f958c06aa30 2023-10-18T19:37:27.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c094cf0 con 0x7f958c06aa30 2023-10-18T19:37:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.450+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c0946c0 con 0x7f958c06aa30 2023-10-18T19:37:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.452+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c05f270 con 0x7f958c06aa30 2023-10-18T19:37:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.452+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f957c012d30 con 0x7f958c06aa30 2023-10-18T19:37:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.453+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f957c055b50 con 0x7f958c06aa30 2023-10-18T19:37:27.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.456+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f957c035ff0 con 0x7f958c06aa30 2023-10-18T19:37:27.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.602+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f958c06a810 con 0x7f958c06aa30 2023-10-18T19:37:27.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.603+0000 7f9581ffb700 1 -- 172.21.15.88:0/3695011630 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11325 (secure 0 0 0) 0x7f957c0397e0 con 0x7f958c06aa30 2023-10-18T19:37:27.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:27.606 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":21,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:18.357291+0000","last_up_change":"2023-10-18T19:34:06.488799+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:27.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 >> v1:172.21.15.88:6800/113625 conn(0x7f9570041d10 legacy=0x7f95700441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 msgr2=0x7f958c14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f957c00e8d0 tx=0x7f957c009060).stop 2023-10-18T19:37:27.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 shutdown_connections 2023-10-18T19:37:27.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f958c0ab590 0x7f958c096350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c06a310 0x7f958c097ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 --2- 172.21.15.88:0/3695011630 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f958c06aa30 0x7f958c14c7c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 >> 172.21.15.88:0/3695011630 conn(0x7f958c05eb30 msgr2=0x7f958c135ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 shutdown_connections 2023-10-18T19:37:27.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.605+0000 7f9593bff700 1 -- 172.21.15.88:0/3695011630 wait complete. 2023-10-18T19:37:27.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-18T19:34:09.738627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T19:34:18.877868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T19:34:20.222147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-18T19:37:15.428276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2023-10-18T19:37:27.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T19:37:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.813+0000 7fa4bf3ff700 1 Processor -- start 2023-10-18T19:37:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.813+0000 7fa4bf3ff700 1 -- start start 2023-10-18T19:37:27.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bf3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4b80af970 0x7fa4b8138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bf3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 0x7fa4b813c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bf3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80afd50 con 0x7fa4b81390f0 2023-10-18T19:37:27.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bf3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80a3ff0 con 0x7fa4b80af970 2023-10-18T19:37:27.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bf3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81395d0 con 0x7fa4b80a4d00 2023-10-18T19:37:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bd19b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4b80af970 0x7fa4b8138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bc99a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 0x7fa4b813c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bd19b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4b80af970 0x7fa4b8138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36012/0 (socket says 172.21.15.88:36012) 2023-10-18T19:37:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bd19b700 1 -- 172.21.15.88:0/2868388231 learned_addr learned my addr 172.21.15.88:0/2868388231 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:27.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.814+0000 7fa4bd99c700 1 --1- 172.21.15.88:0/2868388231 >> v1:172.21.15.88:6789/0 conn(0x7fa4b81390f0 0x7fa4b813c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51092/0 (socket says 172.21.15.88:51092) 2023-10-18T19:37:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bd19b700 1 -- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 msgr2=0x7fa4b813c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bd19b700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 0x7fa4b813c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bd19b700 1 -- 172.21.15.88:0/2868388231 >> v1:172.21.15.88:6789/0 conn(0x7fa4b81390f0 legacy=0x7fa4b813c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bd19b700 1 -- 172.21.15.88:0/2868388231 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8139890 con 0x7fa4b80af970 2023-10-18T19:37:27.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4affff700 1 -- 172.21.15.88:0/2868388231 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942371683 0 0) 0x7fa4b80afd50 con 0x7fa4b81390f0 2023-10-18T19:37:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bc99a700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 0x7fa4b813c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4bd19b700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8138c00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa4b4006fd0 tx=0x7fa4b40090f0).ready entity=mon.0 client_cookie=64fa78a95c295a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4affff700 1 -- 172.21.15.88:0/2868388231 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400b580 con 0x7fa4b80af970 2023-10-18T19:37:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4affff700 1 -- 172.21.15.88:0/2868388231 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400b6e0 con 0x7fa4b80af970 2023-10-18T19:37:27.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.815+0000 7fa4affff700 1 -- 172.21.15.88:0/2868388231 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ba60 con 0x7fa4b80af970 2023-10-18T19:37:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 msgr2=0x7fa4b8138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8138c00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa4b4006fd0 tx=0x7fa4b40090f0).stop 2023-10-18T19:37:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/2868388231 shutdown_connections 2023-10-18T19:37:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8138c00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/2868388231 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b80a4d00 0x7fa4b813c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/2868388231 >> 172.21.15.88:0/2868388231 conn(0x7fa4b805eb60 msgr2=0x7fa4b80af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/2868388231 shutdown_connections 2023-10-18T19:37:27.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.816+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/2868388231 wait complete. 2023-10-18T19:37:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.817+0000 7fa4bf3ff700 1 Processor -- start 2023-10-18T19:37:27.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.817+0000 7fa4bf3ff700 1 -- start start 2023-10-18T19:37:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 0x7fa4b81488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8148da0 con 0x7fa4b80af970 2023-10-18T19:37:27.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80a94b0 con 0x7fa4b81390f0 2023-10-18T19:37:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bf3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80a9750 con 0x7fa4b80a4d00 2023-10-18T19:37:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bd99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bd19b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 0x7fa4b81488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bc99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:27.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bd99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40532/0 (socket says 172.21.15.88:40532) 2023-10-18T19:37:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bd19b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 0x7fa4b81488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57712/0 (socket says 172.21.15.88:57712) 2023-10-18T19:37:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.818+0000 7fa4bd99c700 1 -- 172.21.15.88:0/3573285088 learned_addr learned my addr 172.21.15.88:0/3573285088 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 -- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 msgr2=0x7fa4b81488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 0x7fa4b81488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 -- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 msgr2=0x7fa4b8149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 -- 172.21.15.88:0/3573285088 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80092a0 con 0x7fa4b81390f0 2023-10-18T19:37:27.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bd99c700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa4b000c810 tx=0x7fa4b00014d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0005c70 con 0x7fa4b81390f0 2023-10-18T19:37:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0005df0 con 0x7fa4b81390f0 2023-10-18T19:37:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0007320 con 0x7fa4b81390f0 2023-10-18T19:37:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b4009370 con 0x7fa4b81390f0 2023-10-18T19:37:27.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.819+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80a8b40 con 0x7fa4b81390f0 2023-10-18T19:37:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.820+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b805f270 con 0x7fa4b81390f0 2023-10-18T19:37:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.821+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fa4b00076d0 con 0x7fa4b81390f0 2023-10-18T19:37:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.821+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fa4b00551d0 con 0x7fa4b81390f0 2023-10-18T19:37:27.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.825+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa4b0035570 con 0x7fa4b81390f0 2023-10-18T19:37:27.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.969+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4b80af020 con 0x7fa4b81390f0 2023-10-18T19:37:27.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.970+0000 7fa4ad7fa700 1 -- 172.21.15.88:0/3573285088 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa4b0038d60 con 0x7fa4b81390f0 2023-10-18T19:37:27.973 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-10-18T19:37:27.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.971+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 >> v1:172.21.15.88:6800/113625 conn(0x7fa49c041ce0 legacy=0x7fa49c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.971+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 msgr2=0x7fa4b80ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.971+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa4b000c810 tx=0x7fa4b00014d0).stop 2023-10-18T19:37:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 shutdown_connections 2023-10-18T19:37:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa4b81390f0 0x7fa4b80ab190 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa4b80a4d00 0x7fa4b81488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 --2- 172.21.15.88:0/3573285088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4b80af970 0x7fa4b8149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:27.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 >> 172.21.15.88:0/3573285088 conn(0x7fa4b805eb60 msgr2=0x7fa4b80a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:27.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 shutdown_connections 2023-10-18T19:37:27.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:27.972+0000 7fa4bf3ff700 1 -- 172.21.15.88:0/3573285088 wait complete. 2023-10-18T19:37:27.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T19:37:28.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.182+0000 7f2d1e5ff700 1 Processor -- start 2023-10-18T19:37:28.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.183+0000 7f2d1e5ff700 1 -- start start 2023-10-18T19:37:28.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.183+0000 7f2d1e5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.183+0000 7f2d1e5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 0x7f2d180af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d1e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d18138180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d1e5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180a3940 con 0x7f2d180a14a0 2023-10-18T19:37:28.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d1e5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a46b0 con 0x7f2d180a3560 2023-10-18T19:37:28.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d1e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a1020 con 0x7f2d18137cf0 2023-10-18T19:37:28.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d177fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 0x7f2d180af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40536/0 (socket says 172.21.15.88:40536) 2023-10-18T19:37:28.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 -- 172.21.15.88:0/139062183 learned_addr learned my addr 172.21.15.88:0/139062183 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d1cb9c700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d18138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 -- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 msgr2=0x7f2d18138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:28.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d18138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 -- 172.21.15.88:0/139062183 >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 msgr2=0x7f2d180af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:28.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 --2- 172.21.15.88:0/139062183 >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 0x7f2d180af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 -- 172.21.15.88:0/139062183 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180a4900 con 0x7f2d180a3560 2023-10-18T19:37:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d177fe700 1 --2- 172.21.15.88:0/139062183 >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 0x7f2d180af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.184+0000 7f2d17fff700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2d08009810 tx=0x7f2d08009060).ready entity=mon.1 client_cookie=46089a38a568cc44 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d16ffd700 1 -- 172.21.15.88:0/139062183 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08005880 con 0x7f2d180a3560 2023-10-18T19:37:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d16ffd700 1 -- 172.21.15.88:0/139062183 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d080059e0 con 0x7f2d180a3560 2023-10-18T19:37:28.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d16ffd700 1 -- 172.21.15.88:0/139062183 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08005d60 con 0x7f2d180a3560 2023-10-18T19:37:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 msgr2=0x7f2d180a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2d08009810 tx=0x7f2d08009060).stop 2023-10-18T19:37:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/139062183 shutdown_connections 2023-10-18T19:37:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d18138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/139062183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a2c40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/139062183 >> v2:172.21.15.88:3300/0 conn(0x7f2d180a14a0 0x7f2d180af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/139062183 >> 172.21.15.88:0/139062183 conn(0x7f2d18064b70 msgr2=0x7f2d18062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:28.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/139062183 shutdown_connections 2023-10-18T19:37:28.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.185+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/139062183 wait complete. 2023-10-18T19:37:28.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.187+0000 7f2d1e5ff700 1 Processor -- start 2023-10-18T19:37:28.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.187+0000 7f2d1e5ff700 1 -- start start 2023-10-18T19:37:28.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d180a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a81d0 con 0x7f2d180a14a0 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a93c0 con 0x7f2d180a3560 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a83c0 con 0x7f2d18137cf0 2023-10-18T19:37:28.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d177fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d1cb9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d180a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36030/0 (socket says 172.21.15.88:36030) 2023-10-18T19:37:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d177fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40538/0 (socket says 172.21.15.88:40538) 2023-10-18T19:37:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 -- 172.21.15.88:0/3844880010 learned_addr learned my addr 172.21.15.88:0/3844880010 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 -- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 msgr2=0x7f2d180a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d180a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 -- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 msgr2=0x7f2d180a7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 -- 172.21.15.88:0/3844880010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0092a0 con 0x7f2d180a14a0 2023-10-18T19:37:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.188+0000 7f2d17fff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2d0800b350 tx=0x7f2d08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.189+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800b590 con 0x7f2d180a14a0 2023-10-18T19:37:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.189+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800b6f0 con 0x7f2d180a14a0 2023-10-18T19:37:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.189+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800bab0 con 0x7f2d180a14a0 2023-10-18T19:37:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.189+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08009300 con 0x7f2d180a14a0 2023-10-18T19:37:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.189+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d180a9850 con 0x7f2d180a14a0 2023-10-18T19:37:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.190+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d180a96a0 con 0x7f2d180a14a0 2023-10-18T19:37:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.190+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f2d08026670 con 0x7f2d180a14a0 2023-10-18T19:37:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.191+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f2d08056e70 con 0x7f2d180a14a0 2023-10-18T19:37:28.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.194+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2d0803ac80 con 0x7f2d180a14a0 2023-10-18T19:37:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.340+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d1805f270 con 0x7f2d180a14a0 2023-10-18T19:37:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.341+0000 7f2cfffff700 1 -- 172.21.15.88:0/3844880010 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d0803ac80 con 0x7f2d180a14a0 2023-10-18T19:37:28.344 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:37:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 >> v1:172.21.15.88:6800/113625 conn(0x7f2d04041ce0 legacy=0x7f2d040441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 msgr2=0x7f2d1813c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2d0800b350 tx=0x7f2d08016000).stop 2023-10-18T19:37:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 shutdown_connections 2023-10-18T19:37:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2d18137cf0 0x7f2d180a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d180a14a0 0x7f2d1813c020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 --2- 172.21.15.88:0/3844880010 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2d180a3560 0x7f2d180a7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.342+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 >> 172.21.15.88:0/3844880010 conn(0x7f2d18064b70 msgr2=0x7f2d18137260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:28.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.343+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 shutdown_connections 2023-10-18T19:37:28.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.343+0000 7f2d1e5ff700 1 -- 172.21.15.88:0/3844880010 wait complete. 2023-10-18T19:37:28.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T19:37:28.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.553+0000 7fd59bbff700 1 Processor -- start 2023-10-18T19:37:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.553+0000 7fd59bbff700 1 -- start start 2023-10-18T19:37:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59bbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5940a3560 0x7fd5940a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59bbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59bbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940a3940 con 0x7fd594137cf0 2023-10-18T19:37:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59bbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5940a46b0 con 0x7fd5940a3560 2023-10-18T19:37:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59bbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940a1020 con 0x7fd5940a14a0 2023-10-18T19:37:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59999b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5940a3560 0x7fd5940a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59919a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59999b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5940a3560 0x7fd5940a2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36038/0 (socket says 172.21.15.88:36038) 2023-10-18T19:37:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59919a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57732/0 (socket says 172.21.15.88:57732) 2023-10-18T19:37:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59999b700 1 -- 172.21.15.88:0/3561011227 learned_addr learned my addr 172.21.15.88:0/3561011227 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.554+0000 7fd59a19c700 1 --1- 172.21.15.88:0/3561011227 >> v1:172.21.15.88:6789/0 conn(0x7fd594137cf0 0x7fd594138180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51096/0 (socket says 172.21.15.88:51096) 2023-10-18T19:37:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59999b700 1 -- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 msgr2=0x7fd5940af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59999b700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59999b700 1 -- 172.21.15.88:0/3561011227 >> v1:172.21.15.88:6789/0 conn(0x7fd594137cf0 legacy=0x7fd594138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59999b700 1 -- 172.21.15.88:0/3561011227 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940a4900 con 0x7fd5940a3560 2023-10-18T19:37:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59919a700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd598999700 1 -- 172.21.15.88:0/3561011227 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811212630 0 0) 0x7fd5940a3940 con 0x7fd594137cf0 2023-10-18T19:37:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59999b700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5940a3560 0x7fd5940a2c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd590009810 tx=0x7fd590009060).ready entity=mon.0 client_cookie=77cd403629323663 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd598999700 1 -- 172.21.15.88:0/3561011227 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590005880 con 0x7fd5940a3560 2023-10-18T19:37:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd598999700 1 -- 172.21.15.88:0/3561011227 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5900059e0 con 0x7fd5940a3560 2023-10-18T19:37:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd598999700 1 -- 172.21.15.88:0/3561011227 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590005d60 con 0x7fd5940a3560 2023-10-18T19:37:28.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.555+0000 7fd59bbff700 1 -- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5940a3560 msgr2=0x7fd5940a2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5940a3560 0x7fd5940a2c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd590009810 tx=0x7fd590009060).stop 2023-10-18T19:37:28.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 -- 172.21.15.88:0/3561011227 shutdown_connections 2023-10-18T19:37:28.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5940a3560 0x7fd5940a2c40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 --2- 172.21.15.88:0/3561011227 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a14a0 0x7fd5940af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 -- 172.21.15.88:0/3561011227 >> 172.21.15.88:0/3561011227 conn(0x7fd594064b70 msgr2=0x7fd594062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:28.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 -- 172.21.15.88:0/3561011227 shutdown_connections 2023-10-18T19:37:28.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.556+0000 7fd59bbff700 1 -- 172.21.15.88:0/3561011227 wait complete. 2023-10-18T19:37:28.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.557+0000 7fd59bbff700 1 Processor -- start 2023-10-18T19:37:28.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.557+0000 7fd59bbff700 1 -- start start 2023-10-18T19:37:28.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd594137cf0 0x7fd59414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940ab9b0 con 0x7fd594137cf0 2023-10-18T19:37:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940ac140 con 0x7fd5940a14a0 2023-10-18T19:37:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59bbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940abbb0 con 0x7fd5940a3560 2023-10-18T19:37:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59919a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59999b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59a19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd594137cf0 0x7fd59414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59919a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57746/0 (socket says 172.21.15.88:57746) 2023-10-18T19:37:28.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59999b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40546/0 (socket says 172.21.15.88:40546) 2023-10-18T19:37:28.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.558+0000 7fd59919a700 1 -- 172.21.15.88:0/2541301603 learned_addr learned my addr 172.21.15.88:0/2541301603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 -- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 msgr2=0x7fd5941490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 -- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd594137cf0 msgr2=0x7fd59414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd594137cf0 0x7fd59414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 -- 172.21.15.88:0/2541301603 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840092a0 con 0x7fd5940a14a0 2023-10-18T19:37:28.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59919a700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:28.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59999b700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd590013000 tx=0x7fd590016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59001f070 con 0x7fd5940a14a0 2023-10-18T19:37:28.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5900067c0 con 0x7fd5940a14a0 2023-10-18T19:37:28.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590009300 con 0x7fd5940a14a0 2023-10-18T19:37:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000ba30 con 0x7fd5940a14a0 2023-10-18T19:37:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.559+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940a9970 con 0x7fd5940a14a0 2023-10-18T19:37:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.560+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59405f270 con 0x7fd5940a14a0 2023-10-18T19:37:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.560+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fd590018070 con 0x7fd5940a14a0 2023-10-18T19:37:28.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.561+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fd590055d40 con 0x7fd5940a14a0 2023-10-18T19:37:28.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.564+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fd590039a10 con 0x7fd5940a14a0 2023-10-18T19:37:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.708+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5940a4bc0 con 0x7fd5940a14a0 2023-10-18T19:37:28.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.709+0000 7fd589ffb700 1 -- 172.21.15.88:0/2541301603 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd590039a10 con 0x7fd5940a14a0 2023-10-18T19:37:28.713 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-10-18T19:37:28.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 >> v1:172.21.15.88:6800/113625 conn(0x7fd578041d10 legacy=0x7fd5780441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 msgr2=0x7fd594148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd590013000 tx=0x7fd590016000).stop 2023-10-18T19:37:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 shutdown_connections 2023-10-18T19:37:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd594137cf0 0x7fd59414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5940a14a0 0x7fd594148bf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 --2- 172.21.15.88:0/2541301603 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd5940a3560 0x7fd5941490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 >> 172.21.15.88:0/2541301603 conn(0x7fd594064b70 msgr2=0x7fd5940ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:28.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 shutdown_connections 2023-10-18T19:37:28.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.711+0000 7fd59bbff700 1 -- 172.21.15.88:0/2541301603 wait complete. 2023-10-18T19:37:28.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-18T19:37:28.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.921+0000 7fac07bff700 1 Processor -- start 2023-10-18T19:37:28.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.921+0000 7fac07bff700 1 -- start start 2023-10-18T19:37:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0005ed40 con 0x7fac0013cb80 2023-10-18T19:37:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000a4260 con 0x7fac000a0270 2023-10-18T19:37:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac07bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0009f770 con 0x7fac0005e960 2023-10-18T19:37:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0519a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0619c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0519a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36046/0 (socket says 172.21.15.88:36046) 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0519a700 1 -- 172.21.15.88:0/741178769 learned_addr learned my addr 172.21.15.88:0/741178769 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57756/0 (socket says 172.21.15.88:57756) 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0619c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40548/0 (socket says 172.21.15.88:40548) 2023-10-18T19:37:28.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 -- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 msgr2=0x7fac00138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 -- 172.21.15.88:0/741178769 >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 msgr2=0x7fac0009fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 --2- 172.21.15.88:0/741178769 >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0599b700 1 -- 172.21.15.88:0/741178769 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000a1620 con 0x7fac0005e960 2023-10-18T19:37:28.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0519a700 1 --2- 172.21.15.88:0/741178769 >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.922+0000 7fac0619c700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac0599b700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fabfc009760 tx=0x7fabfc009060).ready entity=mon.2 client_cookie=915f216cb39c8f85 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac04999700 1 -- 172.21.15.88:0/741178769 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0090d0 con 0x7fac0005e960 2023-10-18T19:37:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac04999700 1 -- 172.21.15.88:0/741178769 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00d4a0 con 0x7fac0005e960 2023-10-18T19:37:28.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac04999700 1 -- 172.21.15.88:0/741178769 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00d820 con 0x7fac0005e960 2023-10-18T19:37:28.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 -- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 msgr2=0x7fac0013c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fabfc009760 tx=0x7fabfc009060).stop 2023-10-18T19:37:28.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 -- 172.21.15.88:0/741178769 shutdown_connections 2023-10-18T19:37:28.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac0005e960 0x7fac0013c690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 --2- 172.21.15.88:0/741178769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac000a0270 0x7fac00138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 --2- 172.21.15.88:0/741178769 >> v2:172.21.15.88:3300/0 conn(0x7fac0013cb80 0x7fac0009fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.923+0000 7fac07bff700 1 -- 172.21.15.88:0/741178769 >> 172.21.15.88:0/741178769 conn(0x7fac00064b80 msgr2=0x7fac0005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:28.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.924+0000 7fac07bff700 1 -- 172.21.15.88:0/741178769 shutdown_connections 2023-10-18T19:37:28.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.924+0000 7fac07bff700 1 -- 172.21.15.88:0/741178769 wait complete. 2023-10-18T19:37:28.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.925+0000 7fac07bff700 1 Processor -- start 2023-10-18T19:37:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.925+0000 7fac07bff700 1 -- start start 2023-10-18T19:37:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac0005e960 0x7fac000949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac0013cb80 0x7fac00093720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:28.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000abfb0 con 0x7fac0005e960 2023-10-18T19:37:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac00148b60 con 0x7fac0013cb80 2023-10-18T19:37:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac07bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac00094eb0 con 0x7fac000a0270 2023-10-18T19:37:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0599b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac0005e960 0x7fac000949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57770/0 (socket says 172.21.15.88:57770) 2023-10-18T19:37:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 -- 172.21.15.88:0/2143854155 learned_addr learned my addr 172.21.15.88:0/2143854155 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0619c700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac0013cb80 0x7fac00093720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 -- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac0013cb80 msgr2=0x7fac00093720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac0013cb80 0x7fac00093720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 -- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac0005e960 msgr2=0x7fac000949c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac0005e960 0x7fac000949c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 -- 172.21.15.88:0/2143854155 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8009a20 con 0x7fac000a0270 2023-10-18T19:37:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.926+0000 7fac0519a700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fabf000ec50 tx=0x7fabf00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.927+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000c850 con 0x7fac000a0270 2023-10-18T19:37:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.927+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf000c9b0 con 0x7fac000a0270 2023-10-18T19:37:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.927+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0009370 con 0x7fac000a0270 2023-10-18T19:37:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.927+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000cd30 con 0x7fac000a0270 2023-10-18T19:37:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.927+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc0092a0 con 0x7fac000a0270 2023-10-18T19:37:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.928+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00092c40 con 0x7fac000a0270 2023-10-18T19:37:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.928+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fabf0012600 con 0x7fac000a0270 2023-10-18T19:37:28.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.929+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fabf0055dc0 con 0x7fac000a0270 2023-10-18T19:37:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:28.932+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fabf00363d0 con 0x7fac000a0270 2023-10-18T19:37:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.080+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fac000a5430 con 0x7fac000a0270 2023-10-18T19:37:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.081+0000 7fabf5ffb700 1 -- 172.21.15.88:0/2143854155 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fabf0016020 con 0x7fac000a0270 2023-10-18T19:37:29.084 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-10-18T19:37:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 >> v1:172.21.15.88:6800/113625 conn(0x7fabe4041ce0 legacy=0x7fabe40441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 msgr2=0x7fac00092f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fabf000ec50 tx=0x7fabf00090f0).stop 2023-10-18T19:37:29.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 shutdown_connections 2023-10-18T19:37:29.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fac0013cb80 0x7fac00093720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac0005e960 0x7fac000949c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 --2- 172.21.15.88:0/2143854155 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fac000a0270 0x7fac00092f20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 >> 172.21.15.88:0/2143854155 conn(0x7fac00064b80 msgr2=0x7fac000ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:29.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 shutdown_connections 2023-10-18T19:37:29.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.083+0000 7fac07bff700 1 -- 172.21.15.88:0/2143854155 wait complete. 2023-10-18T19:37:29.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:37:29.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.288+0000 7fb7317ff700 1 Processor -- start 2023-10-18T19:37:29.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.288+0000 7fb7317ff700 1 -- start start 2023-10-18T19:37:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb7317ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 0x7fb72c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb7317ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb7317ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c0afd50 con 0x7fb72c0a4c50 2023-10-18T19:37:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb7317ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c0a47a0 con 0x7fb72c0af970 2023-10-18T19:37:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb7317ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c0a3a10 con 0x7fb72c0a1790 2023-10-18T19:37:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb72a7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb72a7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40570/0 (socket says 172.21.15.88:40570) 2023-10-18T19:37:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb72a7fc700 1 -- 172.21.15.88:0/985000983 learned_addr learned my addr 172.21.15.88:0/985000983 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb72b7fe700 1 --1- 172.21.15.88:0/985000983 >> v1:172.21.15.88:6789/0 conn(0x7fb72c0a4c50 0x7fb72c13bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51106/0 (socket says 172.21.15.88:51106) 2023-10-18T19:37:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.289+0000 7fb72affd700 1 --2- 172.21.15.88:0/985000983 >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 0x7fb72c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72a7fc700 1 -- 172.21.15.88:0/985000983 >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 msgr2=0x7fb72c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72a7fc700 1 --2- 172.21.15.88:0/985000983 >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 0x7fb72c135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb729ffb700 1 -- 172.21.15.88:0/985000983 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796533460 0 0) 0x7fb72c0afd50 con 0x7fb72c0a4c50 2023-10-18T19:37:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72a7fc700 1 -- 172.21.15.88:0/985000983 >> v1:172.21.15.88:6789/0 conn(0x7fb72c0a4c50 legacy=0x7fb72c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72a7fc700 1 -- 172.21.15.88:0/985000983 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c0a32d0 con 0x7fb72c0a1790 2023-10-18T19:37:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72affd700 1 --2- 172.21.15.88:0/985000983 >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 0x7fb72c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb72a7fc700 1 --2- 172.21.15.88:0/985000983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb720006fd0 tx=0x7fb7200090f0).ready entity=mon.1 client_cookie=f4c3000e0968fb3f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb729ffb700 1 -- 172.21.15.88:0/985000983 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000b580 con 0x7fb72c0a1790 2023-10-18T19:37:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb729ffb700 1 -- 172.21.15.88:0/985000983 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000b6e0 con 0x7fb72c0a1790 2023-10-18T19:37:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.290+0000 7fb729ffb700 1 -- 172.21.15.88:0/985000983 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000ba60 con 0x7fb72c0a1790 2023-10-18T19:37:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 -- 172.21.15.88:0/985000983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 msgr2=0x7fb72c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 --2- 172.21.15.88:0/985000983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb720006fd0 tx=0x7fb7200090f0).stop 2023-10-18T19:37:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 -- 172.21.15.88:0/985000983 shutdown_connections 2023-10-18T19:37:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 --2- 172.21.15.88:0/985000983 >> v2:172.21.15.88:3300/0 conn(0x7fb72c0af970 0x7fb72c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 --2- 172.21.15.88:0/985000983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a1790 0x7fb72c136220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 -- 172.21.15.88:0/985000983 >> 172.21.15.88:0/985000983 conn(0x7fb72c05eb60 msgr2=0x7fb72c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 -- 172.21.15.88:0/985000983 shutdown_connections 2023-10-18T19:37:29.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.291+0000 7fb7317ff700 1 -- 172.21.15.88:0/985000983 wait complete. 2023-10-18T19:37:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.292+0000 7fb7317ff700 1 Processor -- start 2023-10-18T19:37:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.292+0000 7fb7317ff700 1 -- start start 2023-10-18T19:37:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 0x7fb72c0ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb72c0af970 0x7fb72c148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c091a50 con 0x7fb72c0a1790 2023-10-18T19:37:29.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c149180 con 0x7fb72c0a4c50 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb7317ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c149440 con 0x7fb72c0af970 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb72affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb72a7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 0x7fb72c0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb72affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36076/0 (socket says 172.21.15.88:36076) 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb72affd700 1 -- 172.21.15.88:0/3839828787 learned_addr learned my addr 172.21.15.88:0/3839828787 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:29.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.293+0000 7fb72b7fe700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb72c0af970 0x7fb72c148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 -- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb72c0af970 msgr2=0x7fb72c148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb72c0af970 0x7fb72c148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 -- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 msgr2=0x7fb72c0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 0x7fb72c0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 -- 172.21.15.88:0/3839828787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0092a0 con 0x7fb72c0a1790 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72a7fc700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 0x7fb72c0ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb72affd700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb71c00e980 tx=0x7fb71c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c012600 con 0x7fb72c0a1790 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c012760 con 0x7fb72c0a1790 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c012ae0 con 0x7fb72c0a1790 2023-10-18T19:37:29.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720009370 con 0x7fb72c0a1790 2023-10-18T19:37:29.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.294+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c091ee0 con 0x7fb72c0a1790 2023-10-18T19:37:29.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.295+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c05f270 con 0x7fb72c0a1790 2023-10-18T19:37:29.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.296+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb71c01b400 con 0x7fb72c0a1790 2023-10-18T19:37:29.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.296+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fb71c055ce0 con 0x7fb72c0a1790 2023-10-18T19:37:29.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.299+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb71c036020 con 0x7fb72c0a1790 2023-10-18T19:37:29.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.473+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb72c0a3010 con 0x7fb72c0a1790 2023-10-18T19:37:29.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.474+0000 7fb712ffd700 1 -- 172.21.15.88:0/3839828787 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3553 (secure 0 0 0) 0x7fb71c039810 con 0x7fb72c0a1790 2023-10-18T19:37:29.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:29.477 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6819/1711023327","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":1711023327}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T19:34:21.213099+0000","modified":"2023-10-18T19:35:17.635104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:37:29.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.475+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 >> v1:172.21.15.88:6800/113625 conn(0x7fb718041d10 legacy=0x7fb7180441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.475+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 msgr2=0x7fb72c0aaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.475+0000 7fb7317ff700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb71c00e980 tx=0x7fb71c009060).stop 2023-10-18T19:37:29.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 shutdown_connections 2023-10-18T19:37:29.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb72c0af970 0x7fb72c148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb72c0a1790 0x7fb72c0aaf00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 --2- 172.21.15.88:0/3839828787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb72c0a4c50 0x7fb72c0ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 >> 172.21.15.88:0/3839828787 conn(0x7fb72c05eb60 msgr2=0x7fb72c062c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:29.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 shutdown_connections 2023-10-18T19:37:29.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.476+0000 7fb7317ff700 1 -- 172.21.15.88:0/3839828787 wait complete. 2023-10-18T19:37:29.481 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2023-10-18T19:37:29.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.681+0000 7f413e9ff700 1 Processor -- start 2023-10-18T19:37:29.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.681+0000 7f413e9ff700 1 -- start start 2023-10-18T19:37:29.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41380afd50 con 0x7f41380a4c50 2023-10-18T19:37:29.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41380a47a0 con 0x7f41380af970 2023-10-18T19:37:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.682+0000 7f413e9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41380a3a10 con 0x7f41380a1790 2023-10-18T19:37:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f41377fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f413cf9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f413cf9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36080/0 (socket says 172.21.15.88:36080) 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f413cf9c700 1 -- 172.21.15.88:0/1720336938 learned_addr learned my addr 172.21.15.88:0/1720336938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40578/0 (socket says 172.21.15.88:40578) 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f41377fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57780/0 (socket says 172.21.15.88:57780) 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 -- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 msgr2=0x7f4138136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 --2- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 -- 172.21.15.88:0/1720336938 >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 msgr2=0x7f413813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:29.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 --2- 172.21.15.88:0/1720336938 >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 -- 172.21.15.88:0/1720336938 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380a32d0 con 0x7f41380af970 2023-10-18T19:37:29.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f413cf9c700 1 --2- 172.21.15.88:0/1720336938 >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:29.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.683+0000 7f4137fff700 1 --2- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4128009760 tx=0x7f4128009060).ready entity=mon.1 client_cookie=c38e601a6258f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:29.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f4136ffd700 1 -- 172.21.15.88:0/1720336938 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800d4a0 con 0x7f41380af970 2023-10-18T19:37:29.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f4136ffd700 1 -- 172.21.15.88:0/1720336938 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412800d600 con 0x7f41380af970 2023-10-18T19:37:29.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f4136ffd700 1 -- 172.21.15.88:0/1720336938 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800d980 con 0x7f41380af970 2023-10-18T19:37:29.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 -- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 msgr2=0x7f4138135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4128009760 tx=0x7f4128009060).stop 2023-10-18T19:37:29.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 -- 172.21.15.88:0/1720336938 shutdown_connections 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1720336938 >> v2:172.21.15.88:3300/0 conn(0x7f41380a4c50 0x7f413813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380af970 0x7f4138135d30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1720336938 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 -- 172.21.15.88:0/1720336938 >> 172.21.15.88:0/1720336938 conn(0x7f413805eb60 msgr2=0x7f41380af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 -- 172.21.15.88:0/1720336938 shutdown_connections 2023-10-18T19:37:29.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.684+0000 7f413e9ff700 1 -- 172.21.15.88:0/1720336938 wait complete. 2023-10-18T19:37:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.685+0000 7f413e9ff700 1 Processor -- start 2023-10-18T19:37:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 -- start start 2023-10-18T19:37:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41380af970 0x7f4138148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380a8b60 con 0x7f41380af970 2023-10-18T19:37:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41380a9900 con 0x7f41380a4c50 2023-10-18T19:37:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.686+0000 7f413e9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4138149060 con 0x7f41380a1790 2023-10-18T19:37:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f4137fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40580/0 (socket says 172.21.15.88:40580) 2023-10-18T19:37:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f4137fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138091a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57792/0 (socket says 172.21.15.88:57792) 2023-10-18T19:37:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 -- 172.21.15.88:0/1595649913 learned_addr learned my addr 172.21.15.88:0/1595649913 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f413cf9c700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41380af970 0x7f4138148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:29.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 -- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 msgr2=0x7f4138091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 -- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41380af970 msgr2=0x7f4138148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41380af970 0x7f4138148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 -- 172.21.15.88:0/1595649913 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130009ae0 con 0x7f41380a4c50 2023-10-18T19:37:29.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f41377fe700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f412c00e900 tx=0x7f412c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c012600 con 0x7f41380a4c50 2023-10-18T19:37:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c012760 con 0x7f41380a4c50 2023-10-18T19:37:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280092a0 con 0x7f41380a4c50 2023-10-18T19:37:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.687+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c012ae0 con 0x7f41380a4c50 2023-10-18T19:37:29.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.688+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41380abed0 con 0x7f41380a4c50 2023-10-18T19:37:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.689+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f412c01b400 con 0x7f41380a4c50 2023-10-18T19:37:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.689+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413805f270 con 0x7f41380a4c50 2023-10-18T19:37:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.689+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f412c055c60 con 0x7f41380a4c50 2023-10-18T19:37:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.693+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f412c036170 con 0x7f41380a4c50 2023-10-18T19:37:29.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.839+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41380a3010 con 0x7f41380a4c50 2023-10-18T19:37:29.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.839+0000 7f411ffff700 1 -- 172.21.15.88:0/1595649913 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11325 (secure 0 0 0) 0x7f412c016070 con 0x7f41380a4c50 2023-10-18T19:37:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:29.843 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":21,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:18.357291+0000","last_up_change":"2023-10-18T19:34:06.488799+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 >> v1:172.21.15.88:6800/113625 conn(0x7f4124041d10 legacy=0x7f41240441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 msgr2=0x7f4138148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f412c00e900 tx=0x7f412c009060).stop 2023-10-18T19:37:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 shutdown_connections 2023-10-18T19:37:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41380af970 0x7f4138148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f41380a1790 0x7f4138091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 --2- 172.21.15.88:0/1595649913 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f41380a4c50 0x7f4138148160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 >> 172.21.15.88:0/1595649913 conn(0x7f413805eb60 msgr2=0x7f4138137070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 shutdown_connections 2023-10-18T19:37:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:29.841+0000 7f413e9ff700 1 -- 172.21.15.88:0/1595649913 wait complete. 2023-10-18T19:37:29.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T19:37:30.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.046+0000 7f43fe9ff700 1 Processor -- start 2023-10-18T19:37:30.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.046+0000 7f43fe9ff700 1 -- start start 2023-10-18T19:37:30.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f80a0fc0 con 0x7f43f80af1e0 2023-10-18T19:37:30.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f80af5c0 con 0x7f43f80a13d0 2023-10-18T19:37:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.047+0000 7f43fe9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8136620 con 0x7f43f8135cb0 2023-10-18T19:37:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36100/0 (socket says 172.21.15.88:36100) 2023-10-18T19:37:30.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57804/0 (socket says 172.21.15.88:57804) 2023-10-18T19:37:30.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40584/0 (socket says 172.21.15.88:40584) 2023-10-18T19:37:30.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 -- 172.21.15.88:0/396740711 learned_addr learned my addr 172.21.15.88:0/396740711 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:30.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 -- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 msgr2=0x7f43f80a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 -- 172.21.15.88:0/396740711 >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 msgr2=0x7f43f80ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 --2- 172.21.15.88:0/396740711 >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 -- 172.21.15.88:0/396740711 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80a4980 con 0x7f43f8135cb0 2023-10-18T19:37:30.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f77fe700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f7fff700 1 --2- 172.21.15.88:0/396740711 >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43fcf9c700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43f0009f50 tx=0x7f43f0009840).ready entity=mon.2 client_cookie=878896b2129afc05 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.048+0000 7f43f6ffd700 1 -- 172.21.15.88:0/396740711 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000e070 con 0x7f43f8135cb0 2023-10-18T19:37:30.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43f6ffd700 1 -- 172.21.15.88:0/396740711 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f000b9a0 con 0x7f43f8135cb0 2023-10-18T19:37:30.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43f6ffd700 1 -- 172.21.15.88:0/396740711 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000bd20 con 0x7f43f8135cb0 2023-10-18T19:37:30.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 -- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 msgr2=0x7f43f8136130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f43f0009f50 tx=0x7f43f0009840).stop 2023-10-18T19:37:30.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 -- 172.21.15.88:0/396740711 shutdown_connections 2023-10-18T19:37:30.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8136130 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/396740711 >> v2:172.21.15.88:3300/0 conn(0x7f43f80af1e0 0x7f43f80ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/396740711 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80a13d0 0x7f43f80a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 -- 172.21.15.88:0/396740711 >> 172.21.15.88:0/396740711 conn(0x7f43f8064d50 msgr2=0x7f43f8062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:30.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 -- 172.21.15.88:0/396740711 shutdown_connections 2023-10-18T19:37:30.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.049+0000 7f43fe9ff700 1 -- 172.21.15.88:0/396740711 wait complete. 2023-10-18T19:37:30.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.050+0000 7f43fe9ff700 1 Processor -- start 2023-10-18T19:37:30.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 -- start start 2023-10-18T19:37:30.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80a13d0 0x7f43f80a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f813c300 con 0x7f43f80a13d0 2023-10-18T19:37:30.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8148660 con 0x7f43f80af1e0 2023-10-18T19:37:30.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.051+0000 7f43fe9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43f8148920 con 0x7f43f8135cb0 2023-10-18T19:37:30.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43fcf9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40596/0 (socket says 172.21.15.88:40596) 2023-10-18T19:37:30.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 -- 172.21.15.88:0/2163452856 learned_addr learned my addr 172.21.15.88:0/2163452856 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:30.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43fcf9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57808/0 (socket says 172.21.15.88:57808) 2023-10-18T19:37:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f7fff700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80a13d0 0x7f43f80a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 -- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 msgr2=0x7f43f8147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 -- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80a13d0 msgr2=0x7f43f80a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80a13d0 0x7f43f80a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 -- 172.21.15.88:0/2163452856 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0092a0 con 0x7f43f80af1e0 2023-10-18T19:37:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43fcf9c700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43f77fe700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f43ec00e960 tx=0x7f43ec009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec012600 con 0x7f43f80af1e0 2023-10-18T19:37:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec012760 con 0x7f43f80af1e0 2023-10-18T19:37:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e80092a0 con 0x7f43f80af1e0 2023-10-18T19:37:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.052+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec012ae0 con 0x7f43f80af1e0 2023-10-18T19:37:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.053+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f0009ae0 con 0x7f43f80af1e0 2023-10-18T19:37:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.054+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f805f270 con 0x7f43f80af1e0 2023-10-18T19:37:30.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.054+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f43ec01b400 con 0x7f43f80af1e0 2023-10-18T19:37:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.055+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f43ec055bb0 con 0x7f43f80af1e0 2023-10-18T19:37:30.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.058+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f43ec05c080 con 0x7f43f80af1e0 2023-10-18T19:37:30.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.232+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43f80afef0 con 0x7f43f80af1e0 2023-10-18T19:37:30.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.232+0000 7f43dffff700 1 -- 172.21.15.88:0/2163452856 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3553 (secure 0 0 0) 0x7f43ec016020 con 0x7f43f80af1e0 2023-10-18T19:37:30.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:30.236 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6818/1355130271","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6818","nonce":1355130271}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.88:6819/1711023327","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6819","nonce":1711023327}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T19:34:21.213099+0000","modified":"2023-10-18T19:35:17.635104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4180},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4180":{"gid":4180,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6817/2557744719","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6817","nonce":2557744719}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-18T19:37:30.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 >> v1:172.21.15.88:6800/113625 conn(0x7f43e4041ce0 legacy=0x7f43e40441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 msgr2=0x7f43f813b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f43ec00e960 tx=0x7f43ec009060).stop 2023-10-18T19:37:30.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 shutdown_connections 2023-10-18T19:37:30.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f43f8135cb0 0x7f43f8147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43f80a13d0 0x7f43f80a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 --2- 172.21.15.88:0/2163452856 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43f80af1e0 0x7f43f813b0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 >> 172.21.15.88:0/2163452856 conn(0x7f43f8064d50 msgr2=0x7f43f805e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 shutdown_connections 2023-10-18T19:37:30.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.234+0000 7f43fe9ff700 1 -- 172.21.15.88:0/2163452856 wait complete. 2023-10-18T19:37:30.239 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 15 2023-10-18T19:37:30.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T19:34:21.213099+0000', 'modified': '2023-10-18T19:35:17.635104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4180}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4180': {'gid': 4180, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6817/2557744719', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.88:6817', 'nonce': 2557744719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-18T19:37:30.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T19:37:30.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T19:37:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.745+0000 7f19169ff700 1 Processor -- start 2023-10-18T19:37:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.746+0000 7f19169ff700 1 -- start start 2023-10-18T19:37:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.746+0000 7f19169ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f1910138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.746+0000 7f19169ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f1910143590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f19169ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19100af9c0 con 0x7f19100af5e0 2023-10-18T19:37:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f19169ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100a4010 con 0x7f19100a4ec0 2023-10-18T19:37:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f19169ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1910139c20 con 0x7f191009fdf0 2023-10-18T19:37:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f19100af5e0 0x7f1910139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51114/0 (socket says 172.21.15.88:51114) 2023-10-18T19:37:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190ffff700 1 -- 172.21.15.88:0/3076999186 learned_addr learned my addr 172.21.15.88:0/3076999186 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f1914f9c700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f1910143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190f7fe700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f1910138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190effd700 1 -- 172.21.15.88:0/3076999186 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300330794 0 0) 0x7f19100af9c0 con 0x7f19100af5e0 2023-10-18T19:37:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190effd700 1 -- 172.21.15.88:0/3076999186 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f80033f0 con 0x7f19100af5e0 2023-10-18T19:37:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f1914f9c700 1 -- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 msgr2=0x7f1910138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f1914f9c700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f1910138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f1914f9c700 1 -- 172.21.15.88:0/3076999186 >> v1:172.21.15.88:6789/0 conn(0x7f19100af5e0 legacy=0x7f1910139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f1914f9c700 1 -- 172.21.15.88:0/3076999186 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191009f700 con 0x7f191009fdf0 2023-10-18T19:37:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.747+0000 7f190f7fe700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f1910138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f1914f9c700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f1910143590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1908009e90 tx=0x7f1908009780).ready entity=mon.2 client_cookie=c53ea652133b6484 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f190effd700 1 -- 172.21.15.88:0/3076999186 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800e070 con 0x7f191009fdf0 2023-10-18T19:37:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f190effd700 1 -- 172.21.15.88:0/3076999186 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800ba50 con 0x7f191009fdf0 2023-10-18T19:37:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f190effd700 1 -- 172.21.15.88:0/3076999186 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800bdd0 con 0x7f191009fdf0 2023-10-18T19:37:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 -- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 msgr2=0x7f1910143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f1910143590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1908009e90 tx=0x7f1908009780).stop 2023-10-18T19:37:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 -- 172.21.15.88:0/3076999186 shutdown_connections 2023-10-18T19:37:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f1910143590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 --2- 172.21.15.88:0/3076999186 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f1910138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 -- 172.21.15.88:0/3076999186 >> 172.21.15.88:0/3076999186 conn(0x7f1910062a80 msgr2=0x7f1910062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.748+0000 7f19169ff700 1 -- 172.21.15.88:0/3076999186 shutdown_connections 2023-10-18T19:37:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.749+0000 7f19169ff700 1 -- 172.21.15.88:0/3076999186 wait complete. 2023-10-18T19:37:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.750+0000 7f19169ff700 1 Processor -- start 2023-10-18T19:37:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.751+0000 7f19169ff700 1 -- start start 2023-10-18T19:37:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.751+0000 7f19169ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f191013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f19169ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f19100a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f19169ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19100af5e0 0x7f19100a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f19169ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100a9710 con 0x7f19100af5e0 2023-10-18T19:37:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f19169ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19100aa020 con 0x7f19100a4ec0 2023-10-18T19:37:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f19169ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19100a71a0 con 0x7f191009fdf0 2023-10-18T19:37:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f19100a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f19100a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40618/0 (socket says 172.21.15.88:40618) 2023-10-18T19:37:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 -- 172.21.15.88:0/2189845845 learned_addr learned my addr 172.21.15.88:0/2189845845 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190ffff700 1 --2- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f191013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f1914f9c700 1 --2- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19100af5e0 0x7f19100a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 -- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 msgr2=0x7f191013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 --2- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f191009fdf0 0x7f191013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 -- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19100af5e0 msgr2=0x7f19100a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 --2- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19100af5e0 0x7f19100a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 -- 172.21.15.88:0/2189845845 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040092a0 con 0x7f19100a4ec0 2023-10-18T19:37:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.752+0000 7f190f7fe700 1 --2- 172.21.15.88:0/2189845845 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19100a4ec0 0x7f19100a5650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f190400e9a0 tx=0x7f1904009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.753+0000 7f18f7fff700 1 -- 172.21.15.88:0/2189845845 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190400c670 con 0x7f19100a4ec0 2023-10-18T19:37:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.753+0000 7f18f7fff700 1 -- 172.21.15.88:0/2189845845 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190400c7d0 con 0x7f19100a4ec0 2023-10-18T19:37:30.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.753+0000 7f19169ff700 1 -- 172.21.15.88:0/2189845845 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908009a20 con 0x7f19100a4ec0 2023-10-18T19:37:30.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.753+0000 7f18f7fff700 1 -- 172.21.15.88:0/2189845845 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190400cb50 con 0x7f19100a4ec0 2023-10-18T19:37:30.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.753+0000 7f19169ff700 1 -- 172.21.15.88:0/2189845845 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19100a6b70 con 0x7f19100a4ec0 2023-10-18T19:37:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.754+0000 7f18f7fff700 1 -- 172.21.15.88:0/2189845845 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f190401b400 con 0x7f19100a4ec0 2023-10-18T19:37:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.755+0000 7f18f7fff700 1 -- 172.21.15.88:0/2189845845 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f1904055dd0 con 0x7f19100a4ec0 2023-10-18T19:37:30.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.757+0000 7f192dcc8b80 1 Processor -- start 2023-10-18T19:37:30.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.757+0000 7f192dcc8b80 1 -- start start 2023-10-18T19:37:30.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 0x5608c3965690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3965b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c38bc7b0 con 0x5608c3967e80 2023-10-18T19:37:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608c3881900 con 0x5608c3966f10 2023-10-18T19:37:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x5608c3896bb0 con 0x5608c39459d0 2023-10-18T19:37:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 0x5608c3965690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f1914f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3965b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f190ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f190ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57836/0 (socket says 172.21.15.88:57836) 2023-10-18T19:37:30.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 0x5608c3965690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40626/0 (socket says 172.21.15.88:40626) 2023-10-18T19:37:30.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.758+0000 7f190ffff700 1 -- 172.21.15.88:0/1618875924 learned_addr learned my addr 172.21.15.88:0/1618875924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 -- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 msgr2=0x5608c3965690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 0x5608c3965690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 -- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 msgr2=0x5608c3965b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3965b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 -- 172.21.15.88:0/1618875924 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608c388fda0 con 0x5608c39459d0 2023-10-18T19:37:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f1914f9c700 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3965b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f190ffff700 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1900001af0 tx=0x7f1900007bd0).ready entity=mon.2 client_cookie=f886efb363adf573 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f18f57fa700 1 -- 172.21.15.88:0/1618875924 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011a00 con 0x5608c39459d0 2023-10-18T19:37:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f18f57fa700 1 -- 172.21.15.88:0/1618875924 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011b60 con 0x5608c39459d0 2023-10-18T19:37:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.759+0000 7f18f57fa700 1 -- 172.21.15.88:0/1618875924 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900015410 con 0x5608c39459d0 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 msgr2=0x5608c3966a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1900001af0 tx=0x7f1900007bd0).stop 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- 172.21.15.88:0/1618875924 shutdown_connections 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3965b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c39459d0 0x5608c3966a20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/1618875924 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c3966f10 0x5608c3965690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- 172.21.15.88:0/1618875924 >> 172.21.15.88:0/1618875924 conn(0x5608c3946820 msgr2=0x5608c3944830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- 172.21.15.88:0/1618875924 shutdown_connections 2023-10-18T19:37:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- 172.21.15.88:0/1618875924 wait complete. 2023-10-18T19:37:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.760+0000 7f192dcc8b80 1 -- start start 2023-10-18T19:37:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 Processor -- start 2023-10-18T19:37:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3969070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608c3896cf0 con 0x5608c3967e80 2023-10-18T19:37:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.761+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608c3896f70 con 0x5608c39459d0 2023-10-18T19:37:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f192dcc8b80 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x5608c38628b0 con 0x5608c3966f10 2023-10-18T19:37:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f192dcc8b80 10 client.0 ll_register_callbacks cb 0x5608c3905ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T19:37:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57846/0 (socket says 172.21.15.88:57846) 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40636/0 (socket says 172.21.15.88:40636) 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190f7fe700 1 -- 172.21.15.88:0/3466404100 learned_addr learned my addr 172.21.15.88:0/3466404100 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f1914f9c700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3969070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 -- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 msgr2=0x5608c3968b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 -- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 msgr2=0x5608c3969070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3969070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 -- 172.21.15.88:0/3466404100 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191009f700 con 0x5608c39459d0 2023-10-18T19:37:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f1914f9c700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3969070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190f7fe700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f190ffff700 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1900017000 tx=0x7f190001a000).ready entity=mon.1 client_cookie=9383b86a8b743124 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.762+0000 7f18ee7fc700 10 client.0 ms_handle_connect on v2:172.21.15.88:3301/0 2023-10-18T19:37:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900015840 con 0x5608c39459d0 2023-10-18T19:37:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mon.1 v2:172.21.15.88:3301/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f19000159a0 con 0x5608c39459d0 2023-10-18T19:37:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608c393a130 con 0x5608c39459d0 2023-10-18T19:37:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1900015d70 con 0x5608c39459d0 2023-10-18T19:37:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 10 client.14305 fetch_fsmap learned FSMap version 15 2023-10-18T19:37:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,fsmap=15,monmap=3+}) v3 -- 0x7f18f80033f0 con 0x5608c39459d0 2023-10-18T19:37:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mon.1 v2:172.21.15.88:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5608c393a130 con 0x5608c39459d0 2023-10-18T19:37:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mon.1 v2:172.21.15.88:3301/0 5 ==== fsmap(e 15) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f190002a660 con 0x5608c39459d0 2023-10-18T19:37:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 10 client.14305 fetch_fsmap finished waiting for FSMap version 15 2023-10-18T19:37:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 10 client.14305 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T19:37:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 20 client.14305 populate_metadata read hostname 'smithi088' 2023-10-18T19:37:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 4 client.14305 mds_command: new command op to 4180 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T19:37:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.763+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 --> v1:172.21.15.88:6817/2557744719 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608c388ca80 con 0x5608c3964680 2023-10-18T19:37:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f18ee7fc700 10 client.14305 ms_handle_connect on v1:172.21.15.88:6817/2557744719 2023-10-18T19:37:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f18ee7fc700 1 -- 172.21.15.88:0/3466404100 <== mds.0 v1:172.21.15.88:6817/2557744719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x5608c388ca80 con 0x5608c3964680 2023-10-18T19:37:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f18ee7fc700 10 client.14305 handle_command_reply: tid=0 2023-10-18T19:37:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 client.14305 shutdown 2023-10-18T19:37:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 msgr2=0x5608c396cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1900017000 tx=0x7f190001a000).stop 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 shutdown_connections 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5608c3967e80 0x5608c3969070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5608c39459d0 0x5608c396cc50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 --2- 172.21.15.88:0/3466404100 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x5608c3966f10 0x5608c3968b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f18ee7fc700 0 client.14305 ms_handle_reset on v1:172.21.15.88:6817/2557744719 2023-10-18T19:37:30.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.764+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 >> 172.21.15.88:0/3466404100 conn(0x5608c3946820 msgr2=0x5608c3941050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.765+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 shutdown_connections 2023-10-18T19:37:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.765+0000 7f192dcc8b80 1 -- 172.21.15.88:0/3466404100 wait complete. 2023-10-18T19:37:30.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:30.765+0000 7f192dcc8b80 20 client.14305 trim_cache size 0 max 16384 2023-10-18T19:37:30.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-18T19:37:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:no valid command found; 10 closest matches: 2023-10-18T19:37:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:injectargs ... 2023-10-18T19:37:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:config set 2023-10-18T19:37:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:config unset 2023-10-18T19:37:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:exit 2023-10-18T19:37:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:respawn 2023-10-18T19:37:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:session kill 2023-10-18T19:37:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:cpu_profiler status|flush 2023-10-18T19:37:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:session ls [...] 2023-10-18T19:37:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:client ls [...] 2023-10-18T19:37:30.791 INFO:teuthology.orchestra.run.smithi088.stderr:session evict [...] 2023-10-18T19:37:30.791 INFO:teuthology.orchestra.run.smithi088.stderr:Error EINVAL: invalid command 2023-10-18T19:37:30.791 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-18T19:37:30.802 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-18T19:37:30.802 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:30.840 INFO:tasks.ceph.osd.0:Stopped 2023-10-18T19:37:30.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-18T19:37:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.070+0000 7f17655ff700 1 Processor -- start 2023-10-18T19:37:31.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.070+0000 7f17655ff700 1 -- start start 2023-10-18T19:37:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.071+0000 7f17655ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f176005e7a0 0x7f176013a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f17655ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 0x7f1760141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f17655ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176013ad80 con 0x7f1760139f10 2023-10-18T19:37:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f17655ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1760136c50 con 0x7f176005e7a0 2023-10-18T19:37:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f17655ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1760136ef0 con 0x7f176013f2a0 2023-10-18T19:37:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f175e7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1760139f10 0x7f1760137320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51122/0 (socket says 172.21.15.88:51122) 2023-10-18T19:37:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f175e7fc700 1 -- 172.21.15.88:0/1367417648 learned_addr learned my addr 172.21.15.88:0/1367417648 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.072+0000 7f175f7fe700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 0x7f1760141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175f7fe700 1 -- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f176005e7a0 msgr2=0x7f176013a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175f7fe700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f176005e7a0 0x7f176013a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T19:37:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175f7fe700 1 -- 172.21.15.88:0/1367417648 >> v1:172.21.15.88:6789/0 conn(0x7f1760139f10 legacy=0x7f1760137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175f7fe700 1 -- 172.21.15.88:0/1367417648 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760136940 con 0x7f176013f2a0 2023-10-18T19:37:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175f7fe700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 0x7f1760141690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1758009e90 tx=0x7f1758009780).ready entity=mon.2 client_cookie=995690c99f1fa139 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.073+0000 7f175dffb700 1 -- 172.21.15.88:0/1367417648 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f176013f2a0 2023-10-18T19:37:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.074+0000 7f175dffb700 1 -- 172.21.15.88:0/1367417648 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800bc30 con 0x7f176013f2a0 2023-10-18T19:37:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.074+0000 7f175dffb700 1 -- 172.21.15.88:0/1367417648 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758012410 con 0x7f176013f2a0 2023-10-18T19:37:31.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.074+0000 7f17655ff700 1 -- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 msgr2=0x7f1760141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.074+0000 7f17655ff700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 0x7f1760141690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1758009e90 tx=0x7f1758009780).stop 2023-10-18T19:37:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 -- 172.21.15.88:0/1367417648 shutdown_connections 2023-10-18T19:37:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176013f2a0 0x7f1760141690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 --2- 172.21.15.88:0/1367417648 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f176005e7a0 0x7f176013a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-18T19:37:31.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 -- 172.21.15.88:0/1367417648 >> 172.21.15.88:0/1367417648 conn(0x7f1760063dd0 msgr2=0x7f176005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:31.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 -- 172.21.15.88:0/1367417648 shutdown_connections 2023-10-18T19:37:31.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.075+0000 7f17655ff700 1 -- 172.21.15.88:0/1367417648 wait complete. 2023-10-18T19:37:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.077+0000 7f17655ff700 1 Processor -- start 2023-10-18T19:37:31.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.077+0000 7f17655ff700 1 -- start start 2023-10-18T19:37:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 0x7f1760093450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 0x7f1760094530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f176013f2a0 0x7f176014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176014cbb0 con 0x7f176013f2a0 2023-10-18T19:37:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1760093940 con 0x7f1760139f10 2023-10-18T19:37:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f17655ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f176013f120 con 0x7f176005e7a0 2023-10-18T19:37:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f175effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 0x7f1760093450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f175e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 0x7f1760094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f175effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 0x7f1760093450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57870/0 (socket says 172.21.15.88:57870) 2023-10-18T19:37:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f175effd700 1 -- 172.21.15.88:0/2058540459 learned_addr learned my addr 172.21.15.88:0/2058540459 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.078+0000 7f175f7fe700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f176013f2a0 0x7f176014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 -- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 msgr2=0x7f1760093450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 0x7f1760093450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 -- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f176013f2a0 msgr2=0x7f176014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f176013f2a0 0x7f176014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 -- 172.21.15.88:0/2058540459 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009a20 con 0x7f1760139f10 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f175e7fc700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 0x7f1760094530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f175400c440 tx=0x7f1754007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400ce40 con 0x7f1760139f10 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17540072e0 con 0x7f1760139f10 2023-10-18T19:37:31.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.079+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176013ebd0 con 0x7f1760139f10 2023-10-18T19:37:31.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.080+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754007660 con 0x7f1760139f10 2023-10-18T19:37:31.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.080+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176013df20 con 0x7f1760139f10 2023-10-18T19:37:31.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.081+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176005f270 con 0x7f1760139f10 2023-10-18T19:37:31.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.081+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f17540059b0 con 0x7f1760139f10 2023-10-18T19:37:31.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.082+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f1754054eb0 con 0x7f1760139f10 2023-10-18T19:37:31.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.085+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f1754035350 con 0x7f1760139f10 2023-10-18T19:37:31.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.244+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f176009c620 con 0x7f1760139f10 2023-10-18T19:37:31.247 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-10-18T19:37:31.244+0000 7fade51f2700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2023-10-18T19:37:31.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.245+0000 7f1746ffd700 1 -- 172.21.15.88:0/2058540459 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 osd.0 is already down. v22) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1754018070 con 0x7f1760139f10 2023-10-18T19:37:31.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 >> v1:172.21.15.88:6800/113625 conn(0x7f174c041ce0 legacy=0x7f174c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 msgr2=0x7f1760094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 0x7f1760094530 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f175400c440 tx=0x7f1754007d30).stop 2023-10-18T19:37:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 shutdown_connections 2023-10-18T19:37:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f176013f2a0 0x7f176014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f176005e7a0 0x7f1760093450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 --2- 172.21.15.88:0/2058540459 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1760139f10 0x7f1760094530 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 >> 172.21.15.88:0/2058540459 conn(0x7f1760063dd0 msgr2=0x7f17601370b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 shutdown_connections 2023-10-18T19:37:31.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.247+0000 7f17655ff700 1 -- 172.21.15.88:0/2058540459 wait complete. 2023-10-18T19:37:31.252 INFO:teuthology.orchestra.run.smithi088.stderr:osd.0 is already down. 2023-10-18T19:37:31.266 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T19:37:31.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-18T19:37:31.271 INFO:tasks.ceph.osd.0:Started 2023-10-18T19:37:31.272 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-18T19:37:31.272 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:31.307 INFO:tasks.ceph.osd.1:Stopped 2023-10-18T19:37:31.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-18T19:37:31.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.542+0000 7f0e249ff700 1 Processor -- start 2023-10-18T19:37:31.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.542+0000 7f0e249ff700 1 -- start start 2023-10-18T19:37:31.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e249ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 0x7f0e200a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e20143390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e249ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e200a4e00 con 0x7f0e20138d20 2023-10-18T19:37:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e249ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200a4070 con 0x7f0e2005e960 2023-10-18T19:37:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e249ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2005ed40 con 0x7f0e201363c0 2023-10-18T19:37:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e1ed9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e20143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e1dd9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0e20138d20 0x7f0e20135cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51138/0 (socket says 172.21.15.88:51138) 2023-10-18T19:37:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e1dd9b700 1 -- 172.21.15.88:0/3637724855 learned_addr learned my addr 172.21.15.88:0/3637724855 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.543+0000 7f0e1e59c700 1 --2- 172.21.15.88:0/3637724855 >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 0x7f0e200a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1d59a700 1 -- 172.21.15.88:0/3637724855 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622987269 0 0) 0x7f0e200a4e00 con 0x7f0e20138d20 2023-10-18T19:37:31.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1ed9d700 1 -- 172.21.15.88:0/3637724855 >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 msgr2=0x7f0e200a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1ed9d700 1 --2- 172.21.15.88:0/3637724855 >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 0x7f0e200a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1ed9d700 1 -- 172.21.15.88:0/3637724855 >> v1:172.21.15.88:6789/0 conn(0x7f0e20138d20 legacy=0x7f0e20135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1ed9d700 1 -- 172.21.15.88:0/3637724855 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200a4bf0 con 0x7f0e201363c0 2023-10-18T19:37:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1e59c700 1 --2- 172.21.15.88:0/3637724855 >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 0x7f0e200a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1ed9d700 1 --2- 172.21.15.88:0/3637724855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e20143390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0e18009e60 tx=0x7f0e18009780).ready entity=mon.2 client_cookie=4913dd5c4a056226 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1d59a700 1 -- 172.21.15.88:0/3637724855 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800e070 con 0x7f0e201363c0 2023-10-18T19:37:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1d59a700 1 -- 172.21.15.88:0/3637724855 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800bb60 con 0x7f0e201363c0 2023-10-18T19:37:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e1d59a700 1 -- 172.21.15.88:0/3637724855 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18012410 con 0x7f0e201363c0 2023-10-18T19:37:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e249ff700 1 -- 172.21.15.88:0/3637724855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 msgr2=0x7f0e20143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.544+0000 7f0e249ff700 1 --2- 172.21.15.88:0/3637724855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e20143390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0e18009e60 tx=0x7f0e18009780).stop 2023-10-18T19:37:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 -- 172.21.15.88:0/3637724855 shutdown_connections 2023-10-18T19:37:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 --2- 172.21.15.88:0/3637724855 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e20143390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 --2- 172.21.15.88:0/3637724855 >> v2:172.21.15.88:3300/0 conn(0x7f0e2005e960 0x7f0e200a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 -- 172.21.15.88:0/3637724855 >> 172.21.15.88:0/3637724855 conn(0x7f0e20063460 msgr2=0x7f0e2005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 -- 172.21.15.88:0/3637724855 shutdown_connections 2023-10-18T19:37:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.545+0000 7f0e249ff700 1 -- 172.21.15.88:0/3637724855 wait complete. 2023-10-18T19:37:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.546+0000 7f0e249ff700 1 Processor -- start 2023-10-18T19:37:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.546+0000 7f0e249ff700 1 -- start start 2023-10-18T19:37:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 0x7f0e200a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e200a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 0x7f0e2014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200a85c0 con 0x7f0e2005e960 2023-10-18T19:37:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200ac500 con 0x7f0e20138d20 2023-10-18T19:37:31.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e249ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200a7330 con 0x7f0e201363c0 2023-10-18T19:37:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1dd9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e200a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1ed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 0x7f0e2014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 0x7f0e200a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1dd9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e200a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57892/0 (socket says 172.21.15.88:57892) 2023-10-18T19:37:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1dd9b700 1 -- 172.21.15.88:0/2307069503 learned_addr learned my addr 172.21.15.88:0/2307069503 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1ed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 0x7f0e2014b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40662/0 (socket says 172.21.15.88:40662) 2023-10-18T19:37:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 -- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 msgr2=0x7f0e200a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e200a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 -- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 msgr2=0x7f0e2014b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 0x7f0e2014b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.547+0000 7f0e1e59c700 1 -- 172.21.15.88:0/2307069503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009250 con 0x7f0e2005e960 2023-10-18T19:37:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e1e59c700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 0x7f0e200a7c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0e10009fd0 tx=0x7f0e10006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10005880 con 0x7f0e2005e960 2023-10-18T19:37:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e100059e0 con 0x7f0e2005e960 2023-10-18T19:37:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18009a20 con 0x7f0e2005e960 2023-10-18T19:37:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10005d60 con 0x7f0e2005e960 2023-10-18T19:37:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.548+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200a5a20 con 0x7f0e2005e960 2023-10-18T19:37:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.549+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20139120 con 0x7f0e2005e960 2023-10-18T19:37:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.549+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f0e10006230 con 0x7f0e2005e960 2023-10-18T19:37:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.550+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f0e10055900 con 0x7f0e2005e960 2023-10-18T19:37:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.553+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0e10035e70 con 0x7f0e2005e960 2023-10-18T19:37:31.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:31.710+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f0e2005f270 con 0x7f0e2005e960 2023-10-18T19:37:31.713 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-10-18T19:37:31.710+0000 7fade51f2700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2023-10-18T19:37:31.933 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:31.931+0000 7fbbd2531200 -1 Falling back to public interface 2023-10-18T19:37:32.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.072+0000 7f0e0e7fc700 1 -- 172.21.15.88:0/2307069503 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0e10016070 con 0x7f0e2005e960 2023-10-18T19:37:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 >> v1:172.21.15.88:6800/113625 conn(0x7f0e00041d10 legacy=0x7f0e000441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:32.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 msgr2=0x7f0e200a7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 0x7f0e200a7c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0e10009fd0 tx=0x7f0e10006f40).stop 2023-10-18T19:37:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 shutdown_connections 2023-10-18T19:37:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0e20138d20 0x7f0e2014b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2005e960 0x7f0e200a7c10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 --2- 172.21.15.88:0/2307069503 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0e201363c0 0x7f0e200a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 >> 172.21.15.88:0/2307069503 conn(0x7f0e20063460 msgr2=0x7f0e20137650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 shutdown_connections 2023-10-18T19:37:32.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.075+0000 7f0e249ff700 1 -- 172.21.15.88:0/2307069503 wait complete. 2023-10-18T19:37:32.081 INFO:teuthology.orchestra.run.smithi088.stderr:marked down osd.1. 2023-10-18T19:37:32.102 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-18T19:37:32.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-18T19:37:32.114 INFO:tasks.ceph.osd.1:Started 2023-10-18T19:37:32.114 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-18T19:37:32.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:32.167 INFO:tasks.ceph.osd.2:Stopped 2023-10-18T19:37:32.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-18T19:37:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.355+0000 7f96da7ff700 1 Processor -- start 2023-10-18T19:37:32.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.355+0000 7f96da7ff700 1 -- start start 2023-10-18T19:37:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96d406a4e0 0x7f96d40636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d406a990 con 0x7f96d406a4e0 2023-10-18T19:37:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4063280 con 0x7f96d4062ea0 2023-10-18T19:37:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.356+0000 7f96da7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4064520 con 0x7f96d4063bd0 2023-10-18T19:37:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96d406a4e0 0x7f96d40636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d8d9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40670/0 (socket says 172.21.15.88:40670) 2023-10-18T19:37:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d3fff700 1 -- 172.21.15.88:0/2521236016 learned_addr learned my addr 172.21.15.88:0/2521236016 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d8d9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57906/0 (socket says 172.21.15.88:57906) 2023-10-18T19:37:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 -- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 msgr2=0x7f96d4064030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 -- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 msgr2=0x7f96d409dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 -- 172.21.15.88:0/2521236016 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4069170 con 0x7f96d406a4e0 2023-10-18T19:37:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d3fff700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d8d9c700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.357+0000 7f96d37fe700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d40636e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f96c8009790 tx=0x7f96c8009060).ready entity=mon.0 client_cookie=8dd51a538c14b3aa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96d2ffd700 1 -- 172.21.15.88:0/2521236016 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800d4a0 con 0x7f96d406a4e0 2023-10-18T19:37:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96d2ffd700 1 -- 172.21.15.88:0/2521236016 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800d600 con 0x7f96d406a4e0 2023-10-18T19:37:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96d2ffd700 1 -- 172.21.15.88:0/2521236016 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800d980 con 0x7f96d406a4e0 2023-10-18T19:37:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 -- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 msgr2=0x7f96d40636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d40636e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f96c8009790 tx=0x7f96c8009060).stop 2023-10-18T19:37:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 -- 172.21.15.88:0/2521236016 shutdown_connections 2023-10-18T19:37:32.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4063bd0 0x7f96d4064030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4062ea0 0x7f96d409dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2521236016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d40636e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 -- 172.21.15.88:0/2521236016 >> 172.21.15.88:0/2521236016 conn(0x7f96d4067ed0 msgr2=0x7f96d40625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 -- 172.21.15.88:0/2521236016 shutdown_connections 2023-10-18T19:37:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.358+0000 7f96da7ff700 1 -- 172.21.15.88:0/2521236016 wait complete. 2023-10-18T19:37:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.359+0000 7f96da7ff700 1 Processor -- start 2023-10-18T19:37:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 -- start start 2023-10-18T19:37:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 0x7f96d413ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40944e0 con 0x7f96d406a4e0 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4094d50 con 0x7f96d4063bd0 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96da7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4094650 con 0x7f96d4062ea0 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.360+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d37fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 0x7f96d413ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57912/0 (socket says 172.21.15.88:57912) 2023-10-18T19:37:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 -- 172.21.15.88:0/2239501620 learned_addr learned my addr 172.21.15.88:0/2239501620 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d8d9c700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 -- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 msgr2=0x7f96d413ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 0x7f96d413ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 -- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 msgr2=0x7f96d413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d413aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 -- 172.21.15.88:0/2239501620 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009370 con 0x7f96d4062ea0 2023-10-18T19:37:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d37fe700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 0x7f96d413ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d8d9c700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96d3fff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f96c400ea20 tx=0x7f96c40090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400c850 con 0x7f96d4062ea0 2023-10-18T19:37:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400c9b0 con 0x7f96d4062ea0 2023-10-18T19:37:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc009a20 con 0x7f96d4062ea0 2023-10-18T19:37:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.361+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400cd30 con 0x7f96d4062ea0 2023-10-18T19:37:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.362+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c80092a0 con 0x7f96d4062ea0 2023-10-18T19:37:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.363+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d405f270 con 0x7f96d4062ea0 2023-10-18T19:37:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.363+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f96c4012600 con 0x7f96d4062ea0 2023-10-18T19:37:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.363+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f96c4055ea0 con 0x7f96d4062ea0 2023-10-18T19:37:32.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.367+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f96c40363b0 con 0x7f96d4062ea0 2023-10-18T19:37:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:32.526+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f96d4068f50 con 0x7f96d4062ea0 2023-10-18T19:37:32.529 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-10-18T19:37:32.526+0000 7fade51f2700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-10-18T19:37:32.777 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:32.775+0000 7f6017982200 -1 Falling back to public interface 2023-10-18T19:37:33.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.082+0000 7f96bbfff700 1 -- 172.21.15.88:0/2239501620 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f96c4016070 con 0x7f96d4062ea0 2023-10-18T19:37:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.085+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 >> v1:172.21.15.88:6800/113625 conn(0x7f96c0041cb0 legacy=0x7f96c0044170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.085+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 msgr2=0x7f96d40a86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.085+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f96c400ea20 tx=0x7f96c40090f0).stop 2023-10-18T19:37:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 shutdown_connections 2023-10-18T19:37:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96d406a4e0 0x7f96d413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f96d4062ea0 0x7f96d40a86b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 --2- 172.21.15.88:0/2239501620 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f96d4063bd0 0x7f96d413ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 >> 172.21.15.88:0/2239501620 conn(0x7f96d4067ed0 msgr2=0x7f96d413eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 shutdown_connections 2023-10-18T19:37:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.086+0000 7f96da7ff700 1 -- 172.21.15.88:0/2239501620 wait complete. 2023-10-18T19:37:33.090 INFO:teuthology.orchestra.run.smithi088.stderr:marked down osd.2. 2023-10-18T19:37:33.108 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-18T19:37:33.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-18T19:37:33.113 INFO:tasks.ceph.osd.2:Started 2023-10-18T19:37:33.113 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-18T19:37:33.114 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:33.172 INFO:tasks.ceph.osd.3:Stopped 2023-10-18T19:37:33.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-18T19:37:33.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.361+0000 7f4e4179d700 1 Processor -- start 2023-10-18T19:37:33.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.361+0000 7f4e4179d700 1 -- start start 2023-10-18T19:37:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e4179d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e3c0af010 0x7f4e3c0a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e4179d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e4179d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0a0d10 con 0x7f4e3c13c740 2023-10-18T19:37:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e4179d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0a47b0 con 0x7f4e3c0af010 2023-10-18T19:37:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e4179d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0af3f0 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e3b7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e3b7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57928/0 (socket says 172.21.15.88:57928) 2023-10-18T19:37:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e3b7fe700 1 -- 172.21.15.88:0/3801664428 learned_addr learned my addr 172.21.15.88:0/3801664428 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.362+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/3801664428 >> v2:172.21.15.88:3300/0 conn(0x7f4e3c0af010 0x7f4e3c0a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3bfff700 1 -- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 msgr2=0x7f4e3c13c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3bfff700 1 -- 172.21.15.88:0/3801664428 >> v1:172.21.15.88:6789/0 conn(0x7f4e3c13c740 legacy=0x7f4e3c1386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3bfff700 1 -- 172.21.15.88:0/3801664428 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0a49a0 con 0x7f4e3c0af010 2023-10-18T19:37:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3affd700 1 -- 172.21.15.88:0/3801664428 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561093081 0 0) 0x7f4e34001490 con 0x7f4e3c13c740 2023-10-18T19:37:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3b7fe700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0a42c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4e2c009760 tx=0x7f4e2c009060).ready entity=mon.0 client_cookie=20cbb127b68910db server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3affd700 1 -- 172.21.15.88:0/3801664428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00f510 con 0x7f4e3c0af010 2023-10-18T19:37:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3affd700 1 -- 172.21.15.88:0/3801664428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00f670 con 0x7f4e3c0af010 2023-10-18T19:37:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.363+0000 7f4e3affd700 1 -- 172.21.15.88:0/3801664428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00f9f0 con 0x7f4e3c0af010 2023-10-18T19:37:33.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 -- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 msgr2=0x7f4e3c0a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0a42c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4e2c009760 tx=0x7f4e2c009060).stop 2023-10-18T19:37:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 -- 172.21.15.88:0/3801664428 shutdown_connections 2023-10-18T19:37:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0a42c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 --2- 172.21.15.88:0/3801664428 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c13c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 -- 172.21.15.88:0/3801664428 >> 172.21.15.88:0/3801664428 conn(0x7f4e3c062910 msgr2=0x7f4e3c062cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 -- 172.21.15.88:0/3801664428 shutdown_connections 2023-10-18T19:37:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.364+0000 7f4e4179d700 1 -- 172.21.15.88:0/3801664428 wait complete. 2023-10-18T19:37:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.365+0000 7f4e4179d700 1 Processor -- start 2023-10-18T19:37:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.365+0000 7f4e4179d700 1 -- start start 2023-10-18T19:37:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e3c13c740 0x7f4e3c14b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0abd40 con 0x7f4e3c0af010 2023-10-18T19:37:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0a78f0 con 0x7f4e3c13c740 2023-10-18T19:37:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e4179d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c092b40 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57936/0 (socket says 172.21.15.88:57936) 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 -- 172.21.15.88:0/1995168724 learned_addr learned my addr 172.21.15.88:0/1995168724 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e40f9c700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e3c13c740 0x7f4e3c14b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 -- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e3c13c740 msgr2=0x7f4e3c14b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e3c13c740 0x7f4e3c14b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 -- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 msgr2=0x7f4e3c0aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.366+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e3bfff700 1 -- 172.21.15.88:0/1995168724 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009370 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e3bfff700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4e2c009e00 tx=0x7f4e2c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00f7e0 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00f940 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c0092a0 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c01b660 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.367+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c0a7b20 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.368+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c062fa0 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.368+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f4e2c01ba50 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.369+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f4e2c057300 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.372+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f4e2c007a80 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:33.531+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f4e3c05f200 con 0x7f4e3c0a14b0 2023-10-18T19:37:33.534 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-10-18T19:37:33.532+0000 7fade51f2700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-18T19:37:33.773 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:33.771+0000 7f02e3b28200 -1 Falling back to public interface 2023-10-18T19:37:34.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.087+0000 7f4e23fff700 1 -- 172.21.15.88:0/1995168724 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f4e2c028070 con 0x7f4e3c0a14b0 2023-10-18T19:37:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 >> v1:172.21.15.88:6800/113625 conn(0x7f4e28041ce0 legacy=0x7f4e280441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 msgr2=0x7f4e3c0ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4e2c009e00 tx=0x7f4e2c017000).stop 2023-10-18T19:37:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 shutdown_connections 2023-10-18T19:37:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e3c13c740 0x7f4e3c14b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e3c0a14b0 0x7f4e3c0ab850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 --2- 172.21.15.88:0/1995168724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e3c0af010 0x7f4e3c0aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.089+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 >> 172.21.15.88:0/1995168724 conn(0x7f4e3c062910 msgr2=0x7f4e3c09f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.090+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 shutdown_connections 2023-10-18T19:37:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.090+0000 7f4e4179d700 1 -- 172.21.15.88:0/1995168724 wait complete. 2023-10-18T19:37:34.094 INFO:teuthology.orchestra.run.smithi088.stderr:marked down osd.3. 2023-10-18T19:37:34.109 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-18T19:37:34.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-18T19:37:34.115 INFO:tasks.ceph.osd.3:Started 2023-10-18T19:37:34.115 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T19:37:34.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.305+0000 7fda6d9ff700 1 Processor -- start 2023-10-18T19:37:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 -- start start 2023-10-18T19:37:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda680af970 0x7fda68135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680afd50 con 0x7fda680a4c50 2023-10-18T19:37:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680a47a0 con 0x7fda680af970 2023-10-18T19:37:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.306+0000 7fda6d9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680a3a10 con 0x7fda680a1790 2023-10-18T19:37:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda680af970 0x7fda68135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda667fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda680af970 0x7fda68135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36250/0 (socket says 172.21.15.88:36250) 2023-10-18T19:37:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda667fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40702/0 (socket says 172.21.15.88:40702) 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 -- 172.21.15.88:0/2935723128 learned_addr learned my addr 172.21.15.88:0/2935723128 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 -- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 msgr2=0x7fda68136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 -- 172.21.15.88:0/2935723128 >> v1:172.21.15.88:6789/0 conn(0x7fda680a4c50 legacy=0x7fda6813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 -- 172.21.15.88:0/2935723128 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680a32d0 con 0x7fda680af970 2023-10-18T19:37:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda65ffb700 1 -- 172.21.15.88:0/2935723128 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993584104 0 0) 0x7fda680afd50 con 0x7fda680a4c50 2023-10-18T19:37:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda667fc700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.307+0000 7fda66ffd700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680af970 0x7fda68135d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fda58006fd0 tx=0x7fda580090f0).ready entity=mon.0 client_cookie=d9caf592505863bd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda65ffb700 1 -- 172.21.15.88:0/2935723128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800b580 con 0x7fda680af970 2023-10-18T19:37:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda65ffb700 1 -- 172.21.15.88:0/2935723128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800b6e0 con 0x7fda680af970 2023-10-18T19:37:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda65ffb700 1 -- 172.21.15.88:0/2935723128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800ba60 con 0x7fda680af970 2023-10-18T19:37:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 -- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680af970 msgr2=0x7fda68135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680af970 0x7fda68135d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fda58006fd0 tx=0x7fda580090f0).stop 2023-10-18T19:37:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 -- 172.21.15.88:0/2935723128 shutdown_connections 2023-10-18T19:37:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680af970 0x7fda68135d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/2935723128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680a1790 0x7fda68136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 -- 172.21.15.88:0/2935723128 >> 172.21.15.88:0/2935723128 conn(0x7fda6805eb60 msgr2=0x7fda680af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 -- 172.21.15.88:0/2935723128 shutdown_connections 2023-10-18T19:37:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.308+0000 7fda6d9ff700 1 -- 172.21.15.88:0/2935723128 wait complete. 2023-10-18T19:37:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.309+0000 7fda6d9ff700 1 Processor -- start 2023-10-18T19:37:34.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 -- start start 2023-10-18T19:37:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 0x7fda68091ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680af970 0x7fda680a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68148f50 con 0x7fda680a1790 2023-10-18T19:37:34.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda681491f0 con 0x7fda680af970 2023-10-18T19:37:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.310+0000 7fda6d9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda681494b0 con 0x7fda680a4c50 2023-10-18T19:37:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda66ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 0x7fda68091ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda66ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36256/0 (socket says 172.21.15.88:36256) 2023-10-18T19:37:34.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda66ffd700 1 -- 172.21.15.88:0/3214010210 learned_addr learned my addr 172.21.15.88:0/3214010210 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda677fe700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680af970 0x7fda680a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 -- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680af970 msgr2=0x7fda680a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680af970 0x7fda680a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 -- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 msgr2=0x7fda68148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 -- 172.21.15.88:0/3214010210 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0092a0 con 0x7fda680a4c50 2023-10-18T19:37:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda66ffd700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda667fc700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 0x7fda68091ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fda5c00e950 tx=0x7fda5c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c009580 con 0x7fda680a4c50 2023-10-18T19:37:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c012600 con 0x7fda680a4c50 2023-10-18T19:37:34.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c012980 con 0x7fda680a4c50 2023-10-18T19:37:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.311+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda58009370 con 0x7fda680a4c50 2023-10-18T19:37:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.312+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda68091fb0 con 0x7fda680a4c50 2023-10-18T19:37:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.313+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fda5c012d30 con 0x7fda680a4c50 2023-10-18T19:37:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.313+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6805f270 con 0x7fda680a4c50 2023-10-18T19:37:34.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.313+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fda5c055ac0 con 0x7fda680a4c50 2023-10-18T19:37:34.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.317+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fda5c035f60 con 0x7fda680a4c50 2023-10-18T19:37:34.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.469+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda6813cdf0 con 0x7fda680a4c50 2023-10-18T19:37:34.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.469+0000 7fda4effd700 1 -- 172.21.15.88:0/3214010210 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+11332 (secure 0 0 0) 0x7fda5c016020 con 0x7fda680a4c50 2023-10-18T19:37:34.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:34.473 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":25,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:34.079545+0000","last_up_change":"2023-10-18T19:37:34.079545+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":107950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":107950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":107950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":107950}]},"public_addr":"172.21.15.88:6801/107950","cluster_addr":"172.21.15.88:6802/107950","heartbeat_back_addr":"172.21.15.88:6804/107950","heartbeat_front_addr":"172.21.15.88:6803/107950","state":["exists"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:34.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.471+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 >> v1:172.21.15.88:6800/113625 conn(0x7fda54041d10 legacy=0x7fda540441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.471+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 msgr2=0x7fda68091ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:34.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.471+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 0x7fda68091ac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fda5c00e950 tx=0x7fda5c009060).stop 2023-10-18T19:37:34.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 shutdown_connections 2023-10-18T19:37:34.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda680af970 0x7fda680a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda680a1790 0x7fda68148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 --2- 172.21.15.88:0/3214010210 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fda680a4c50 0x7fda68091ac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:34.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 >> 172.21.15.88:0/3214010210 conn(0x7fda6805eb60 msgr2=0x7fda68139070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:34.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 shutdown_connections 2023-10-18T19:37:34.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:34.472+0000 7fda6d9ff700 1 -- 172.21.15.88:0/3214010210 wait complete. 2023-10-18T19:37:34.773 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:34.771+0000 7f4b10e37200 -1 Falling back to public interface 2023-10-18T19:37:34.790 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.787+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2023-10-18T19:37:34.795 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.795 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.795 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.795 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.796 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.797 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.797 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.797 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:34.797 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:34.792+0000 7fbbd2531200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.659 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.657+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2023-10-18T19:37:35.666 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.666 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.666 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.668 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.668 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.668 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.668 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.668 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.669 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.669 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.669 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:35.662+0000 7f6017982200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #4:f6ec3e4a:::INTEL_SSDPEDMD400G4_PHFT620400XD400BGN:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:35.714 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:35.711+0000 7fbbd2531200 -1 osd.0 21 log_to_monitors {default=true} 2023-10-18T19:37:36.112 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-10-18T19:37:36.109+0000 7fbbc1ffa700 -1 osd.0 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:37:36.576 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:36.574+0000 7f6017982200 -1 osd.1 22 log_to_monitors {default=true} 2023-10-18T19:37:36.626 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.624+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2023-10-18T19:37:36.631 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.631 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.631 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.631 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.631 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.632 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.632 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.632 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.632 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:36.632 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:36.628+0000 7f02e3b28200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.137 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-10-18T19:37:37.134+0000 7f60073fa700 -1 osd.1 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:37:37.386 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.383+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2023-10-18T19:37:37.390 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.390 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.390 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.391 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.391 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.391 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.391 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.392 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.393 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.393 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.387+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.393 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:37.388+0000 7f4b10e37200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #4:f6ec3e4a:::INTEL_SSDPEDMD400G4_PHFT620400XD400BGN:head# has omap that is not per-pool or pgmeta 2023-10-18T19:37:37.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:37.528 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:37.526+0000 7f02e3b28200 -1 osd.2 23 log_to_monitors {default=true} 2023-10-18T19:37:37.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.683+0000 7f3ee61ff700 1 Processor -- start 2023-10-18T19:37:37.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.683+0000 7f3ee61ff700 1 -- start start 2023-10-18T19:37:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3ee61ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee00a3580 0x7f3ee0135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3ee61ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 0x7f3ee01433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3ee61ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee005ed40 con 0x7f3ee005e960 2023-10-18T19:37:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3ee61ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0136670 con 0x7f3ee00a3580 2023-10-18T19:37:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3ee61ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee00a2ac0 con 0x7f3ee01361c0 2023-10-18T19:37:37.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3edeffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee00a3580 0x7f3ee0135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:37.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3edffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 0x7f3ee01433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:37.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3edf7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ee005e960 0x7f3ee00a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39074/0 (socket says 172.21.15.88:39074) 2023-10-18T19:37:37.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.684+0000 7f3edf7fe700 1 -- 172.21.15.88:0/55624479 learned_addr learned my addr 172.21.15.88:0/55624479 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3edffff700 1 -- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee00a3580 msgr2=0x7f3ee0135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3edffff700 1 --2- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee00a3580 0x7f3ee0135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3ede7fc700 1 -- 172.21.15.88:0/55624479 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246771126 0 0) 0x7f3ee005ed40 con 0x7f3ee005e960 2023-10-18T19:37:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3edffff700 1 -- 172.21.15.88:0/55624479 >> v1:172.21.15.88:6789/0 conn(0x7f3ee005e960 legacy=0x7f3ee00a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3edffff700 1 -- 172.21.15.88:0/55624479 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00a2d60 con 0x7f3ee01361c0 2023-10-18T19:37:37.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3edffff700 1 --2- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 0x7f3ee01433f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3ed8009ec0 tx=0x7f3ed8009780).ready entity=mon.2 client_cookie=df811c292cbed63f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:37.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3ede7fc700 1 -- 172.21.15.88:0/55624479 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800e070 con 0x7f3ee01361c0 2023-10-18T19:37:37.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3ede7fc700 1 -- 172.21.15.88:0/55624479 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed800bc20 con 0x7f3ee01361c0 2023-10-18T19:37:37.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.685+0000 7f3ede7fc700 1 -- 172.21.15.88:0/55624479 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8012410 con 0x7f3ee01361c0 2023-10-18T19:37:37.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 -- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 msgr2=0x7f3ee01433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 0x7f3ee01433f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3ed8009ec0 tx=0x7f3ed8009780).stop 2023-10-18T19:37:37.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 -- 172.21.15.88:0/55624479 shutdown_connections 2023-10-18T19:37:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee01361c0 0x7f3ee01433f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/55624479 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee00a3580 0x7f3ee0135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 -- 172.21.15.88:0/55624479 >> 172.21.15.88:0/55624479 conn(0x7f3ee0064bb0 msgr2=0x7f3ee005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 -- 172.21.15.88:0/55624479 shutdown_connections 2023-10-18T19:37:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.686+0000 7f3ee61ff700 1 -- 172.21.15.88:0/55624479 wait complete. 2023-10-18T19:37:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.687+0000 7f3ee61ff700 1 Processor -- start 2023-10-18T19:37:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.687+0000 7f3ee61ff700 1 -- start start 2023-10-18T19:37:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 0x7f3ee00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:37.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee00a7fb0 con 0x7f3ee00a3580 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01482f0 con 0x7f3ee01361c0 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3ee61ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0148020 con 0x7f3ee005e960 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edf7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 0x7f3ee00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:37.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55552/0 (socket says 172.21.15.88:55552) 2023-10-18T19:37:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36874/0 (socket says 172.21.15.88:36874) 2023-10-18T19:37:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edf7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 0x7f3ee00a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:59784/0 (socket says 172.21.15.88:59784) 2023-10-18T19:37:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.688+0000 7f3edffff700 1 -- 172.21.15.88:0/2889407119 learned_addr learned my addr 172.21.15.88:0/2889407119 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:37.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 -- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 msgr2=0x7f3ee00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 0x7f3ee00a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 -- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 msgr2=0x7f3ee01485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 -- 172.21.15.88:0/2889407119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8009a20 con 0x7f3ee00a3580 2023-10-18T19:37:37.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edffff700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3edeffd700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3ed400e8d0 tx=0x7f3ed4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4009470 con 0x7f3ee00a3580 2023-10-18T19:37:37.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4012600 con 0x7f3ee00a3580 2023-10-18T19:37:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4012980 con 0x7f3ee00a3580 2023-10-18T19:37:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee00a89a0 con 0x7f3ee00a3580 2023-10-18T19:37:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.689+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee00a76f0 con 0x7f3ee00a3580 2023-10-18T19:37:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.690+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee00a6f20 con 0x7f3ee00a3580 2023-10-18T19:37:37.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.691+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f3ed4012cf0 con 0x7f3ee00a3580 2023-10-18T19:37:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.691+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f3ed4055d20 con 0x7f3ee00a3580 2023-10-18T19:37:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.695+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3ee00a6f20 con 0x7f3ee00a3580 2023-10-18T19:37:37.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.842+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ee00a6f20 con 0x7f3ee00a3580 2023-10-18T19:37:37.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.843+0000 7f3ec77fe700 1 -- 172.21.15.88:0/2889407119 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11339 (secure 0 0 0) 0x7f3ee00a6f20 con 0x7f3ee00a3580 2023-10-18T19:37:37.845 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:37.845 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:37.092203+0000","last_up_change":"2023-10-18T19:37:37.092203+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":14,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":115732}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":115732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":115732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":115732}]},"public_addr":"172.21.15.88:6801/115732","cluster_addr":"172.21.15.88:6802/115732","heartbeat_back_addr":"172.21.15.88:6804/115732","heartbeat_front_addr":"172.21.15.88:6803/115732","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":107952}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":107952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":107952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":107952}]},"public_addr":"172.21.15.88:6813/107952","cluster_addr":"172.21.15.88:6814/107952","heartbeat_back_addr":"172.21.15.88:6816/107952","heartbeat_front_addr":"172.21.15.88:6815/107952","state":["exists"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":107953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":107953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":107953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":107953}]},"public_addr":"172.21.15.88:6809/107953","cluster_addr":"172.21.15.88:6810/107953","heartbeat_back_addr":"172.21.15.88:6812/107953","heartbeat_front_addr":"172.21.15.88:6811/107953","state":["exists"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":107951}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":107951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":107951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":107951}]},"public_addr":"172.21.15.88:6805/107951","cluster_addr":"172.21.15.88:6806/107951","heartbeat_back_addr":"172.21.15.88:6808/107951","heartbeat_front_addr":"172.21.15.88:6807/107951","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:37.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 >> v1:172.21.15.88:6800/113625 conn(0x7f3ecc041ce0 legacy=0x7f3ecc0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 msgr2=0x7f3ee00a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:37.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3ed400e8d0 tx=0x7f3ed4009060).stop 2023-10-18T19:37:37.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 shutdown_connections 2023-10-18T19:37:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3ee01361c0 0x7f3ee01485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3ee005e960 0x7f3ee00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 --2- 172.21.15.88:0/2889407119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee00a3580 0x7f3ee00a7200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 >> 172.21.15.88:0/2889407119 conn(0x7f3ee0064bb0 msgr2=0x7f3ee0139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:37.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 shutdown_connections 2023-10-18T19:37:37.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:37.845+0000 7f3ee61ff700 1 -- 172.21.15.88:0/2889407119 wait complete. 2023-10-18T19:37:38.149 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-10-18T19:37:38.147+0000 7f02d35fa700 -1 osd.2 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:37:38.297 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:38.296+0000 7f4b10e37200 -1 osd.3 24 log_to_monitors {default=true} 2023-10-18T19:37:39.162 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-10-18T19:37:39.160+0000 7f4b009fa700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T19:37:40.866 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:41.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.061+0000 7f7f3c5ff700 1 Processor -- start 2023-10-18T19:37:41.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 -- start start 2023-10-18T19:37:41.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f3405e960 0x7f7f340a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:41.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:41.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3405ed40 con 0x7f7f340a4a20 2023-10-18T19:37:41.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f340a3a70 con 0x7f7f3405e960 2023-10-18T19:37:41.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.062+0000 7f7f3c5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340a2ac0 con 0x7f7f341363e0 2023-10-18T19:37:41.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f3405e960 0x7f7f340a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:41.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3ab9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:41.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f3405e960 0x7f7f340a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55564/0 (socket says 172.21.15.88:55564) 2023-10-18T19:37:41.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f39b9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f340a4a20 0x7f7f34135cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39082/0 (socket says 172.21.15.88:39082) 2023-10-18T19:37:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 -- 172.21.15.88:0/4094909338 learned_addr learned my addr 172.21.15.88:0/4094909338 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3ab9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36890/0 (socket says 172.21.15.88:36890) 2023-10-18T19:37:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 -- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 msgr2=0x7f7f341433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 -- 172.21.15.88:0/4094909338 >> v1:172.21.15.88:6789/0 conn(0x7f7f340a4a20 legacy=0x7f7f34135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 -- 172.21.15.88:0/4094909338 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340a2d60 con 0x7f7f3405e960 2023-10-18T19:37:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f39399700 1 -- 172.21.15.88:0/4094909338 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220502660 0 0) 0x7f7f3405ed40 con 0x7f7f340a4a20 2023-10-18T19:37:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3ab9c700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.063+0000 7f7f3a39b700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3405e960 0x7f7f340a3580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7f30006fd0 tx=0x7f7f300090f0).ready entity=mon.0 client_cookie=42e9ad3d6b3395dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f39399700 1 -- 172.21.15.88:0/4094909338 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000b610 con 0x7f7f3405e960 2023-10-18T19:37:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f39399700 1 -- 172.21.15.88:0/4094909338 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3000b770 con 0x7f7f3405e960 2023-10-18T19:37:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f39399700 1 -- 172.21.15.88:0/4094909338 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000baf0 con 0x7f7f3405e960 2023-10-18T19:37:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3405e960 msgr2=0x7f7f340a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3405e960 0x7f7f340a3580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7f30006fd0 tx=0x7f7f300090f0).stop 2023-10-18T19:37:41.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/4094909338 shutdown_connections 2023-10-18T19:37:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f341363e0 0x7f7f341433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/4094909338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3405e960 0x7f7f340a3580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/4094909338 >> 172.21.15.88:0/4094909338 conn(0x7f7f34064bb0 msgr2=0x7f7f3405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/4094909338 shutdown_connections 2023-10-18T19:37:41.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.064+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/4094909338 wait complete. 2023-10-18T19:37:41.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.066+0000 7f7f3c5ff700 1 Processor -- start 2023-10-18T19:37:41.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.066+0000 7f7f3c5ff700 1 -- start start 2023-10-18T19:37:41.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:41.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:41.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f341363e0 0x7f7f3414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:41.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340a6e70 con 0x7f7f340a4a20 2023-10-18T19:37:41.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34136dd0 con 0x7f7f3405e960 2023-10-18T19:37:41.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.067+0000 7f7f3c5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340a7280 con 0x7f7f341363e0 2023-10-18T19:37:41.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f3a39b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:41.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:41.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f3a39b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36906/0 (socket says 172.21.15.88:36906) 2023-10-18T19:37:41.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55568/0 (socket says 172.21.15.88:55568) 2023-10-18T19:37:41.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f3a39b700 1 -- 172.21.15.88:0/927979772 learned_addr learned my addr 172.21.15.88:0/927979772 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:41.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f3ab9c700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f341363e0 0x7f7f3414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:41.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 -- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f341363e0 msgr2=0x7f7f3414b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f341363e0 0x7f7f3414b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 -- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 msgr2=0x7f7f340a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 -- 172.21.15.88:0/927979772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c009a20 con 0x7f7f340a4a20 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f3a39b700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f39b9a700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7f24000c00 tx=0x7f7f24007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.068+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240070d0 con 0x7f7f340a4a20 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.069+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24007230 con 0x7f7f340a4a20 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.069+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f30009370 con 0x7f7f340a4a20 2023-10-18T19:37:41.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.069+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240056e0 con 0x7f7f340a4a20 2023-10-18T19:37:41.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.069+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f34138b00 con 0x7f7f340a4a20 2023-10-18T19:37:41.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.070+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3405e0d0 con 0x7f7f340a4a20 2023-10-18T19:37:41.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.070+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f7f24005a50 con 0x7f7f340a4a20 2023-10-18T19:37:41.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.071+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f7f24054d60 con 0x7f7f340a4a20 2023-10-18T19:37:41.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.074+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f7f24035200 con 0x7f7f340a4a20 2023-10-18T19:37:41.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.250+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f3405f270 con 0x7f7f340a4a20 2023-10-18T19:37:41.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.251+0000 7f7f2a7fc700 1 -- 172.21.15.88:0/927979772 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+11360 (secure 0 0 0) 0x7f7f240389f0 con 0x7f7f340a4a20 2023-10-18T19:37:41.253 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:41.253 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":31,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:41.127009+0000","last_up_change":"2023-10-18T19:37:40.120819+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":115732}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":115732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":115732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":115732}]},"public_addr":"172.21.15.88:6801/115732","cluster_addr":"172.21.15.88:6802/115732","heartbeat_back_addr":"172.21.15.88:6804/115732","heartbeat_front_addr":"172.21.15.88:6803/115732","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":115836}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":115836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":115836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":115836}]},"public_addr":"172.21.15.88:6809/115836","cluster_addr":"172.21.15.88:6810/115836","heartbeat_back_addr":"172.21.15.88:6812/115836","heartbeat_front_addr":"172.21.15.88:6811/115836","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":115939}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":115939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":115939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":115939}]},"public_addr":"172.21.15.88:6805/115939","cluster_addr":"172.21.15.88:6806/115939","heartbeat_back_addr":"172.21.15.88:6808/115939","heartbeat_front_addr":"172.21.15.88:6807/115939","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":116057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":116057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":116057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":116057}]},"public_addr":"172.21.15.88:6813/116057","cluster_addr":"172.21.15.88:6814/116057","heartbeat_back_addr":"172.21.15.88:6816/116057","heartbeat_front_addr":"172.21.15.88:6815/116057","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:41.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 >> v1:172.21.15.88:6800/113625 conn(0x7f7f18041cb0 legacy=0x7f7f18044170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 msgr2=0x7f7f340a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7f24000c00 tx=0x7f7f24007bb0).stop 2023-10-18T19:37:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 shutdown_connections 2023-10-18T19:37:41.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f341363e0 0x7f7f3414b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f3405e960 0x7f7f340a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 --2- 172.21.15.88:0/927979772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f340a4a20 0x7f7f340a6980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 >> 172.21.15.88:0/927979772 conn(0x7f7f34064bb0 msgr2=0x7f7f34135a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 shutdown_connections 2023-10-18T19:37:41.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:41.253+0000 7f7f3c5ff700 1 -- 172.21.15.88:0/927979772 wait complete. 2023-10-18T19:37:41.271 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T19:37:41.272 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-18T19:37:41.286 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-18T19:37:41.286 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:41.299 INFO:tasks.ceph.mds.a:Stopped 2023-10-18T19:37:41.299 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-18T19:37:41.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:41.354 INFO:tasks.ceph.mds.b:Stopped 2023-10-18T19:37:41.355 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-18T19:37:41.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T19:37:41.413 INFO:tasks.ceph.mds.c:Stopped 2023-10-18T19:37:45.423 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-18T19:37:45.423 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-18T19:37:45.436 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-18T19:37:45.436 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T19:37:45.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-18T19:37:45.442 INFO:tasks.ceph.mds.a:Started 2023-10-18T19:37:45.442 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2023-10-18T19:37:45.442 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T19:37:45.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-18T19:37:45.447 INFO:tasks.ceph.mds.b:Started 2023-10-18T19:37:45.448 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2023-10-18T19:37:45.448 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T19:37:45.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-18T19:37:45.453 INFO:tasks.ceph.mds.c:Started 2023-10-18T19:37:45.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T19:37:45.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:45.608 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-10-18T19:37:45.609 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2023-10-18T19:37:45.619 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-10-18T19:37:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.684+0000 7fe17a1ff700 1 Processor -- start 2023-10-18T19:37:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.684+0000 7fe17a1ff700 1 -- start start 2023-10-18T19:37:45.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe17a1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe17a1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 0x7fe174063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe17a1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17406a320 con 0x7fe174062ea0 2023-10-18T19:37:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe17a1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe174063280 con 0x7fe174069b40 2023-10-18T19:37:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe17a1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17406ab10 con 0x7fe17409db80 2023-10-18T19:37:45.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:45.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe173fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 0x7fe174063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:45.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe1737fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe174062ea0 0x7fe1740636e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39138/0 (socket says 172.21.15.88:39138) 2023-10-18T19:37:45.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:59802/0 (socket says 172.21.15.88:59802) 2023-10-18T19:37:45.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.685+0000 7fe1737fe700 1 -- 172.21.15.88:0/3669966390 learned_addr learned my addr 172.21.15.88:0/3669966390 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe172ffd700 1 -- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 msgr2=0x7fe174063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe172ffd700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 0x7fe174063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe172ffd700 1 -- 172.21.15.88:0/3669966390 >> v1:172.21.15.88:6789/0 conn(0x7fe174062ea0 legacy=0x7fe1740636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe1727fc700 1 -- 172.21.15.88:0/3669966390 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319571960 0 0) 0x7fe17406a320 con 0x7fe174062ea0 2023-10-18T19:37:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe172ffd700 1 -- 172.21.15.88:0/3669966390 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17406a080 con 0x7fe17409db80 2023-10-18T19:37:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe173fff700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 0x7fe174063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe172ffd700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe168009790 tx=0x7fe168009060).ready entity=mon.2 client_cookie=3a4c736679278e3a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe1727fc700 1 -- 172.21.15.88:0/3669966390 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800f510 con 0x7fe17409db80 2023-10-18T19:37:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe1727fc700 1 -- 172.21.15.88:0/3669966390 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16800f670 con 0x7fe17409db80 2023-10-18T19:37:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe1727fc700 1 -- 172.21.15.88:0/3669966390 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800f9f0 con 0x7fe17409db80 2023-10-18T19:37:45.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe17a1ff700 1 -- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 msgr2=0x7fe1740aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.686+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe168009790 tx=0x7fe168009060).stop 2023-10-18T19:37:45.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 -- 172.21.15.88:0/3669966390 shutdown_connections 2023-10-18T19:37:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174069b40 0x7fe174063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/3669966390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe17409db80 0x7fe1740aa700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 -- 172.21.15.88:0/3669966390 >> 172.21.15.88:0/3669966390 conn(0x7fe174067ef0 msgr2=0x7fe1740625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 -- 172.21.15.88:0/3669966390 shutdown_connections 2023-10-18T19:37:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.687+0000 7fe17a1ff700 1 -- 172.21.15.88:0/3669966390 wait complete. 2023-10-18T19:37:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.688+0000 7fe17a1ff700 1 Processor -- start 2023-10-18T19:37:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.688+0000 7fe17a1ff700 1 -- start start 2023-10-18T19:37:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174062ea0 0x7fe174093a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 0x7fe174148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:45.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740975b0 con 0x7fe17409db80 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17409cb60 con 0x7fe174062ea0 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe17a1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe174097ca0 con 0x7fe174069b40 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 0x7fe174148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:45.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174062ea0 0x7fe174093a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55608/0 (socket says 172.21.15.88:55608) 2023-10-18T19:37:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 0x7fe174148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:59818/0 (socket says 172.21.15.88:59818) 2023-10-18T19:37:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 -- 172.21.15.88:0/1011911084 learned_addr learned my addr 172.21.15.88:0/1011911084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 -- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 msgr2=0x7fe174148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 0x7fe174148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 -- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174062ea0 msgr2=0x7fe174093a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174062ea0 0x7fe174093a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.689+0000 7fe173fff700 1 -- 172.21.15.88:0/1011911084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009a20 con 0x7fe17409db80 2023-10-18T19:37:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe173fff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe16c00c0f0 tx=0x7fe16c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:45.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00cc30 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00f040 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c013400 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680092a0 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.690+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe174098130 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.691+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17405f270 con 0x7fe17409db80 2023-10-18T19:37:45.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.691+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fe16c0137f0 con 0x7fe17409db80 2023-10-18T19:37:45.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.692+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7fe16c0562e0 con 0x7fe17409db80 2023-10-18T19:37:45.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.696+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe16c036540 con 0x7fe17409db80 2023-10-18T19:37:45.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.844+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe174068ba0 con 0x7fe17409db80 2023-10-18T19:37:45.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.845+0000 7fe15b7fe700 1 -- 172.21.15.88:0/1011911084 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+11425 (secure 0 0 0) 0x7fe16c039d30 con 0x7fe17409db80 2023-10-18T19:37:45.847 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:45.847 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:45.635007+0000","last_up_change":"2023-10-18T19:37:40.120819+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":115732}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":115732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":115732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":115732}]},"public_addr":"172.21.15.88:6801/115732","cluster_addr":"172.21.15.88:6802/115732","heartbeat_back_addr":"172.21.15.88:6804/115732","heartbeat_front_addr":"172.21.15.88:6803/115732","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":115836}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":115836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":115836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":115836}]},"public_addr":"172.21.15.88:6809/115836","cluster_addr":"172.21.15.88:6810/115836","heartbeat_back_addr":"172.21.15.88:6812/115836","heartbeat_front_addr":"172.21.15.88:6811/115836","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":115939}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":115939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":115939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":115939}]},"public_addr":"172.21.15.88:6805/115939","cluster_addr":"172.21.15.88:6806/115939","heartbeat_back_addr":"172.21.15.88:6808/115939","heartbeat_front_addr":"172.21.15.88:6807/115939","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":116057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":116057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":116057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":116057}]},"public_addr":"172.21.15.88:6813/116057","cluster_addr":"172.21.15.88:6814/116057","heartbeat_back_addr":"172.21.15.88:6816/116057","heartbeat_front_addr":"172.21.15.88:6815/116057","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6817/2557744719":"2023-10-19T19:37:45.614894+0000","172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 >> v1:172.21.15.88:6800/113625 conn(0x7fe160041ce0 legacy=0x7fe1600441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 msgr2=0x7fe174096540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe16c00c0f0 tx=0x7fe16c00b040).stop 2023-10-18T19:37:45.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 shutdown_connections 2023-10-18T19:37:45.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17409db80 0x7fe174096540 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe174062ea0 0x7fe174093a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 --2- 172.21.15.88:0/1011911084 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe174069b40 0x7fe174148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:45.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 >> 172.21.15.88:0/1011911084 conn(0x7fe174067ef0 msgr2=0x7fe174063e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:45.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.846+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 shutdown_connections 2023-10-18T19:37:45.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:45.847+0000 7fe17a1ff700 1 -- 172.21.15.88:0/1011911084 wait complete. 2023-10-18T19:37:45.866 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T19:37:45.866 INFO:teuthology.run_tasks:Running task exec... 2023-10-18T19:37:45.877 INFO:teuthology.task.exec:Executing custom commands... 2023-10-18T19:37:45.877 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi088.front.sepia.ceph.com 2023-10-18T19:37:45.878 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-18T19:37:46.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.058+0000 7f6e741ff700 1 Processor -- start 2023-10-18T19:37:46.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.058+0000 7f6e741ff700 1 -- start start 2023-10-18T19:37:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e741ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c069180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e741ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e6c0a90a0 0x7f6e6c1435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e741ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c06bfe0 con 0x7f6e6c06bc00 2023-10-18T19:37:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e741ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0a3960 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e741ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c069670 con 0x7f6e6c13bd90 2023-10-18T19:37:46.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e71f9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6e6c06bc00 0x7f6e6c13b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56762/0 (socket says 172.21.15.88:56762) 2023-10-18T19:37:46.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e71f9b700 1 -- 172.21.15.88:0/1942564047 learned_addr learned my addr 172.21.15.88:0/1942564047 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:46.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7179a700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7279c700 1 --2- 172.21.15.88:0/1942564047 >> v2:172.21.15.88:3300/0 conn(0x7f6e6c0a90a0 0x7f6e6c1435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e70f99700 1 -- 172.21.15.88:0/1942564047 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142960807 0 0) 0x7f6e6c06bfe0 con 0x7f6e6c06bc00 2023-10-18T19:37:46.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e70f99700 1 -- 172.21.15.88:0/1942564047 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e580033f0 con 0x7f6e6c06bc00 2023-10-18T19:37:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7279c700 1 -- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 msgr2=0x7f6e6c069180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7279c700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c069180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7279c700 1 -- 172.21.15.88:0/1942564047 >> v1:172.21.15.88:6789/0 conn(0x7f6e6c06bc00 legacy=0x7f6e6c13b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7279c700 1 -- 172.21.15.88:0/1942564047 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0a3f20 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.059+0000 7f6e7179a700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c069180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e7279c700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c0a90a0 0x7f6e6c1435a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6e64009e60 tx=0x7f6e64009780).ready entity=mon.0 client_cookie=a129041c12f83698 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e70f99700 1 -- 172.21.15.88:0/1942564047 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400e070 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e70f99700 1 -- 172.21.15.88:0/1942564047 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400bab0 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e70f99700 1 -- 172.21.15.88:0/1942564047 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400be30 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 -- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c0a90a0 msgr2=0x7f6e6c1435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c0a90a0 0x7f6e6c1435a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6e64009e60 tx=0x7f6e64009780).stop 2023-10-18T19:37:46.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 -- 172.21.15.88:0/1942564047 shutdown_connections 2023-10-18T19:37:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c0a90a0 0x7f6e6c1435a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 --2- 172.21.15.88:0/1942564047 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c069180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 -- 172.21.15.88:0/1942564047 >> 172.21.15.88:0/1942564047 conn(0x7f6e6c063700 msgr2=0x7f6e6c063ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.060+0000 7f6e741ff700 1 -- 172.21.15.88:0/1942564047 shutdown_connections 2023-10-18T19:37:46.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.061+0000 7f6e741ff700 1 -- 172.21.15.88:0/1942564047 wait complete. 2023-10-18T19:37:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.062+0000 7f6e741ff700 1 Processor -- start 2023-10-18T19:37:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.062+0000 7f6e741ff700 1 -- start start 2023-10-18T19:37:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c06bc00 0x7f6e6c094950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c13aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c096230 con 0x7f6e6c06bc00 2023-10-18T19:37:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0955e0 con 0x7f6e6c13bd90 2023-10-18T19:37:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e741ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c095370 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60906/0 (socket says 172.21.15.88:60906) 2023-10-18T19:37:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e71f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c06bc00 0x7f6e6c094950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 -- 172.21.15.88:0/2853330205 learned_addr learned my addr 172.21.15.88:0/2853330205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7279c700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c13aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 -- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 msgr2=0x7f6e6c13aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c13aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 -- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c06bc00 msgr2=0x7f6e6c094950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c06bc00 0x7f6e6c094950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7179a700 1 -- 172.21.15.88:0/2853330205 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0092a0 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.063+0000 7f6e7279c700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e7179a700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6e5c00e930 tx=0x7f6e5c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c012600 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c012760 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e64009a20 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c012ae0 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.064+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c13af80 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.065+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c05a260 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.065+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f6e5c01b400 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.066+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7f6e5c055d80 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.070+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6e5c036090 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.245 INFO:tasks.ceph.mds.c.smithi088.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T19:37:46.246 INFO:tasks.ceph.mds.c.smithi088.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T19:37:46.246 INFO:tasks.ceph.mds.c.smithi088.stderr:*** Caught signal (Aborted) ** 2023-10-18T19:37:46.246 INFO:tasks.ceph.mds.c.smithi088.stderr: in thread 7f8436bf6700 thread_name:ms_dispatch 2023-10-18T19:37:46.247 INFO:tasks.ceph.mds.c.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:37:46.247 INFO:tasks.ceph.mds.c.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8440412cf0] 2023-10-18T19:37:46.247 INFO:tasks.ceph.mds.c.smithi088.stderr: 2: gsignal() 2023-10-18T19:37:46.248 INFO:tasks.ceph.mds.c.smithi088.stderr: 3: abort() 2023-10-18T19:37:46.248 INFO:tasks.ceph.mds.c.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f843f09009b] 2023-10-18T19:37:46.248 INFO:tasks.ceph.mds.c.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f843f09653c] 2023-10-18T19:37:46.248 INFO:tasks.ceph.mds.c.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f843f096597] 2023-10-18T19:37:46.248 INFO:tasks.ceph.mds.c.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f843f0967f8] 2023-10-18T19:37:46.249 INFO:tasks.ceph.mds.c.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x5647a5012b43] 2023-10-18T19:37:46.249 INFO:tasks.ceph.mds.c.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x5647a508789c] 2023-10-18T19:37:46.249 INFO:tasks.ceph.mds.c.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x5647a52cf6a2] 2023-10-18T19:37:46.249 INFO:tasks.ceph.mds.c.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x5647a4fec724] 2023-10-18T19:37:46.249 INFO:tasks.ceph.mds.c.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x5647a4fee181] 2023-10-18T19:37:46.250 INFO:tasks.ceph.mds.c.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x5647a4fbe348] 2023-10-18T19:37:46.250 INFO:tasks.ceph.mds.c.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x5647a4fc144d] 2023-10-18T19:37:46.250 INFO:tasks.ceph.mds.c.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x5647a4fc1fa3] 2023-10-18T19:37:46.250 INFO:tasks.ceph.mds.c.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f8441ec14ea] 2023-10-18T19:37:46.250 INFO:tasks.ceph.mds.c.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8441f75d51] 2023-10-18T19:37:46.251 INFO:tasks.ceph.mds.c.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f84404081ca] 2023-10-18T19:37:46.251 INFO:tasks.ceph.mds.c.smithi088.stderr: 19: clone() 2023-10-18T19:37:46.251 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-10-18T19:37:46.246+0000 7f8436bf6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:37:46.252 INFO:tasks.ceph.mds.c.smithi088.stderr: in thread 7f8436bf6700 thread_name:ms_dispatch 2023-10-18T19:37:46.252 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.252 INFO:tasks.ceph.mds.c.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:37:46.252 INFO:tasks.ceph.mds.c.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8440412cf0] 2023-10-18T19:37:46.252 INFO:tasks.ceph.mds.c.smithi088.stderr: 2: gsignal() 2023-10-18T19:37:46.253 INFO:tasks.ceph.mds.c.smithi088.stderr: 3: abort() 2023-10-18T19:37:46.253 INFO:tasks.ceph.mds.c.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f843f09009b] 2023-10-18T19:37:46.253 INFO:tasks.ceph.mds.c.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f843f09653c] 2023-10-18T19:37:46.253 INFO:tasks.ceph.mds.c.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f843f096597] 2023-10-18T19:37:46.253 INFO:tasks.ceph.mds.c.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f843f0967f8] 2023-10-18T19:37:46.254 INFO:tasks.ceph.mds.c.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x5647a5012b43] 2023-10-18T19:37:46.254 INFO:tasks.ceph.mds.c.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x5647a508789c] 2023-10-18T19:37:46.254 INFO:tasks.ceph.mds.c.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x5647a52cf6a2] 2023-10-18T19:37:46.254 INFO:tasks.ceph.mds.c.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x5647a4fec724] 2023-10-18T19:37:46.254 INFO:tasks.ceph.mds.c.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x5647a4fee181] 2023-10-18T19:37:46.255 INFO:tasks.ceph.mds.c.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x5647a4fbe348] 2023-10-18T19:37:46.255 INFO:tasks.ceph.mds.c.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x5647a4fc144d] 2023-10-18T19:37:46.255 INFO:tasks.ceph.mds.c.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x5647a4fc1fa3] 2023-10-18T19:37:46.255 INFO:tasks.ceph.mds.c.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f8441ec14ea] 2023-10-18T19:37:46.255 INFO:tasks.ceph.mds.c.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8441f75d51] 2023-10-18T19:37:46.256 INFO:tasks.ceph.mds.c.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f84404081ca] 2023-10-18T19:37:46.256 INFO:tasks.ceph.mds.c.smithi088.stderr: 19: clone() 2023-10-18T19:37:46.256 INFO:tasks.ceph.mds.c.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:37:46.256 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.256 INFO:tasks.ceph.mds.c.smithi088.stderr: 0> 2023-10-18T19:37:46.246+0000 7f8436bf6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:37:46.257 INFO:tasks.ceph.mds.c.smithi088.stderr: in thread 7f8436bf6700 thread_name:ms_dispatch 2023-10-18T19:37:46.257 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.257 INFO:tasks.ceph.mds.c.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:37:46.257 INFO:tasks.ceph.mds.c.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8440412cf0] 2023-10-18T19:37:46.257 INFO:tasks.ceph.mds.c.smithi088.stderr: 2: gsignal() 2023-10-18T19:37:46.258 INFO:tasks.ceph.mds.c.smithi088.stderr: 3: abort() 2023-10-18T19:37:46.258 INFO:tasks.ceph.mds.c.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f843f09009b] 2023-10-18T19:37:46.258 INFO:tasks.ceph.mds.c.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f843f09653c] 2023-10-18T19:37:46.258 INFO:tasks.ceph.mds.c.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f843f096597] 2023-10-18T19:37:46.258 INFO:tasks.ceph.mds.c.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f843f0967f8] 2023-10-18T19:37:46.259 INFO:tasks.ceph.mds.c.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x5647a5012b43] 2023-10-18T19:37:46.259 INFO:tasks.ceph.mds.c.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x5647a508789c] 2023-10-18T19:37:46.259 INFO:tasks.ceph.mds.c.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x5647a52cf6a2] 2023-10-18T19:37:46.259 INFO:tasks.ceph.mds.c.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x5647a4fec724] 2023-10-18T19:37:46.259 INFO:tasks.ceph.mds.c.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x5647a4fee181] 2023-10-18T19:37:46.260 INFO:tasks.ceph.mds.c.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x5647a4fbe348] 2023-10-18T19:37:46.260 INFO:tasks.ceph.mds.c.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x5647a4fc144d] 2023-10-18T19:37:46.260 INFO:tasks.ceph.mds.c.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x5647a4fc1fa3] 2023-10-18T19:37:46.260 INFO:tasks.ceph.mds.c.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f8441ec14ea] 2023-10-18T19:37:46.260 INFO:tasks.ceph.mds.c.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8441f75d51] 2023-10-18T19:37:46.261 INFO:tasks.ceph.mds.c.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f84404081ca] 2023-10-18T19:37:46.261 INFO:tasks.ceph.mds.c.smithi088.stderr: 19: clone() 2023-10-18T19:37:46.261 INFO:tasks.ceph.mds.c.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:37:46.261 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.262 INFO:tasks.ceph.mds.c.smithi088.stderr: 0> 2023-10-18T19:37:46.246+0000 7f8436bf6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:37:46.262 INFO:tasks.ceph.mds.c.smithi088.stderr: in thread 7f8436bf6700 thread_name:ms_dispatch 2023-10-18T19:37:46.262 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.262 INFO:tasks.ceph.mds.c.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:37:46.263 INFO:tasks.ceph.mds.c.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f8440412cf0] 2023-10-18T19:37:46.263 INFO:tasks.ceph.mds.c.smithi088.stderr: 2: gsignal() 2023-10-18T19:37:46.263 INFO:tasks.ceph.mds.c.smithi088.stderr: 3: abort() 2023-10-18T19:37:46.263 INFO:tasks.ceph.mds.c.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f843f09009b] 2023-10-18T19:37:46.263 INFO:tasks.ceph.mds.c.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f843f09653c] 2023-10-18T19:37:46.264 INFO:tasks.ceph.mds.c.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f843f096597] 2023-10-18T19:37:46.264 INFO:tasks.ceph.mds.c.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f843f0967f8] 2023-10-18T19:37:46.264 INFO:tasks.ceph.mds.c.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x5647a5012b43] 2023-10-18T19:37:46.264 INFO:tasks.ceph.mds.c.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x5647a508789c] 2023-10-18T19:37:46.264 INFO:tasks.ceph.mds.c.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x5647a52cf6a2] 2023-10-18T19:37:46.265 INFO:tasks.ceph.mds.c.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x5647a4fec724] 2023-10-18T19:37:46.265 INFO:tasks.ceph.mds.c.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x5647a4fee181] 2023-10-18T19:37:46.265 INFO:tasks.ceph.mds.c.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x5647a4fbe348] 2023-10-18T19:37:46.265 INFO:tasks.ceph.mds.c.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x5647a4fc144d] 2023-10-18T19:37:46.265 INFO:tasks.ceph.mds.c.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x5647a4fc1fa3] 2023-10-18T19:37:46.266 INFO:tasks.ceph.mds.c.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f8441ec14ea] 2023-10-18T19:37:46.266 INFO:tasks.ceph.mds.c.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8441f75d51] 2023-10-18T19:37:46.266 INFO:tasks.ceph.mds.c.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f84404081ca] 2023-10-18T19:37:46.266 INFO:tasks.ceph.mds.c.smithi088.stderr: 19: clone() 2023-10-18T19:37:46.266 INFO:tasks.ceph.mds.c.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:37:46.267 INFO:tasks.ceph.mds.c.smithi088.stderr: 2023-10-18T19:37:46.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.276+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6e6c068f60 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.276+0000 7f6e61ffb700 1 -- 172.21.15.88:0/2853330205 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7f6e5c016070 con 0x7f6e6c0a90a0 2023-10-18T19:37:46.278 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-18T19:37:46.278 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2023-10-18T19:37:46.279 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 3 2023-10-18T19:37:46.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.279 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2023-10-18T19:37:46.279 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 2 2023-10-18T19:37:46.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.280 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2023-10-18T19:37:46.280 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 4 2023-10-18T19:37:46.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.280 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": { 2023-10-18T19:37:46.280 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 3 2023-10-18T19:37:46.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.281 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2023-10-18T19:37:46.281 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable)": 12 2023-10-18T19:37:46.281 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.281 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-18T19:37:46.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 >> v1:172.21.15.88:6800/113625 conn(0x7f6e50041ce0 legacy=0x7f6e500441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 msgr2=0x7f6e6c13a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6e5c00e930 tx=0x7f6e5c009060).stop 2023-10-18T19:37:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 shutdown_connections 2023-10-18T19:37:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e6c13bd90 0x7f6e6c13aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e6c06bc00 0x7f6e6c094950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 --2- 172.21.15.88:0/2853330205 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e6c0a90a0 0x7f6e6c13a5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 >> 172.21.15.88:0/2853330205 conn(0x7f6e6c063700 msgr2=0x7f6e6c063ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 shutdown_connections 2023-10-18T19:37:46.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.278+0000 7f6e741ff700 1 -- 172.21.15.88:0/2853330205 wait complete. 2023-10-18T19:37:46.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-18T19:37:46.386 INFO:tasks.ceph.mds.c.smithi088.stderr:daemon-helper: command crashed with signal 6 2023-10-18T19:37:46.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.483+0000 7f6d423ff700 1 Processor -- start 2023-10-18T19:37:46.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.483+0000 7f6d423ff700 1 -- start start 2023-10-18T19:37:46.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d423ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3c0afaf0 0x7f6d3c068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c13c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d423ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0aad50 con 0x7f6d3c0672a0 2023-10-18T19:37:46.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d423ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c1365d0 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d423ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0afed0 con 0x7f6d3c066e80 2023-10-18T19:37:46.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3c0afaf0 0x7f6d3c068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c13c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3c0afaf0 0x7f6d3c068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47138/0 (socket says 172.21.15.88:47138) 2023-10-18T19:37:46.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 -- 172.21.15.88:0/3161248910 learned_addr learned my addr 172.21.15.88:0/3161248910 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:46.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d4099c700 1 --1- 172.21.15.88:0/3161248910 >> v1:172.21.15.88:6789/0 conn(0x7f6d3c0672a0 0x7f6d3c13c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56776/0 (socket says 172.21.15.88:56776) 2023-10-18T19:37:46.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 -- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 msgr2=0x7f6d3c13c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:46.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c13c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 -- 172.21.15.88:0/3161248910 >> v1:172.21.15.88:6789/0 conn(0x7f6d3c0672a0 legacy=0x7f6d3c13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 -- 172.21.15.88:0/3161248910 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c13c1e0 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3b7fe700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c13c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.485+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0afaf0 0x7f6d3c068200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6d2c006fd0 tx=0x7f6d2c0090f0).ready entity=mon.0 client_cookie=dda1e8ab6ae077e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d3affd700 1 -- 172.21.15.88:0/3161248910 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00b610 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d3affd700 1 -- 172.21.15.88:0/3161248910 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00b770 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d3affd700 1 -- 172.21.15.88:0/3161248910 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00baf0 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 -- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0afaf0 msgr2=0x7f6d3c068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0afaf0 0x7f6d3c068200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6d2c006fd0 tx=0x7f6d2c0090f0).stop 2023-10-18T19:37:46.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 -- 172.21.15.88:0/3161248910 shutdown_connections 2023-10-18T19:37:46.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0afaf0 0x7f6d3c068200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3161248910 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c13c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 -- 172.21.15.88:0/3161248910 >> 172.21.15.88:0/3161248910 conn(0x7f6d3c064480 msgr2=0x7f6d3c064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 -- 172.21.15.88:0/3161248910 shutdown_connections 2023-10-18T19:37:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.486+0000 7f6d423ff700 1 -- 172.21.15.88:0/3161248910 wait complete. 2023-10-18T19:37:46.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.488+0000 7f6d423ff700 1 Processor -- start 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.488+0000 7f6d423ff700 1 -- start start 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.488+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 0x7f6d3c0a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d423ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d3c0afaf0 0x7f6d3c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d423ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1415a0 con 0x7f6d3c0672a0 2023-10-18T19:37:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d423ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0a4d00 con 0x7f6d3c0afaf0 2023-10-18T19:37:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d423ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0a49a0 con 0x7f6d3c066e80 2023-10-18T19:37:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 0x7f6d3c0a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60916/0 (socket says 172.21.15.88:60916) 2023-10-18T19:37:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3bfff700 1 -- 172.21.15.88:0/3485783391 learned_addr learned my addr 172.21.15.88:0/3485783391 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d4099c700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d3c0afaf0 0x7f6d3c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 -- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 msgr2=0x7f6d3c1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 -- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d3c0afaf0 msgr2=0x7f6d3c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d3c0afaf0 0x7f6d3c148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 -- 172.21.15.88:0/3485783391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300092a0 con 0x7f6d3c0672a0 2023-10-18T19:37:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.489+0000 7f6d3b7fe700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 0x7f6d3c0a54e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6d3000e950 tx=0x7f6d30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.490+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012600 con 0x7f6d3c0672a0 2023-10-18T19:37:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.490+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d30012760 con 0x7f6d3c0672a0 2023-10-18T19:37:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.490+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012b00 con 0x7f6d3c0672a0 2023-10-18T19:37:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.490+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c009370 con 0x7f6d3c0672a0 2023-10-18T19:37:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.490+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c1494c0 con 0x7f6d3c0672a0 2023-10-18T19:37:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.491+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f6d3001b400 con 0x7f6d3c0672a0 2023-10-18T19:37:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.491+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c0a5ac0 con 0x7f6d3c0672a0 2023-10-18T19:37:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.491+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7f6d30055d30 con 0x7f6d3c0672a0 2023-10-18T19:37:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.495+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6d30036210 con 0x7f6d3c0672a0 2023-10-18T19:37:46.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.643+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6d3c148e20 con 0x7f6d3c0672a0 2023-10-18T19:37:46.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.644+0000 7f6d23fff700 1 -- 172.21.15.88:0/3485783391 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+20913 (secure 0 0 0) 0x7f6d30039830 con 0x7f6d3c0672a0 2023-10-18T19:37:46.646 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:46.646 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-10-18T19:37:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 34, 2023-10-18T19:37:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "fe6fac15-13f3-4a33-b6ef-f18d02d18f87", 2023-10-18T19:37:46.647 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2023-10-18T19:33:59.453951+0000", 2023-10-18T19:37:46.648 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2023-10-18T19:37:45.635007+0000", 2023-10-18T19:37:46.648 INFO:teuthology.orchestra.run.smithi088.stdout: "last_up_change": "2023-10-18T19:37:40.120819+0000", 2023-10-18T19:37:46.648 INFO:teuthology.orchestra.run.smithi088.stdout: "last_in_change": "2023-10-18T19:34:06.488799+0000", 2023-10-18T19:37:46.648 INFO:teuthology.orchestra.run.smithi088.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_num": 5799936, 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_set": [ 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "pglog_hardlimit", 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "purged_snapdirs", 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_deletes", 2023-10-18T19:37:46.649 INFO:teuthology.orchestra.run.smithi088.stdout: "sortbitwise" 2023-10-18T19:37:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-10-18T19:37:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_version": 8, 2023-10-18T19:37:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "full_ratio": 0.94999998807907104, 2023-10-18T19:37:46.650 INFO:teuthology.orchestra.run.smithi088.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-18T19:37:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-18T19:37:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_snapshot": "", 2023-10-18T19:37:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_max": 4, 2023-10-18T19:37:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "max_osd": 4, 2023-10-18T19:37:46.651 INFO:teuthology.orchestra.run.smithi088.stdout: "require_min_compat_client": "nautilus", 2023-10-18T19:37:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "min_compat_client": "jewel", 2023-10-18T19:37:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "require_osd_release": "nautilus", 2023-10-18T19:37:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "pools": [ 2023-10-18T19:37:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.652 INFO:teuthology.orchestra.run.smithi088.stdout: "pool": 1, 2023-10-18T19:37:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_name": "rbd", 2023-10-18T19:37:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "create_time": "2023-10-18T19:34:09.738627+0000", 2023-10-18T19:37:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "flags": 1, 2023-10-18T19:37:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_names": "hashpspool", 2023-10-18T19:37:46.653 INFO:teuthology.orchestra.run.smithi088.stdout: "type": 1, 2023-10-18T19:37:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 2, 2023-10-18T19:37:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "min_size": 1, 2023-10-18T19:37:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_rule": 0, 2023-10-18T19:37:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_count": 0, 2023-10-18T19:37:46.654 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_target": 0, 2023-10-18T19:37:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_barrier": 0, 2023-10-18T19:37:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-18T19:37:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "object_hash": 2, 2023-10-18T19:37:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_autoscale_mode": "off", 2023-10-18T19:37:46.655 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num": 8, 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num": 8, 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num_target": 8, 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_target": 8, 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_pending": 8, 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "last_pg_merge_meta": { 2023-10-18T19:37:46.656 INFO:teuthology.orchestra.run.smithi088.stdout: "source_pgid": "0.0", 2023-10-18T19:37:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "ready_epoch": 0, 2023-10-18T19:37:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_started": 0, 2023-10-18T19:37:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_clean": 0, 2023-10-18T19:37:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "source_version": "0'0", 2023-10-18T19:37:46.657 INFO:teuthology.orchestra.run.smithi088.stdout: "target_version": "0'0" 2023-10-18T19:37:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "last_change": "12", 2023-10-18T19:37:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend": "0", 2023-10-18T19:37:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-18T19:37:46.658 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_preluminous": "0", 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "auid": 0, 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_mode": "selfmanaged", 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_seq": 0, 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_epoch": 0, 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_snaps": [], 2023-10-18T19:37:46.659 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_snaps": "[]", 2023-10-18T19:37:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_bytes": 0, 2023-10-18T19:37:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_objects": 0, 2023-10-18T19:37:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "tiers": [], 2023-10-18T19:37:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "tier_of": -1, 2023-10-18T19:37:46.660 INFO:teuthology.orchestra.run.smithi088.stdout: "read_tier": -1, 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "write_tier": -1, 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_mode": "none", 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_bytes": 0, 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_objects": 0, 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-18T19:37:46.661 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-18T19:37:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-18T19:37:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_flush_age": 0, 2023-10-18T19:37:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_evict_age": 0, 2023-10-18T19:37:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_profile": "", 2023-10-18T19:37:46.662 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_params": { 2023-10-18T19:37:46.663 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "none" 2023-10-18T19:37:46.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.663 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_period": 0, 2023-10-18T19:37:46.663 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_count": 0, 2023-10-18T19:37:46.663 INFO:teuthology.orchestra.run.smithi088.stdout: "use_gmt_hitset": true, 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "min_read_recency_for_promote": 0, 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "min_write_recency_for_promote": 0, 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_grade_decay_rate": 0, 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_search_last_n": 0, 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "grade_table": [], 2023-10-18T19:37:46.664 INFO:teuthology.orchestra.run.smithi088.stdout: "stripe_width": 0, 2023-10-18T19:37:46.665 INFO:teuthology.orchestra.run.smithi088.stdout: "expected_num_objects": 0, 2023-10-18T19:37:46.665 INFO:teuthology.orchestra.run.smithi088.stdout: "fast_read": false, 2023-10-18T19:37:46.665 INFO:teuthology.orchestra.run.smithi088.stdout: "options": {}, 2023-10-18T19:37:46.665 INFO:teuthology.orchestra.run.smithi088.stdout: "application_metadata": { 2023-10-18T19:37:46.665 INFO:teuthology.orchestra.run.smithi088.stdout: "rbd": {} 2023-10-18T19:37:46.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.666 INFO:teuthology.orchestra.run.smithi088.stdout: "pool": 2, 2023-10-18T19:37:46.666 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_name": "cephfs_metadata", 2023-10-18T19:37:46.667 INFO:teuthology.orchestra.run.smithi088.stdout: "create_time": "2023-10-18T19:34:18.877868+0000", 2023-10-18T19:37:46.667 INFO:teuthology.orchestra.run.smithi088.stdout: "flags": 1, 2023-10-18T19:37:46.667 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_names": "hashpspool", 2023-10-18T19:37:46.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type": 1, 2023-10-18T19:37:46.667 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 2, 2023-10-18T19:37:46.668 INFO:teuthology.orchestra.run.smithi088.stdout: "min_size": 1, 2023-10-18T19:37:46.668 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_rule": 0, 2023-10-18T19:37:46.668 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_count": 0, 2023-10-18T19:37:46.668 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_target": 0, 2023-10-18T19:37:46.668 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_barrier": 0, 2023-10-18T19:37:46.669 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-18T19:37:46.669 INFO:teuthology.orchestra.run.smithi088.stdout: "object_hash": 2, 2023-10-18T19:37:46.669 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_autoscale_mode": "off", 2023-10-18T19:37:46.669 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num": 64, 2023-10-18T19:37:46.669 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num": 64, 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num_target": 64, 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_target": 64, 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_pending": 64, 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "last_pg_merge_meta": { 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "source_pgid": "0.0", 2023-10-18T19:37:46.670 INFO:teuthology.orchestra.run.smithi088.stdout: "ready_epoch": 0, 2023-10-18T19:37:46.671 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_started": 0, 2023-10-18T19:37:46.671 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_clean": 0, 2023-10-18T19:37:46.671 INFO:teuthology.orchestra.run.smithi088.stdout: "source_version": "0'0", 2023-10-18T19:37:46.671 INFO:teuthology.orchestra.run.smithi088.stdout: "target_version": "0'0" 2023-10-18T19:37:46.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "last_change": "15", 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend": "0", 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_preluminous": "0", 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "auid": 0, 2023-10-18T19:37:46.672 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_mode": "selfmanaged", 2023-10-18T19:37:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_seq": 0, 2023-10-18T19:37:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_epoch": 0, 2023-10-18T19:37:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_snaps": [], 2023-10-18T19:37:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_snaps": "[]", 2023-10-18T19:37:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_bytes": 0, 2023-10-18T19:37:46.674 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_objects": 0, 2023-10-18T19:37:46.674 INFO:teuthology.orchestra.run.smithi088.stdout: "tiers": [], 2023-10-18T19:37:46.674 INFO:teuthology.orchestra.run.smithi088.stdout: "tier_of": -1, 2023-10-18T19:37:46.674 INFO:teuthology.orchestra.run.smithi088.stdout: "read_tier": -1, 2023-10-18T19:37:46.674 INFO:teuthology.orchestra.run.smithi088.stdout: "write_tier": -1, 2023-10-18T19:37:46.675 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_mode": "none", 2023-10-18T19:37:46.675 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_bytes": 0, 2023-10-18T19:37:46.675 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_objects": 0, 2023-10-18T19:37:46.675 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-18T19:37:46.675 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_flush_age": 0, 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_evict_age": 0, 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_profile": "", 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_params": { 2023-10-18T19:37:46.676 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "none" 2023-10-18T19:37:46.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.677 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_period": 0, 2023-10-18T19:37:46.677 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_count": 0, 2023-10-18T19:37:46.677 INFO:teuthology.orchestra.run.smithi088.stdout: "use_gmt_hitset": true, 2023-10-18T19:37:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: "min_read_recency_for_promote": 0, 2023-10-18T19:37:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: "min_write_recency_for_promote": 0, 2023-10-18T19:37:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_grade_decay_rate": 0, 2023-10-18T19:37:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_search_last_n": 0, 2023-10-18T19:37:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: "grade_table": [], 2023-10-18T19:37:46.679 INFO:teuthology.orchestra.run.smithi088.stdout: "stripe_width": 0, 2023-10-18T19:37:46.679 INFO:teuthology.orchestra.run.smithi088.stdout: "expected_num_objects": 0, 2023-10-18T19:37:46.679 INFO:teuthology.orchestra.run.smithi088.stdout: "fast_read": false, 2023-10-18T19:37:46.679 INFO:teuthology.orchestra.run.smithi088.stdout: "options": { 2023-10-18T19:37:46.679 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_autoscale_bias": 4, 2023-10-18T19:37:46.680 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_min": 16, 2023-10-18T19:37:46.680 INFO:teuthology.orchestra.run.smithi088.stdout: "recovery_priority": 5 2023-10-18T19:37:46.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.680 INFO:teuthology.orchestra.run.smithi088.stdout: "application_metadata": { 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs": { 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": "cephfs" 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.682 INFO:teuthology.orchestra.run.smithi088.stdout: "pool": 3, 2023-10-18T19:37:46.682 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_name": "cephfs_data", 2023-10-18T19:37:46.682 INFO:teuthology.orchestra.run.smithi088.stdout: "create_time": "2023-10-18T19:34:20.222147+0000", 2023-10-18T19:37:46.682 INFO:teuthology.orchestra.run.smithi088.stdout: "flags": 1, 2023-10-18T19:37:46.682 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_names": "hashpspool", 2023-10-18T19:37:46.683 INFO:teuthology.orchestra.run.smithi088.stdout: "type": 1, 2023-10-18T19:37:46.683 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 2, 2023-10-18T19:37:46.683 INFO:teuthology.orchestra.run.smithi088.stdout: "min_size": 1, 2023-10-18T19:37:46.683 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_rule": 0, 2023-10-18T19:37:46.683 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_count": 0, 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_target": 0, 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_barrier": 0, 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "object_hash": 2, 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_autoscale_mode": "off", 2023-10-18T19:37:46.684 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num": 64, 2023-10-18T19:37:46.685 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num": 64, 2023-10-18T19:37:46.685 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num_target": 64, 2023-10-18T19:37:46.685 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_target": 64, 2023-10-18T19:37:46.685 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_pending": 64, 2023-10-18T19:37:46.685 INFO:teuthology.orchestra.run.smithi088.stdout: "last_pg_merge_meta": { 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "source_pgid": "0.0", 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "ready_epoch": 0, 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_started": 0, 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_clean": 0, 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "source_version": "0'0", 2023-10-18T19:37:46.686 INFO:teuthology.orchestra.run.smithi088.stdout: "target_version": "0'0" 2023-10-18T19:37:46.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.687 INFO:teuthology.orchestra.run.smithi088.stdout: "last_change": "16", 2023-10-18T19:37:46.687 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend": "0", 2023-10-18T19:37:46.687 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-18T19:37:46.687 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_preluminous": "0", 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "auid": 0, 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_mode": "selfmanaged", 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_seq": 0, 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_epoch": 0, 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_snaps": [], 2023-10-18T19:37:46.688 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_snaps": "[]", 2023-10-18T19:37:46.689 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_bytes": 0, 2023-10-18T19:37:46.689 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_objects": 0, 2023-10-18T19:37:46.689 INFO:teuthology.orchestra.run.smithi088.stdout: "tiers": [], 2023-10-18T19:37:46.689 INFO:teuthology.orchestra.run.smithi088.stdout: "tier_of": -1, 2023-10-18T19:37:46.689 INFO:teuthology.orchestra.run.smithi088.stdout: "read_tier": -1, 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "write_tier": -1, 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_mode": "none", 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_bytes": 0, 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_objects": 0, 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-18T19:37:46.690 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-18T19:37:46.691 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-18T19:37:46.691 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_flush_age": 0, 2023-10-18T19:37:46.691 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_evict_age": 0, 2023-10-18T19:37:46.691 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_profile": "", 2023-10-18T19:37:46.691 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_params": { 2023-10-18T19:37:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "none" 2023-10-18T19:37:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_period": 0, 2023-10-18T19:37:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_count": 0, 2023-10-18T19:37:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "use_gmt_hitset": true, 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "min_read_recency_for_promote": 0, 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "min_write_recency_for_promote": 0, 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_grade_decay_rate": 0, 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_search_last_n": 0, 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "grade_table": [], 2023-10-18T19:37:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "stripe_width": 0, 2023-10-18T19:37:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "expected_num_objects": 0, 2023-10-18T19:37:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "fast_read": false, 2023-10-18T19:37:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "options": { 2023-10-18T19:37:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_min": 64, 2023-10-18T19:37:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "target_size_ratio": 0.89999997615814209 2023-10-18T19:37:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "application_metadata": { 2023-10-18T19:37:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "cephfs": { 2023-10-18T19:37:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "data": "cephfs" 2023-10-18T19:37:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "pool": 4, 2023-10-18T19:37:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_name": "device_health_metrics", 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "create_time": "2023-10-18T19:37:15.428276+0000", 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "flags": 1, 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "flags_names": "hashpspool", 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "type": 1, 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 2, 2023-10-18T19:37:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "min_size": 1, 2023-10-18T19:37:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_rule": 0, 2023-10-18T19:37:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_count": 0, 2023-10-18T19:37:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_target": 0, 2023-10-18T19:37:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_barrier": 0, 2023-10-18T19:37:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-18T19:37:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "object_hash": 2, 2023-10-18T19:37:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_autoscale_mode": "off", 2023-10-18T19:37:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num": 1, 2023-10-18T19:37:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num": 1, 2023-10-18T19:37:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_placement_num_target": 1, 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_target": 1, 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_pending": 1, 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "last_pg_merge_meta": { 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "source_pgid": "0.0", 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "ready_epoch": 0, 2023-10-18T19:37:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_started": 0, 2023-10-18T19:37:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "last_epoch_clean": 0, 2023-10-18T19:37:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "source_version": "0'0", 2023-10-18T19:37:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "target_version": "0'0" 2023-10-18T19:37:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "last_change": "21", 2023-10-18T19:37:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend": "0", 2023-10-18T19:37:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-18T19:37:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "last_force_op_resend_preluminous": "0", 2023-10-18T19:37:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "auid": 0, 2023-10-18T19:37:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_mode": "selfmanaged", 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_seq": 0, 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "snap_epoch": 0, 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "pool_snaps": [], 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_snaps": "[]", 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_bytes": 0, 2023-10-18T19:37:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "quota_max_objects": 0, 2023-10-18T19:37:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "tiers": [], 2023-10-18T19:37:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "tier_of": -1, 2023-10-18T19:37:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "read_tier": -1, 2023-10-18T19:37:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "write_tier": -1, 2023-10-18T19:37:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_mode": "none", 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_bytes": 0, 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "target_max_objects": 0, 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-18T19:37:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_flush_age": 0, 2023-10-18T19:37:46.706 INFO:teuthology.orchestra.run.smithi088.stdout: "cache_min_evict_age": 0, 2023-10-18T19:37:46.706 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_profile": "", 2023-10-18T19:37:46.706 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_params": { 2023-10-18T19:37:46.706 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "none" 2023-10-18T19:37:46.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.707 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_period": 0, 2023-10-18T19:37:46.707 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_count": 0, 2023-10-18T19:37:46.707 INFO:teuthology.orchestra.run.smithi088.stdout: "use_gmt_hitset": true, 2023-10-18T19:37:46.707 INFO:teuthology.orchestra.run.smithi088.stdout: "min_read_recency_for_promote": 0, 2023-10-18T19:37:46.707 INFO:teuthology.orchestra.run.smithi088.stdout: "min_write_recency_for_promote": 0, 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_grade_decay_rate": 0, 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "hit_set_search_last_n": 0, 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "grade_table": [], 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "stripe_width": 0, 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "expected_num_objects": 0, 2023-10-18T19:37:46.708 INFO:teuthology.orchestra.run.smithi088.stdout: "fast_read": false, 2023-10-18T19:37:46.709 INFO:teuthology.orchestra.run.smithi088.stdout: "options": { 2023-10-18T19:37:46.709 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_num_min": 1 2023-10-18T19:37:46.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.709 INFO:teuthology.orchestra.run.smithi088.stdout: "application_metadata": { 2023-10-18T19:37:46.709 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr_devicehealth": {} 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: "osds": [ 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.710 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 0, 2023-10-18T19:37:46.711 INFO:teuthology.orchestra.run.smithi088.stdout: "uuid": "8dd014e9-edff-49f4-a64e-a9a08eb5bbf2", 2023-10-18T19:37:46.711 INFO:teuthology.orchestra.run.smithi088.stdout: "up": 1, 2023-10-18T19:37:46.711 INFO:teuthology.orchestra.run.smithi088.stdout: "in": 1, 2023-10-18T19:37:46.711 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 1, 2023-10-18T19:37:46.711 INFO:teuthology.orchestra.run.smithi088.stdout: "primary_affinity": 1, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_begin": 9, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_end": 21, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "up_from": 27, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "up_thru": 30, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "down_at": 22, 2023-10-18T19:37:46.712 INFO:teuthology.orchestra.run.smithi088.stdout: "lost_at": 0, 2023-10-18T19:37:46.713 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2023-10-18T19:37:46.713 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.713 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.713 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6801", 2023-10-18T19:37:46.714 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115732 2023-10-18T19:37:46.714 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.714 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.714 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addrs": { 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6802", 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115732 2023-10-18T19:37:46.715 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addrs": { 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.716 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.717 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6804", 2023-10-18T19:37:46.717 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115732 2023-10-18T19:37:46.717 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.717 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.718 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addrs": { 2023-10-18T19:37:46.718 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.718 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.718 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6803", 2023-10-18T19:37:46.719 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115732 2023-10-18T19:37:46.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.719 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.719 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6801/115732", 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addr": "172.21.15.88:6802/115732", 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addr": "172.21.15.88:6804/115732", 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addr": "172.21.15.88:6803/115732", 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "state": [ 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "exists", 2023-10-18T19:37:46.720 INFO:teuthology.orchestra.run.smithi088.stdout: "up" 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 1, 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: "uuid": "b8c2b64b-e04e-435d-8eba-9cdc531cfd37", 2023-10-18T19:37:46.721 INFO:teuthology.orchestra.run.smithi088.stdout: "up": 1, 2023-10-18T19:37:46.722 INFO:teuthology.orchestra.run.smithi088.stdout: "in": 1, 2023-10-18T19:37:46.722 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 1, 2023-10-18T19:37:46.722 INFO:teuthology.orchestra.run.smithi088.stdout: "primary_affinity": 1, 2023-10-18T19:37:46.722 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_begin": 9, 2023-10-18T19:37:46.722 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_end": 22, 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "up_from": 28, 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "up_thru": 30, 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "down_at": 23, 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "lost_at": 0, 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2023-10-18T19:37:46.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6809", 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115836 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.724 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.725 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addrs": { 2023-10-18T19:37:46.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.725 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6810", 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115836 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.726 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addrs": { 2023-10-18T19:37:46.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.727 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6812", 2023-10-18T19:37:46.727 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115836 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addrs": { 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6811", 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115836 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.730 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6809/115836", 2023-10-18T19:37:46.730 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addr": "172.21.15.88:6810/115836", 2023-10-18T19:37:46.730 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addr": "172.21.15.88:6812/115836", 2023-10-18T19:37:46.730 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addr": "172.21.15.88:6811/115836", 2023-10-18T19:37:46.730 INFO:teuthology.orchestra.run.smithi088.stdout: "state": [ 2023-10-18T19:37:46.731 INFO:teuthology.orchestra.run.smithi088.stdout: "exists", 2023-10-18T19:37:46.731 INFO:teuthology.orchestra.run.smithi088.stdout: "up" 2023-10-18T19:37:46.731 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 2, 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "uuid": "4527909d-9edd-46d9-abdd-6ab5a4da9e5b", 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "up": 1, 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "in": 1, 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 1, 2023-10-18T19:37:46.732 INFO:teuthology.orchestra.run.smithi088.stdout: "primary_affinity": 1, 2023-10-18T19:37:46.733 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_begin": 9, 2023-10-18T19:37:46.733 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_end": 23, 2023-10-18T19:37:46.733 INFO:teuthology.orchestra.run.smithi088.stdout: "up_from": 29, 2023-10-18T19:37:46.733 INFO:teuthology.orchestra.run.smithi088.stdout: "up_thru": 30, 2023-10-18T19:37:46.733 INFO:teuthology.orchestra.run.smithi088.stdout: "down_at": 24, 2023-10-18T19:37:46.734 INFO:teuthology.orchestra.run.smithi088.stdout: "lost_at": 0, 2023-10-18T19:37:46.734 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2023-10-18T19:37:46.734 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.734 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6805", 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115939 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.735 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addrs": { 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6806", 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115939 2023-10-18T19:37:46.736 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.737 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.737 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addrs": { 2023-10-18T19:37:46.737 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.738 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.738 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6808", 2023-10-18T19:37:46.738 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115939 2023-10-18T19:37:46.738 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.738 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addrs": { 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.739 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6807", 2023-10-18T19:37:46.740 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 115939 2023-10-18T19:37:46.740 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.740 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.740 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6805/115939", 2023-10-18T19:37:46.741 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addr": "172.21.15.88:6806/115939", 2023-10-18T19:37:46.741 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addr": "172.21.15.88:6808/115939", 2023-10-18T19:37:46.741 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addr": "172.21.15.88:6807/115939", 2023-10-18T19:37:46.741 INFO:teuthology.orchestra.run.smithi088.stdout: "state": [ 2023-10-18T19:37:46.741 INFO:teuthology.orchestra.run.smithi088.stdout: "exists", 2023-10-18T19:37:46.742 INFO:teuthology.orchestra.run.smithi088.stdout: "up" 2023-10-18T19:37:46.742 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.742 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 3, 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "uuid": "60440fa3-794f-4b22-b0e6-76801bcaf0c5", 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "up": 1, 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "in": 1, 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 1, 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "primary_affinity": 1, 2023-10-18T19:37:46.743 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_begin": 9, 2023-10-18T19:37:46.744 INFO:teuthology.orchestra.run.smithi088.stdout: "last_clean_end": 24, 2023-10-18T19:37:46.744 INFO:teuthology.orchestra.run.smithi088.stdout: "up_from": 30, 2023-10-18T19:37:46.744 INFO:teuthology.orchestra.run.smithi088.stdout: "up_thru": 30, 2023-10-18T19:37:46.744 INFO:teuthology.orchestra.run.smithi088.stdout: "down_at": 25, 2023-10-18T19:37:46.744 INFO:teuthology.orchestra.run.smithi088.stdout: "lost_at": 0, 2023-10-18T19:37:46.745 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2023-10-18T19:37:46.745 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.745 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.745 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6813", 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 116057 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addrs": { 2023-10-18T19:37:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6814", 2023-10-18T19:37:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 116057 2023-10-18T19:37:46.747 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addrs": { 2023-10-18T19:37:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6816", 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 116057 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addrs": { 2023-10-18T19:37:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2023-10-18T19:37:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-10-18T19:37:46.750 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6815", 2023-10-18T19:37:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 116057 2023-10-18T19:37:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.751 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6813/116057", 2023-10-18T19:37:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_addr": "172.21.15.88:6814/116057", 2023-10-18T19:37:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_back_addr": "172.21.15.88:6816/116057", 2023-10-18T19:37:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "heartbeat_front_addr": "172.21.15.88:6815/116057", 2023-10-18T19:37:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "state": [ 2023-10-18T19:37:46.752 INFO:teuthology.orchestra.run.smithi088.stdout: "exists", 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "up" 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_xinfo": [ 2023-10-18T19:37:46.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 0, 2023-10-18T19:37:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "down_stamp": "0.000000", 2023-10-18T19:37:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_probability": 0, 2023-10-18T19:37:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_interval": 0, 2023-10-18T19:37:46.754 INFO:teuthology.orchestra.run.smithi088.stdout: "features": 4540138314316775423, 2023-10-18T19:37:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "old_weight": 0, 2023-10-18T19:37:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "last_purged_snaps_scrub": "0.000000", 2023-10-18T19:37:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: "dead_epoch": 0 2023-10-18T19:37:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 1, 2023-10-18T19:37:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "down_stamp": "0.000000", 2023-10-18T19:37:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_probability": 0, 2023-10-18T19:37:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_interval": 0, 2023-10-18T19:37:46.756 INFO:teuthology.orchestra.run.smithi088.stdout: "features": 4540138314316775423, 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "old_weight": 0, 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "last_purged_snaps_scrub": "0.000000", 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "dead_epoch": 0 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.757 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 2, 2023-10-18T19:37:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "down_stamp": "0.000000", 2023-10-18T19:37:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_probability": 0, 2023-10-18T19:37:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_interval": 0, 2023-10-18T19:37:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "features": 4540138314316775423, 2023-10-18T19:37:46.758 INFO:teuthology.orchestra.run.smithi088.stdout: "old_weight": 0, 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "last_purged_snaps_scrub": "0.000000", 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "dead_epoch": 0 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": 3, 2023-10-18T19:37:46.759 INFO:teuthology.orchestra.run.smithi088.stdout: "down_stamp": "2023-10-18T19:37:34.079545+0000", 2023-10-18T19:37:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_probability": 0, 2023-10-18T19:37:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "laggy_interval": 0, 2023-10-18T19:37:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": 4540138314316775423, 2023-10-18T19:37:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "old_weight": 0, 2023-10-18T19:37:46.760 INFO:teuthology.orchestra.run.smithi088.stdout: "last_purged_snaps_scrub": "0.000000", 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "dead_epoch": 0 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_upmap": [], 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_upmap_items": [], 2023-10-18T19:37:46.761 INFO:teuthology.orchestra.run.smithi088.stdout: "pg_temp": [], 2023-10-18T19:37:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "primary_temp": [], 2023-10-18T19:37:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklist": { 2023-10-18T19:37:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "172.21.15.88:6817/2557744719": "2023-10-19T19:37:45.614894+0000", 2023-10-18T19:37:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "172.21.15.88:6800/107321": "2023-10-19T19:37:15.335447+0000" 2023-10-18T19:37:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "range_blocklist": {}, 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "erasure_code_profiles": { 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "default": { 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "crush-failure-domain": "osd", 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "k": "2", 2023-10-18T19:37:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "m": "1", 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "plugin": "jerasure", 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "ruleset-failure-domain": "osd", 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "technique": "reed_sol_van" 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-10-18T19:37:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_snaps_queue": [], 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "new_removed_snaps": [], 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "new_purged_snaps": [], 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_node_flags": {}, 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "device_class_flags": {}, 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": { 2023-10-18T19:37:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode_enabled": false, 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_bucket_count": 0, 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "degraded_stretch_mode": 0, 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "recovering_stretch_mode": 0, 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode_bucket": 0 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-10-18T19:37:46.766 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-10-18T19:37:46.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 >> v1:172.21.15.88:6800/113625 conn(0x7f6d28041ce0 legacy=0x7f6d280441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 msgr2=0x7f6d3c0a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 0x7f6d3c0a54e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6d3000e950 tx=0x7f6d30009060).stop 2023-10-18T19:37:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 shutdown_connections 2023-10-18T19:37:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d3c0afaf0 0x7f6d3c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d3c066e80 0x7f6d3c1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 --2- 172.21.15.88:0/3485783391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c0672a0 0x7f6d3c0a54e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 >> 172.21.15.88:0/3485783391 conn(0x7f6d3c064480 msgr2=0x7f6d3c13b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:46.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 shutdown_connections 2023-10-18T19:37:46.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.646+0000 7f6d423ff700 1 -- 172.21.15.88:0/3485783391 wait complete. 2023-10-18T19:37:46.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release pacific' 2023-10-18T19:37:46.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.950+0000 7f6d901ff700 1 Processor -- start 2023-10-18T19:37:46.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.950+0000 7f6d901ff700 1 -- start start 2023-10-18T19:37:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d901ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d901ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 0x7f6d8813cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d901ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d880aad50 con 0x7f6d88066e80 2023-10-18T19:37:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d901ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881365d0 con 0x7f6d880672a0 2023-10-18T19:37:46.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d901ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880afed0 con 0x7f6d880afaf0 2023-10-18T19:37:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d8df9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d8e79c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 0x7f6d8813cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d8df9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60924/0 (socket says 172.21.15.88:60924) 2023-10-18T19:37:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d8df9b700 1 -- 172.21.15.88:0/3450628574 learned_addr learned my addr 172.21.15.88:0/3450628574 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.951+0000 7f6d8d79a700 1 --1- 172.21.15.88:0/3450628574 >> v1:172.21.15.88:6789/0 conn(0x7f6d88066e80 0x7f6d8813c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56786/0 (socket says 172.21.15.88:56786) 2023-10-18T19:37:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8e79c700 1 -- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 msgr2=0x7f6d88068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8e79c700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8e79c700 1 -- 172.21.15.88:0/3450628574 >> v1:172.21.15.88:6789/0 conn(0x7f6d88066e80 legacy=0x7f6d8813c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8e79c700 1 -- 172.21.15.88:0/3450628574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8813c1e0 con 0x7f6d880672a0 2023-10-18T19:37:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8cf99700 1 -- 172.21.15.88:0/3450628574 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974437919 0 0) 0x7f6d880aad50 con 0x7f6d88066e80 2023-10-18T19:37:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8df9b700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8e79c700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 0x7f6d8813cb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6d80009e90 tx=0x7f6d80009780).ready entity=mon.1 client_cookie=a3f56294f6637371 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8cf99700 1 -- 172.21.15.88:0/3450628574 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000e070 con 0x7f6d880672a0 2023-10-18T19:37:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8cf99700 1 -- 172.21.15.88:0/3450628574 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000bb90 con 0x7f6d880672a0 2023-10-18T19:37:46.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.952+0000 7f6d8cf99700 1 -- 172.21.15.88:0/3450628574 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80012410 con 0x7f6d880672a0 2023-10-18T19:37:46.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 -- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 msgr2=0x7f6d8813cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 0x7f6d8813cb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6d80009e90 tx=0x7f6d80009780).stop 2023-10-18T19:37:46.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 -- 172.21.15.88:0/3450628574 shutdown_connections 2023-10-18T19:37:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880672a0 0x7f6d8813cb90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 --2- 172.21.15.88:0/3450628574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880afaf0 0x7f6d88068200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 -- 172.21.15.88:0/3450628574 >> 172.21.15.88:0/3450628574 conn(0x7f6d88064480 msgr2=0x7f6d88064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 -- 172.21.15.88:0/3450628574 shutdown_connections 2023-10-18T19:37:46.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.953+0000 7f6d901ff700 1 -- 172.21.15.88:0/3450628574 wait complete. 2023-10-18T19:37:46.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.954+0000 7f6d901ff700 1 Processor -- start 2023-10-18T19:37:46.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.954+0000 7f6d901ff700 1 -- start start 2023-10-18T19:37:46.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880672a0 0x7f6d88137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 0x7f6d88148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:46.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880ade20 con 0x7f6d88066e80 2023-10-18T19:37:46.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8812f180 con 0x7f6d880afaf0 2023-10-18T19:37:46.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d901ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881377f0 con 0x7f6d880672a0 2023-10-18T19:37:46.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d8df9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d8df9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47162/0 (socket says 172.21.15.88:47162) 2023-10-18T19:37:46.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d8df9b700 1 -- 172.21.15.88:0/832827402 learned_addr learned my addr 172.21.15.88:0/832827402 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:46.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d8e79c700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 0x7f6d88148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.955+0000 7f6d8d79a700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880672a0 0x7f6d88137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:46.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 -- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880672a0 msgr2=0x7f6d88137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880672a0 0x7f6d88137f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 -- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 msgr2=0x7f6d88148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 0x7f6d88148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 -- 172.21.15.88:0/832827402 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009370 con 0x7f6d88066e80 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8e79c700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 0x7f6d88148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d8df9b700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6d84006d00 tx=0x7f6d840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:46.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840095b0 con 0x7f6d88066e80 2023-10-18T19:37:46.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d84012600 con 0x7f6d88066e80 2023-10-18T19:37:46.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d80009a20 con 0x7f6d88066e80 2023-10-18T19:37:46.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d84012980 con 0x7f6d88066e80 2023-10-18T19:37:46.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.956+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88148a80 con 0x7f6d88066e80 2023-10-18T19:37:46.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.957+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8805a260 con 0x7f6d88066e80 2023-10-18T19:37:46.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.957+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f6d8401b400 con 0x7f6d88066e80 2023-10-18T19:37:46.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.958+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7f6d84055d30 con 0x7f6d88066e80 2023-10-18T19:37:46.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:46.961+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6d84036210 con 0x7f6d88066e80 2023-10-18T19:37:47.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.117+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "pacific"} v 0) v1 -- 0x7f6d880aaf40 con 0x7f6d88066e80 2023-10-18T19:37:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.473+0000 7f6d7dffb700 1 -- 172.21.15.88:0/832827402 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "pacific"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f6d84016070 con 0x7f6d88066e80 2023-10-18T19:37:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.475+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 >> v1:172.21.15.88:6800/113625 conn(0x7f6d6c041ce0 legacy=0x7f6d6c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.475+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 msgr2=0x7f6d880ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.475+0000 7f6d901ff700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6d84006d00 tx=0x7f6d840090f0).stop 2023-10-18T19:37:47.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.476+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 shutdown_connections 2023-10-18T19:37:47.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.476+0000 7f6d901ff700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d880afaf0 0x7f6d88148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.476+0000 7f6d901ff700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d88066e80 0x7f6d880ad340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.476+0000 7f6d901ff700 1 --2- 172.21.15.88:0/832827402 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6d880672a0 0x7f6d88137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.476+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 >> 172.21.15.88:0/832827402 conn(0x7f6d88064480 msgr2=0x7f6d88138b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.479+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 shutdown_connections 2023-10-18T19:37:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.479+0000 7f6d901ff700 1 -- 172.21.15.88:0/832827402 wait complete. 2023-10-18T19:37:47.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-18T19:37:47.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.681+0000 7fdeea9ff700 1 Processor -- start 2023-10-18T19:37:47.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.681+0000 7fdeea9ff700 1 -- start start 2023-10-18T19:37:47.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.682+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 0x7fdee413c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.682+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee413c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.682+0000 7fdeea9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40aad50 con 0x7fdee40afaf0 2023-10-18T19:37:47.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.682+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee41365d0 con 0x7fdee4066e80 2023-10-18T19:37:47.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.682+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40afed0 con 0x7fdee40672a0 2023-10-18T19:37:47.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 0x7fdee413c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdee40afaf0 0x7fdee4068200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56802/0 (socket says 172.21.15.88:56802) 2023-10-18T19:37:47.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee3fff700 1 -- 172.21.15.88:0/1108268576 learned_addr learned my addr 172.21.15.88:0/1108268576 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:47.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee8f9c700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee2ffd700 1 -- 172.21.15.88:0/1108268576 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899285510 0 0) 0x7fdee40aad50 con 0x7fdee40afaf0 2023-10-18T19:37:47.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 -- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 msgr2=0x7fdee413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:47.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 -- 172.21.15.88:0/1108268576 >> v1:172.21.15.88:6789/0 conn(0x7fdee40afaf0 legacy=0x7fdee4068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 -- 172.21.15.88:0/1108268576 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee413c1e0 con 0x7fdee4066e80 2023-10-18T19:37:47.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee8f9c700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:47.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee37fe700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 0x7fdee413c480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fded8009790 tx=0x7fded8009060).ready entity=mon.1 client_cookie=e04813a5b6e71688 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:47.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.683+0000 7fdee2ffd700 1 -- 172.21.15.88:0/1108268576 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800f510 con 0x7fdee4066e80 2023-10-18T19:37:47.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdee2ffd700 1 -- 172.21.15.88:0/1108268576 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded800f670 con 0x7fdee4066e80 2023-10-18T19:37:47.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdee2ffd700 1 -- 172.21.15.88:0/1108268576 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800f9f0 con 0x7fdee4066e80 2023-10-18T19:37:47.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 -- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 msgr2=0x7fdee413c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 0x7fdee413c480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fded8009790 tx=0x7fded8009060).stop 2023-10-18T19:37:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 -- 172.21.15.88:0/1108268576 shutdown_connections 2023-10-18T19:37:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/1108268576 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee4066e80 0x7fdee413c480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 -- 172.21.15.88:0/1108268576 >> 172.21.15.88:0/1108268576 conn(0x7fdee4064480 msgr2=0x7fdee4064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 -- 172.21.15.88:0/1108268576 shutdown_connections 2023-10-18T19:37:47.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.684+0000 7fdeea9ff700 1 -- 172.21.15.88:0/1108268576 wait complete. 2023-10-18T19:37:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.685+0000 7fdeea9ff700 1 Processor -- start 2023-10-18T19:37:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 -- start start 2023-10-18T19:37:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 0x7fdee413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee4148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4149500 con 0x7fdee4066e80 2023-10-18T19:37:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4149260 con 0x7fdee40afaf0 2023-10-18T19:37:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4142240 con 0x7fdee40672a0 2023-10-18T19:37:47.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.686+0000 7fdee8f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee37fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee4148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39492/0 (socket says 172.21.15.88:39492) 2023-10-18T19:37:47.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 0x7fdee413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 -- 172.21.15.88:0/3536181372 learned_addr learned my addr 172.21.15.88:0/3536181372 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:47.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 -- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 msgr2=0x7fdee4148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee4148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 -- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 msgr2=0x7fdee413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 0x7fdee413b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 -- 172.21.15.88:0/3536181372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc009a20 con 0x7fdee40afaf0 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee37fe700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee4148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee3fff700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 0x7fdee413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdee8f9c700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdedc00ef90 tx=0x7fdedc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00cc60 con 0x7fdee40afaf0 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00f040 con 0x7fdee40afaf0 2023-10-18T19:37:47.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded80092a0 con 0x7fdee40afaf0 2023-10-18T19:37:47.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.687+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc013400 con 0x7fdee40afaf0 2023-10-18T19:37:47.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.688+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee4136e60 con 0x7fdee40afaf0 2023-10-18T19:37:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.689+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee405a260 con 0x7fdee40afaf0 2023-10-18T19:37:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.689+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fdedc013830 con 0x7fdee40afaf0 2023-10-18T19:37:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.690+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fdedc056360 con 0x7fdee40afaf0 2023-10-18T19:37:47.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.693+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fdedc036590 con 0x7fdee40afaf0 2023-10-18T19:37:47.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.840+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fdee40aec30 con 0x7fdee40afaf0 2023-10-18T19:37:47.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.840+0000 7fdecbfff700 1 -- 172.21.15.88:0/3536181372 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v35) v1 ==== 59+0+54 (secure 0 0 0) 0x7fdedc039d80 con 0x7fdee40afaf0 2023-10-18T19:37:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 >> v1:172.21.15.88:6800/113625 conn(0x7fded0041ce0 legacy=0x7fded00441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 msgr2=0x7fdee412f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fdedc00ef90 tx=0x7fdedc00b040).stop 2023-10-18T19:37:47.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 shutdown_connections 2023-10-18T19:37:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdee40afaf0 0x7fdee412f5f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdee4066e80 0x7fdee413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 --2- 172.21.15.88:0/3536181372 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdee40672a0 0x7fdee4148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 >> 172.21.15.88:0/3536181372 conn(0x7fdee4064480 msgr2=0x7fdee40abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:47.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 shutdown_connections 2023-10-18T19:37:47.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.842+0000 7fdeea9ff700 1 -- 172.21.15.88:0/3536181372 wait complete. 2023-10-18T19:37:47.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.974+0000 7f1da75ff700 1 Processor -- start 2023-10-18T19:37:47.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.975+0000 7f1da75ff700 1 -- start start 2023-10-18T19:37:47.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.975+0000 7f1da75ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 0x7f1da00657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da75ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da75ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00632d0 con 0x7f1da00a8860 2023-10-18T19:37:47.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da75ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da0139220 con 0x7f1da01398c0 2023-10-18T19:37:47.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da75ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01394e0 con 0x7f1da0138d20 2023-10-18T19:37:47.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 0x7f1da00657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60966/0 (socket says 172.21.15.88:60966) 2023-10-18T19:37:47.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2895694924 learned_addr learned my addr 172.21.15.88:0/2895694924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:47.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 0x7f1da00657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47172/0 (socket says 172.21.15.88:47172) 2023-10-18T19:37:47.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2895694924 >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 msgr2=0x7f1da00657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:47.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 --2- 172.21.15.88:0/2895694924 >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 0x7f1da00657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2895694924 >> v1:172.21.15.88:6789/0 conn(0x7f1da00a8860 legacy=0x7f1da00ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2895694924 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0139ca0 con 0x7f1da0138d20 2023-10-18T19:37:47.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.976+0000 7f1da4b9a700 1 --2- 172.21.15.88:0/2895694924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1d90006fd0 tx=0x7f1d900090f0).ready entity=mon.2 client_cookie=ba95bd338f1cd7f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:47.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1d97fff700 1 -- 172.21.15.88:0/2895694924 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000b580 con 0x7f1da0138d20 2023-10-18T19:37:47.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1d97fff700 1 -- 172.21.15.88:0/2895694924 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000b6e0 con 0x7f1da0138d20 2023-10-18T19:37:47.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1d97fff700 1 -- 172.21.15.88:0/2895694924 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000ba60 con 0x7f1da0138d20 2023-10-18T19:37:47.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 -- 172.21.15.88:0/2895694924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 msgr2=0x7f1da0062d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2895694924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1d90006fd0 tx=0x7f1d900090f0).stop 2023-10-18T19:37:47.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 -- 172.21.15.88:0/2895694924 shutdown_connections 2023-10-18T19:37:47.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2895694924 >> v2:172.21.15.88:3300/0 conn(0x7f1da01398c0 0x7f1da00657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2895694924 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da0062d60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 -- 172.21.15.88:0/2895694924 >> 172.21.15.88:0/2895694924 conn(0x7f1da0064690 msgr2=0x7f1da0062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:47.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 -- 172.21.15.88:0/2895694924 shutdown_connections 2023-10-18T19:37:47.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.977+0000 7f1da75ff700 1 -- 172.21.15.88:0/2895694924 wait complete. 2023-10-18T19:37:47.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 Processor -- start 2023-10-18T19:37:47.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 -- start start 2023-10-18T19:37:47.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1da00a8860 0x7f1da00a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1da01398c0 0x7f1da01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:47.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00a2e10 con 0x7f1da00a8860 2023-10-18T19:37:47.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da014d100 con 0x7f1da01398c0 2023-10-18T19:37:47.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.979+0000 7f1da75ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0148da0 con 0x7f1da0138d20 2023-10-18T19:37:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da539b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1da00a8860 0x7f1da00a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60980/0 (socket says 172.21.15.88:60980) 2023-10-18T19:37:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2014032786 learned_addr learned my addr 172.21.15.88:0/2014032786 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:47.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da5b9c700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1da01398c0 0x7f1da01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1da01398c0 msgr2=0x7f1da01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1da01398c0 0x7f1da01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1da00a8860 msgr2=0x7f1da00a3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1da00a8860 0x7f1da00a3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:47.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 -- 172.21.15.88:0/2014032786 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90009370 con 0x7f1da0138d20 2023-10-18T19:37:47.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.980+0000 7f1da4b9a700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d90009fd0 tx=0x7f1d90017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:47.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.981+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90000bc0 con 0x7f1da0138d20 2023-10-18T19:37:47.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.981+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000b850 con 0x7f1da0138d20 2023-10-18T19:37:47.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.981+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00a3a30 con 0x7f1da0138d20 2023-10-18T19:37:47.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.981+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90000d20 con 0x7f1da0138d20 2023-10-18T19:37:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.981+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da00a0e70 con 0x7f1da0138d20 2023-10-18T19:37:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.982+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f1d9001cad0 con 0x7f1da0138d20 2023-10-18T19:37:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.982+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da00a1060 con 0x7f1da0138d20 2023-10-18T19:37:47.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.983+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f1d90057660 con 0x7f1da0138d20 2023-10-18T19:37:47.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:47.986+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f1da00a1060 con 0x7f1da0138d20 2023-10-18T19:37:48.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.133+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f1da00a1060 con 0x7f1da0138d20 2023-10-18T19:37:48.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.476+0000 7f1d957fa700 1 -- 172.21.15.88:0/2014032786 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7f1da00a1060 con 0x7f1da0138d20 2023-10-18T19:37:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 >> v1:172.21.15.88:6800/113625 conn(0x7f1d84041ce0 legacy=0x7f1d840441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 msgr2=0x7f1da014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f1d90009fd0 tx=0x7f1d90017000).stop 2023-10-18T19:37:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 shutdown_connections 2023-10-18T19:37:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1da01398c0 0x7f1da01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1da00a8860 0x7f1da00a3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 --2- 172.21.15.88:0/2014032786 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1da0138d20 0x7f1da014c730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.479+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 >> 172.21.15.88:0/2014032786 conn(0x7f1da0064690 msgr2=0x7f1da0066080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.480+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 shutdown_connections 2023-10-18T19:37:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.480+0000 7f1da75ff700 1 -- 172.21.15.88:0/2014032786 wait complete. 2023-10-18T19:37:48.484 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 1 pg_autoscale_mode to off 2023-10-18T19:37:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.612+0000 7fe263dff700 1 Processor -- start 2023-10-18T19:37:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.612+0000 7fe263dff700 1 -- start start 2023-10-18T19:37:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe263dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe263dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c1416f0 0x7fe25c143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe263dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25c0ab4c0 con 0x7fe25c0a63a0 2023-10-18T19:37:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe263dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0aa800 con 0x7fe25c1416f0 2023-10-18T19:37:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe263dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0aaa00 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe261b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe261b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60982/0 (socket says 172.21.15.88:60982) 2023-10-18T19:37:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe261b9b700 1 -- 172.21.15.88:0/2221701376 learned_addr learned my addr 172.21.15.88:0/2221701376 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.613+0000 7fe26239c700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c1416f0 0x7fe25c143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe261b9b700 1 -- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c1416f0 msgr2=0x7fe25c143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe261b9b700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c1416f0 0x7fe25c143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe261b9b700 1 -- 172.21.15.88:0/2221701376 >> v1:172.21.15.88:6789/0 conn(0x7fe25c0a63a0 legacy=0x7fe25c136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe261b9b700 1 -- 172.21.15.88:0/2221701376 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c138d90 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe260b99700 1 -- 172.21.15.88:0/2221701376 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316109299 0 0) 0x7fe25c0ab4c0 con 0x7fe25c0a63a0 2023-10-18T19:37:48.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe261b9b700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe258009830 tx=0x7fe2580090f0).ready entity=mon.2 client_cookie=315307c5befb4721 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:48.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe260b99700 1 -- 172.21.15.88:0/2221701376 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800b580 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe260b99700 1 -- 172.21.15.88:0/2221701376 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800b6e0 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.614+0000 7fe260b99700 1 -- 172.21.15.88:0/2221701376 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800ba60 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 -- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 msgr2=0x7fe25c0abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe258009830 tx=0x7fe2580090f0).stop 2023-10-18T19:37:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 -- 172.21.15.88:0/2221701376 shutdown_connections 2023-10-18T19:37:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c1416f0 0x7fe25c143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 --2- 172.21.15.88:0/2221701376 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0ab0e0 0x7fe25c0abee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 -- 172.21.15.88:0/2221701376 >> 172.21.15.88:0/2221701376 conn(0x7fe25c064460 msgr2=0x7fe25c064870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 -- 172.21.15.88:0/2221701376 shutdown_connections 2023-10-18T19:37:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.615+0000 7fe263dff700 1 -- 172.21.15.88:0/2221701376 wait complete. 2023-10-18T19:37:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.616+0000 7fe263dff700 1 Processor -- start 2023-10-18T19:37:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.616+0000 7fe263dff700 1 -- start start 2023-10-18T19:37:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c0ab0e0 0x7fe25c13a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 0x7fe25c0a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c13ae60 con 0x7fe25c1416f0 2023-10-18T19:37:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c13b060 con 0x7fe25c0ab0e0 2023-10-18T19:37:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe263dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c13b670 con 0x7fe25c0a63a0 2023-10-18T19:37:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60990/0 (socket says 172.21.15.88:60990) 2023-10-18T19:37:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 -- 172.21.15.88:0/3649753328 learned_addr learned my addr 172.21.15.88:0/3649753328 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe26239c700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 0x7fe25c0a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:48.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe26139a700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c0ab0e0 0x7fe25c13a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:48.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 -- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c0ab0e0 msgr2=0x7fe25c13a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c0ab0e0 0x7fe25c13a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 -- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 msgr2=0x7fe25c0a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:48.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.617+0000 7fe261b9b700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 0x7fe25c0a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe261b9b700 1 -- 172.21.15.88:0/3649753328 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009370 con 0x7fe25c0a63a0 2023-10-18T19:37:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe26239c700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 0x7fe25c0a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe261b9b700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe258008000 tx=0x7fe258017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258000bc0 con 0x7fe25c0a63a0 2023-10-18T19:37:48.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25800b850 con 0x7fe25c0a63a0 2023-10-18T19:37:48.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258000d20 con 0x7fe25c0a63a0 2023-10-18T19:37:48.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c13b930 con 0x7fe25c0a63a0 2023-10-18T19:37:48.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.618+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0a8870 con 0x7fe25c0a63a0 2023-10-18T19:37:48.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.619+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c0a97e0 con 0x7fe25c0a63a0 2023-10-18T19:37:48.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.619+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fe25801ca90 con 0x7fe25c0a63a0 2023-10-18T19:37:48.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.620+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fe258057580 con 0x7fe25c0a63a0 2023-10-18T19:37:48.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.623+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe25803b5c0 con 0x7fe25c0a63a0 2023-10-18T19:37:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:48.768+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fe25c0a9600 con 0x7fe25c0a63a0 2023-10-18T19:37:49.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.484+0000 7fe251ffb700 1 -- 172.21.15.88:0/3649753328 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7fe258020070 con 0x7fe25c0a63a0 2023-10-18T19:37:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 >> v1:172.21.15.88:6800/113625 conn(0x7fe240041d10 legacy=0x7fe2400441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 msgr2=0x7fe25c13fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe258008000 tx=0x7fe258017000).stop 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 shutdown_connections 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe25c1416f0 0x7fe25c0a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe25c0a63a0 0x7fe25c13fcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 --2- 172.21.15.88:0/3649753328 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe25c0ab0e0 0x7fe25c13a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 >> 172.21.15.88:0/3649753328 conn(0x7fe25c064460 msgr2=0x7fe25c0ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:49.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 shutdown_connections 2023-10-18T19:37:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.486+0000 7fe263dff700 1 -- 172.21.15.88:0/3649753328 wait complete. 2023-10-18T19:37:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 2 pg_autoscale_mode to off 2023-10-18T19:37:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.623+0000 7f5a697ff700 1 Processor -- start 2023-10-18T19:37:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.623+0000 7f5a697ff700 1 -- start start 2023-10-18T19:37:49.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a697ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a697ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a640a63a0 0x7f5a64136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a697ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a640ab4c0 con 0x7f5a6413c360 2023-10-18T19:37:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a697ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a640aa800 con 0x7f5a640a63a0 2023-10-18T19:37:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a697ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a640aaa00 con 0x7f5a640ab0e0 2023-10-18T19:37:49.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a62ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a627fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a640a63a0 0x7f5a64136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a62ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39548/0 (socket says 172.21.15.88:39548) 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.624+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3084626299 learned_addr learned my addr 172.21.15.88:0/3084626299 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3084626299 >> v2:172.21.15.88:3300/0 conn(0x7f5a640a63a0 msgr2=0x7f5a64136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a62ffd700 1 --2- 172.21.15.88:0/3084626299 >> v2:172.21.15.88:3300/0 conn(0x7f5a640a63a0 0x7f5a64136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3084626299 >> v1:172.21.15.88:6789/0 conn(0x7f5a6413c360 legacy=0x7f5a6413c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3084626299 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64138d90 con 0x7f5a640ab0e0 2023-10-18T19:37:49.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a62ffd700 1 --2- 172.21.15.88:0/3084626299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5a54006fd0 tx=0x7f5a540090f0).ready entity=mon.1 client_cookie=1e46a8f3e8e2133d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:49.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a61ffb700 1 -- 172.21.15.88:0/3084626299 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400b580 con 0x7f5a640ab0e0 2023-10-18T19:37:49.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a61ffb700 1 -- 172.21.15.88:0/3084626299 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400b6e0 con 0x7f5a640ab0e0 2023-10-18T19:37:49.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.625+0000 7f5a61ffb700 1 -- 172.21.15.88:0/3084626299 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400ba60 con 0x7f5a640ab0e0 2023-10-18T19:37:49.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 -- 172.21.15.88:0/3084626299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 msgr2=0x7f5a640abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3084626299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5a54006fd0 tx=0x7f5a540090f0).stop 2023-10-18T19:37:49.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 -- 172.21.15.88:0/3084626299 shutdown_connections 2023-10-18T19:37:49.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3084626299 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a640abee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3084626299 >> v2:172.21.15.88:3300/0 conn(0x7f5a640a63a0 0x7f5a64136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 -- 172.21.15.88:0/3084626299 >> 172.21.15.88:0/3084626299 conn(0x7f5a64064460 msgr2=0x7f5a64064870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 -- 172.21.15.88:0/3084626299 shutdown_connections 2023-10-18T19:37:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.626+0000 7f5a697ff700 1 -- 172.21.15.88:0/3084626299 wait complete. 2023-10-18T19:37:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.627+0000 7f5a697ff700 1 Processor -- start 2023-10-18T19:37:49.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.627+0000 7f5a697ff700 1 -- start start 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a6414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 0x7f5a641185d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6414cf40 con 0x7f5a6413c360 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a64136bc0 con 0x7f5a640ab0e0 2023-10-18T19:37:49.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a697ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a64119280 con 0x7f5a640a63a0 2023-10-18T19:37:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a62ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a62ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60998/0 (socket says 172.21.15.88:60998) 2023-10-18T19:37:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3092170377 learned_addr learned my addr 172.21.15.88:0/3092170377 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a637fe700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 0x7f5a641185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.628+0000 7f5a627fc700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a6414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 msgr2=0x7f5a6414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a6414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 msgr2=0x7f5a641185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 0x7f5a641185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:49.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 -- 172.21.15.88:0/3092170377 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54009370 con 0x7f5a640a63a0 2023-10-18T19:37:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a627fc700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a6414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a637fe700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 0x7f5a641185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a62ffd700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5a64063ff0 tx=0x7f5a54017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54000bc0 con 0x7f5a640a63a0 2023-10-18T19:37:49.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400b850 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a64118180 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54000d20 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.629+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a64137250 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.630+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6405a260 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.630+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f5a5401c8c0 con 0x7f5a640a63a0 2023-10-18T19:37:49.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.631+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f5a54057440 con 0x7f5a640a63a0 2023-10-18T19:37:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.634+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5a5400b9c0 con 0x7f5a640a63a0 2023-10-18T19:37:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:49.780+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f5a640a5230 con 0x7f5a640a63a0 2023-10-18T19:37:50.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.493+0000 7f5a4affd700 1 -- 172.21.15.88:0/3092170377 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7f5a54020070 con 0x7f5a640a63a0 2023-10-18T19:37:50.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 >> v1:172.21.15.88:6800/113625 conn(0x7f5a50041ce0 legacy=0x7f5a500441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 msgr2=0x7f5a64119e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f5a64063ff0 tx=0x7f5a54017000).stop 2023-10-18T19:37:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 shutdown_connections 2023-10-18T19:37:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6413c360 0x7f5a641185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5a640a63a0 0x7f5a64119e90 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0x7f5a64063ff0 tx=0x7f5a54017000).stop 2023-10-18T19:37:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 --2- 172.21.15.88:0/3092170377 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a640ab0e0 0x7f5a6414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.496+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 >> 172.21.15.88:0/3092170377 conn(0x7f5a64064460 msgr2=0x7f5a64064860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.497+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 shutdown_connections 2023-10-18T19:37:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.497+0000 7f5a697ff700 1 -- 172.21.15.88:0/3092170377 wait complete. 2023-10-18T19:37:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 3 pg_autoscale_mode to off 2023-10-18T19:37:50.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.642+0000 7fb745fff700 1 Processor -- start 2023-10-18T19:37:50.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.643+0000 7fb745fff700 1 -- start start 2023-10-18T19:37:50.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.643+0000 7fb745fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 0x7fb7400abee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:50.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.643+0000 7fb745fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 0x7fb740136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:50.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb745fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400ab4c0 con 0x7fb74013c360 2023-10-18T19:37:50.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb745fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400aa800 con 0x7fb7400ab0e0 2023-10-18T19:37:50.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb745fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400aaa00 con 0x7fb7400a63a0 2023-10-18T19:37:50.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 0x7fb740136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:50.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb74013c360 0x7fb74013c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56840/0 (socket says 172.21.15.88:56840) 2023-10-18T19:37:50.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 0x7fb7400abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:50.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73ffff700 1 -- 172.21.15.88:0/1254869616 learned_addr learned my addr 172.21.15.88:0/1254869616 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:50.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73effd700 1 -- 172.21.15.88:0/1254869616 >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 msgr2=0x7fb7400abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73effd700 1 --2- 172.21.15.88:0/1254869616 >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 0x7fb7400abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73effd700 1 -- 172.21.15.88:0/1254869616 >> v1:172.21.15.88:6789/0 conn(0x7fb74013c360 legacy=0x7fb74013c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73effd700 1 -- 172.21.15.88:0/1254869616 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740138d90 con 0x7fb7400a63a0 2023-10-18T19:37:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.644+0000 7fb73f7fe700 1 --2- 172.21.15.88:0/1254869616 >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 0x7fb7400abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:50.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb73effd700 1 --2- 172.21.15.88:0/1254869616 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 0x7fb740136210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb734009760 tx=0x7fb734009060).ready entity=mon.2 client_cookie=a5cdedc04e32b0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:50.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb73e7fc700 1 -- 172.21.15.88:0/1254869616 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400f510 con 0x7fb7400a63a0 2023-10-18T19:37:50.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb73e7fc700 1 -- 172.21.15.88:0/1254869616 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73400f670 con 0x7fb7400a63a0 2023-10-18T19:37:50.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb73e7fc700 1 -- 172.21.15.88:0/1254869616 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400f9f0 con 0x7fb7400a63a0 2023-10-18T19:37:50.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb745fff700 1 -- 172.21.15.88:0/1254869616 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 msgr2=0x7fb740136210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.645+0000 7fb745fff700 1 --2- 172.21.15.88:0/1254869616 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 0x7fb740136210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb734009760 tx=0x7fb734009060).stop 2023-10-18T19:37:50.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 -- 172.21.15.88:0/1254869616 shutdown_connections 2023-10-18T19:37:50.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 --2- 172.21.15.88:0/1254869616 >> v2:172.21.15.88:3300/0 conn(0x7fb7400ab0e0 0x7fb7400abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 --2- 172.21.15.88:0/1254869616 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400a63a0 0x7fb740136210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 -- 172.21.15.88:0/1254869616 >> 172.21.15.88:0/1254869616 conn(0x7fb740064460 msgr2=0x7fb740064870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:50.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 -- 172.21.15.88:0/1254869616 shutdown_connections 2023-10-18T19:37:50.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.646+0000 7fb745fff700 1 -- 172.21.15.88:0/1254869616 wait complete. 2023-10-18T19:37:50.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.647+0000 7fb745fff700 1 Processor -- start 2023-10-18T19:37:50.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.647+0000 7fb745fff700 1 -- start start 2023-10-18T19:37:50.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb7400a63a0 0x7fb74014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:50.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:50.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:50.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74014c8b0 con 0x7fb74013c360 2023-10-18T19:37:50.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400a7cd0 con 0x7fb7400a63a0 2023-10-18T19:37:50.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb745fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb740119110 con 0x7fb7400ab0e0 2023-10-18T19:37:50.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:50.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:50.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb7400a63a0 0x7fb74014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:50.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32788/0 (socket says 172.21.15.88:32788) 2023-10-18T19:37:50.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47222/0 (socket says 172.21.15.88:47222) 2023-10-18T19:37:50.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.648+0000 7fb73effd700 1 -- 172.21.15.88:0/475024185 learned_addr learned my addr 172.21.15.88:0/475024185 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:50.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 -- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 msgr2=0x7fb7400a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 -- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb7400a63a0 msgr2=0x7fb74014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:50.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb7400a63a0 0x7fb74014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:50.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 -- 172.21.15.88:0/475024185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300092a0 con 0x7fb74013c360 2023-10-18T19:37:50.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73effd700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb73ffff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb73800c7c0 tx=0x7fb738001460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738005d30 con 0x7fb74013c360 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738005e90 con 0x7fb74013c360 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7340092a0 con 0x7fb74013c360 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380072e0 con 0x7fb74013c360 2023-10-18T19:37:50.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.649+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb740119de0 con 0x7fb74013c360 2023-10-18T19:37:50.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.650+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74014c9f0 con 0x7fb74013c360 2023-10-18T19:37:50.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.651+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb738007710 con 0x7fb74013c360 2023-10-18T19:37:50.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.651+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fb738055160 con 0x7fb74013c360 2023-10-18T19:37:50.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.654+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb7380354a0 con 0x7fb74013c360 2023-10-18T19:37:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:50.802+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fb74005a260 con 0x7fb74013c360 2023-10-18T19:37:51.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.493+0000 7fb7277fe700 1 -- 172.21.15.88:0/475024185 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb738038c90 con 0x7fb74013c360 2023-10-18T19:37:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 >> v1:172.21.15.88:6800/113625 conn(0x7fb72c041d10 legacy=0x7fb72c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 msgr2=0x7fb7401198f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb73800c7c0 tx=0x7fb738001460).stop 2023-10-18T19:37:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 shutdown_connections 2023-10-18T19:37:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb74013c360 0x7fb7401198f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb7400a63a0 0x7fb74014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 --2- 172.21.15.88:0/475024185 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb7400ab0e0 0x7fb7400a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 >> 172.21.15.88:0/475024185 conn(0x7fb740064460 msgr2=0x7fb740137b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 shutdown_connections 2023-10-18T19:37:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.496+0000 7fb745fff700 1 -- 172.21.15.88:0/475024185 wait complete. 2023-10-18T19:37:51.502 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 4 pg_autoscale_mode to off 2023-10-18T19:37:51.521 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-18T19:37:51.533 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T19:37:51.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T19:37:51.534 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T19:37:51.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.722+0000 7fdffe3ff700 1 Processor -- start 2023-10-18T19:37:51.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.723+0000 7fdffe3ff700 1 -- start start 2023-10-18T19:37:51.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffe3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdff805e960 0x7fdff80a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:51.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffe3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:51.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffe3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff805ed40 con 0x7fdff80a4a20 2023-10-18T19:37:51.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffe3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff80a3a70 con 0x7fdff805e960 2023-10-18T19:37:51.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffe3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80a2ac0 con 0x7fdff81363e0 2023-10-18T19:37:51.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdff805e960 0x7fdff80a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:51.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffc99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:51.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdff805e960 0x7fdff80a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47236/0 (socket says 172.21.15.88:47236) 2023-10-18T19:37:51.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffc99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39572/0 (socket says 172.21.15.88:39572) 2023-10-18T19:37:51.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 -- 172.21.15.88:0/1853162498 learned_addr learned my addr 172.21.15.88:0/1853162498 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:51.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff77fe700 1 --1- 172.21.15.88:0/1853162498 >> v1:172.21.15.88:6789/0 conn(0x7fdff80a4a20 0x7fdff8135cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56846/0 (socket says 172.21.15.88:56846) 2023-10-18T19:37:51.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 -- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 msgr2=0x7fdff81433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 -- 172.21.15.88:0/1853162498 >> v1:172.21.15.88:6789/0 conn(0x7fdff80a4a20 legacy=0x7fdff8135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdff7fff700 1 -- 172.21.15.88:0/1853162498 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff80a2d60 con 0x7fdff805e960 2023-10-18T19:37:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.724+0000 7fdffc99c700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdff7fff700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff80a3580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdfe8006fd0 tx=0x7fdfe80090f0).ready entity=mon.0 client_cookie=a064f98608e26473 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdff6ffd700 1 -- 172.21.15.88:0/1853162498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800b610 con 0x7fdff805e960 2023-10-18T19:37:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdff6ffd700 1 -- 172.21.15.88:0/1853162498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe800b770 con 0x7fdff805e960 2023-10-18T19:37:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdff6ffd700 1 -- 172.21.15.88:0/1853162498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800baf0 con 0x7fdff805e960 2023-10-18T19:37:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 -- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 msgr2=0x7fdff80a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff80a3580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdfe8006fd0 tx=0x7fdfe80090f0).stop 2023-10-18T19:37:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 -- 172.21.15.88:0/1853162498 shutdown_connections 2023-10-18T19:37:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff81363e0 0x7fdff81433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/1853162498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff80a3580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.725+0000 7fdffe3ff700 1 -- 172.21.15.88:0/1853162498 >> 172.21.15.88:0/1853162498 conn(0x7fdff8064bb0 msgr2=0x7fdff805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.726+0000 7fdffe3ff700 1 -- 172.21.15.88:0/1853162498 shutdown_connections 2023-10-18T19:37:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.726+0000 7fdffe3ff700 1 -- 172.21.15.88:0/1853162498 wait complete. 2023-10-18T19:37:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.727+0000 7fdffe3ff700 1 Processor -- start 2023-10-18T19:37:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.727+0000 7fdffe3ff700 1 -- start start 2023-10-18T19:37:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 0x7fdff80a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdff81363e0 0x7fdff8133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80a54b0 con 0x7fdff805e960 2023-10-18T19:37:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8139700 con 0x7fdff80a4a20 2023-10-18T19:37:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffe3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdff813cc50 con 0x7fdff81363e0 2023-10-18T19:37:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 0x7fdff80a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47246/0 (socket says 172.21.15.88:47246) 2023-10-18T19:37:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff7fff700 1 -- 172.21.15.88:0/2012176850 learned_addr learned my addr 172.21.15.88:0/2012176850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdffc99c700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdff81363e0 0x7fdff8133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 -- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdff81363e0 msgr2=0x7fdff8133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdff81363e0 0x7fdff8133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 -- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 msgr2=0x7fdff813c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff77fe700 1 -- 172.21.15.88:0/2012176850 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009a20 con 0x7fdff80a4a20 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.728+0000 7fdff7fff700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdff77fe700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 0x7fdff80a6730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdfec00c410 tx=0x7fdfec007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0070d0 con 0x7fdff80a4a20 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec007230 con 0x7fdff80a4a20 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe8009370 con 0x7fdff80a4a20 2023-10-18T19:37:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0075b0 con 0x7fdff80a4a20 2023-10-18T19:37:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.729+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff8138a30 con 0x7fdff80a4a20 2023-10-18T19:37:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.730+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff8139900 con 0x7fdff80a4a20 2023-10-18T19:37:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.730+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fdfec0058f0 con 0x7fdff80a4a20 2023-10-18T19:37:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.731+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fdfec054ec0 con 0x7fdff80a4a20 2023-10-18T19:37:51.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.734+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fdff8139900 con 0x7fdff80a4a20 2023-10-18T19:37:51.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.907+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdff805f270 con 0x7fdff80a4a20 2023-10-18T19:37:51.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.910+0000 7fdfdffff700 1 -- 172.21.15.88:0/2012176850 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v8) v1 ==== 74+0+97750 (secure 0 0 0) 0x7fdfec035200 con 0x7fdff80a4a20 2023-10-18T19:37:51.914 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 >> v1:172.21.15.88:6800/113625 conn(0x7fdfe4041ce0 legacy=0x7fdfe40441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 msgr2=0x7fdff80a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:51.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 0x7fdff80a6730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdfec00c410 tx=0x7fdfec007d30).stop 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 shutdown_connections 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdff81363e0 0x7fdff8133c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdff805e960 0x7fdff813c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 --2- 172.21.15.88:0/2012176850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdff80a4a20 0x7fdff80a6730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 >> 172.21.15.88:0/2012176850 conn(0x7fdff8064bb0 msgr2=0x7fdff81359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:51.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 shutdown_connections 2023-10-18T19:37:51.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:51.912+0000 7fdffe3ff700 1 -- 172.21.15.88:0/2012176850 wait complete. 2023-10-18T19:37:51.932 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"active_gid":14098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6800","nonce":113625}]},"active_addr":"172.21.15.88:6800/113625","active_change":"2023-10-18T19:37:15.335620+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14118,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":18,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":197192167}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":737068194}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3166945155}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":273199233}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2469127949}]}]} 2023-10-18T19:37:51.935 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T19:37:51.935 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T19:37:51.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:52.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.121+0000 7fb485bff700 1 Processor -- start 2023-10-18T19:37:52.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.121+0000 7fb485bff700 1 -- start start 2023-10-18T19:37:52.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.122+0000 7fb485bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.122+0000 7fb485bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 0x7fb4801434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb485bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800a6330 con 0x7fb48005e250 2023-10-18T19:37:52.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb485bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48005e630 con 0x7fb4800a6b10 2023-10-18T19:37:52.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb485bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800a1f80 con 0x7fb4801361e0 2023-10-18T19:37:52.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 0x7fb4801434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39598/0 (socket says 172.21.15.88:39598) 2023-10-18T19:37:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 -- 172.21.15.88:0/1721665334 learned_addr learned my addr 172.21.15.88:0/1721665334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47f7fe700 1 --1- 172.21.15.88:0/1721665334 >> v1:172.21.15.88:6789/0 conn(0x7fb48005e250 0x7fb4800a16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56852/0 (socket says 172.21.15.88:56852) 2023-10-18T19:37:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 -- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 msgr2=0x7fb4801434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 0x7fb4801434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 -- 172.21.15.88:0/1721665334 >> v1:172.21.15.88:6789/0 conn(0x7fb48005e250 legacy=0x7fb4800a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 -- 172.21.15.88:0/1721665334 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800a2240 con 0x7fb4800a6b10 2023-10-18T19:37:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47e7fc700 1 -- 172.21.15.88:0/1721665334 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423331631 0 0) 0x7fb4800a6330 con 0x7fb48005e250 2023-10-18T19:37:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47ffff700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 0x7fb4801434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:52.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.123+0000 7fb47effd700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb474009830 tx=0x7fb4740090f0).ready entity=mon.1 client_cookie=539a058efb5f24b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb47e7fc700 1 -- 172.21.15.88:0/1721665334 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400b580 con 0x7fb4800a6b10 2023-10-18T19:37:52.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb47e7fc700 1 -- 172.21.15.88:0/1721665334 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47400b6e0 con 0x7fb4800a6b10 2023-10-18T19:37:52.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb47e7fc700 1 -- 172.21.15.88:0/1721665334 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400ba60 con 0x7fb4800a6b10 2023-10-18T19:37:52.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 -- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 msgr2=0x7fb480135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb474009830 tx=0x7fb4740090f0).stop 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 -- 172.21.15.88:0/1721665334 shutdown_connections 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4801361e0 0x7fb4801434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 --2- 172.21.15.88:0/1721665334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb4800a6b10 0x7fb480135cf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 -- 172.21.15.88:0/1721665334 >> 172.21.15.88:0/1721665334 conn(0x7fb4800665a0 msgr2=0x7fb4800625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 -- 172.21.15.88:0/1721665334 shutdown_connections 2023-10-18T19:37:52.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.124+0000 7fb485bff700 1 -- 172.21.15.88:0/1721665334 wait complete. 2023-10-18T19:37:52.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.126+0000 7fb485bff700 1 Processor -- start 2023-10-18T19:37:52.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.126+0000 7fb485bff700 1 -- start start 2023-10-18T19:37:52.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.126+0000 7fb485bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.126+0000 7fb485bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4800a6b10 0x7fb4800a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb485bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4801361e0 0x7fb48014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb485bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800a56a0 con 0x7fb4801361e0 2023-10-18T19:37:52.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb485bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800a4f40 con 0x7fb48005e250 2023-10-18T19:37:52.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb485bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800a4780 con 0x7fb4800a6b10 2023-10-18T19:37:52.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4800a6b10 0x7fb4800a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4801361e0 0x7fb48014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39614/0 (socket says 172.21.15.88:39614) 2023-10-18T19:37:52.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 -- 172.21.15.88:0/1614845551 learned_addr learned my addr 172.21.15.88:0/1614845551 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 -- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4800a6b10 msgr2=0x7fb4800a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4800a6b10 0x7fb4800a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 -- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4801361e0 msgr2=0x7fb48014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4801361e0 0x7fb48014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 -- 172.21.15.88:0/1614845551 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009a20 con 0x7fb48005e250 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.127+0000 7fb47f7fe700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb47000c4c0 tx=0x7fb470007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.128+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700072e0 con 0x7fb48005e250 2023-10-18T19:37:52.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.128+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470007460 con 0x7fb48005e250 2023-10-18T19:37:52.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.128+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb474009370 con 0x7fb48005e250 2023-10-18T19:37:52.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.128+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470005930 con 0x7fb48005e250 2023-10-18T19:37:52.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.128+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480134620 con 0x7fb48005e250 2023-10-18T19:37:52.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.129+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4801175a0 con 0x7fb48005e250 2023-10-18T19:37:52.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.129+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb470005ce0 con 0x7fb48005e250 2023-10-18T19:37:52.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.129+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fb470055070 con 0x7fb48005e250 2023-10-18T19:37:52.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.133+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb47007c000 con 0x7fb48005e250 2023-10-18T19:37:52.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.280+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb48005f270 con 0x7fb48005e250 2023-10-18T19:37:52.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.281+0000 7fb4677fe700 1 -- 172.21.15.88:0/1614845551 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11424 (secure 0 0 0) 0x7fb470018020 con 0x7fb48005e250 2023-10-18T19:37:52.284 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:52.284 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:51.488687+0000","last_up_change":"2023-10-18T19:37:40.120819+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":115732}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":115732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":115732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":115732}]},"public_addr":"172.21.15.88:6801/115732","cluster_addr":"172.21.15.88:6802/115732","heartbeat_back_addr":"172.21.15.88:6804/115732","heartbeat_front_addr":"172.21.15.88:6803/115732","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":115836}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":115836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":115836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":115836}]},"public_addr":"172.21.15.88:6809/115836","cluster_addr":"172.21.15.88:6810/115836","heartbeat_back_addr":"172.21.15.88:6812/115836","heartbeat_front_addr":"172.21.15.88:6811/115836","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":115939}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":115939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":115939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":115939}]},"public_addr":"172.21.15.88:6805/115939","cluster_addr":"172.21.15.88:6806/115939","heartbeat_back_addr":"172.21.15.88:6808/115939","heartbeat_front_addr":"172.21.15.88:6807/115939","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":116057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":116057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":116057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":116057}]},"public_addr":"172.21.15.88:6813/116057","cluster_addr":"172.21.15.88:6814/116057","heartbeat_back_addr":"172.21.15.88:6816/116057","heartbeat_front_addr":"172.21.15.88:6815/116057","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6817/2557744719":"2023-10-19T19:37:45.614894+0000","172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:52.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 >> v1:172.21.15.88:6800/113625 conn(0x7fb46c041d10 legacy=0x7fb46c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 msgr2=0x7fb4800a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb47000c4c0 tx=0x7fb470007c10).stop 2023-10-18T19:37:52.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 shutdown_connections 2023-10-18T19:37:52.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4801361e0 0x7fb48014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb48005e250 0x7fb4800a3a50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 --2- 172.21.15.88:0/1614845551 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb4800a6b10 0x7fb4800a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 >> 172.21.15.88:0/1614845551 conn(0x7fb4800665a0 msgr2=0x7fb480062d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 shutdown_connections 2023-10-18T19:37:52.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.283+0000 7fb485bff700 1 -- 172.21.15.88:0/1614845551 wait complete. 2023-10-18T19:37:52.303 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T19:37:52.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T19:37:52.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.488+0000 7f17623ff700 1 Processor -- start 2023-10-18T19:37:52.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.488+0000 7f17623ff700 1 -- start start 2023-10-18T19:37:52.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f17623ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f175c0af970 0x7f175c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f17623ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a4c50 0x7f175c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f17623ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0afd50 con 0x7f175c0a1790 2023-10-18T19:37:52.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f17623ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0a47a0 con 0x7f175c0af970 2023-10-18T19:37:52.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f17623ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0a3a10 con 0x7f175c0a4c50 2023-10-18T19:37:52.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f175c0af970 0x7f175c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f176099c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a4c50 0x7f175c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f175c0af970 0x7f175c135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47262/0 (socket says 172.21.15.88:47262) 2023-10-18T19:37:52.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 -- 172.21.15.88:0/2579485865 learned_addr learned my addr 172.21.15.88:0/2579485865 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 -- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a4c50 msgr2=0x7f175c136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:52.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 --2- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a4c50 0x7f175c136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 -- 172.21.15.88:0/2579485865 >> v1:172.21.15.88:6789/0 conn(0x7f175c0a1790 legacy=0x7f175c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.489+0000 7f175bfff700 1 -- 172.21.15.88:0/2579485865 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0a32d0 con 0x7f175c0af970 2023-10-18T19:37:52.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f175bfff700 1 --2- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c135d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f174c006fd0 tx=0x7f174c0090f0).ready entity=mon.0 client_cookie=f83c788b332e0b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f175affd700 1 -- 172.21.15.88:0/2579485865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00b580 con 0x7f175c0af970 2023-10-18T19:37:52.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f175affd700 1 -- 172.21.15.88:0/2579485865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00b6e0 con 0x7f175c0af970 2023-10-18T19:37:52.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f175affd700 1 -- 172.21.15.88:0/2579485865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00ba60 con 0x7f175c0af970 2023-10-18T19:37:52.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 -- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 msgr2=0x7f175c135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 --2- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c135d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f174c006fd0 tx=0x7f174c0090f0).stop 2023-10-18T19:37:52.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 -- 172.21.15.88:0/2579485865 shutdown_connections 2023-10-18T19:37:52.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 --2- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a4c50 0x7f175c136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 --2- 172.21.15.88:0/2579485865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c135d30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.490+0000 7f17623ff700 1 -- 172.21.15.88:0/2579485865 >> 172.21.15.88:0/2579485865 conn(0x7f175c05eb60 msgr2=0x7f175c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.491+0000 7f17623ff700 1 -- 172.21.15.88:0/2579485865 shutdown_connections 2023-10-18T19:37:52.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.491+0000 7f17623ff700 1 -- 172.21.15.88:0/2579485865 wait complete. 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.492+0000 7f17623ff700 1 Processor -- start 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.492+0000 7f17623ff700 1 -- start start 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 0x7f175c0a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f175c0a4c50 0x7f175c0a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c148cf0 con 0x7f175c0af970 2023-10-18T19:37:52.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0a7a90 con 0x7f175c0a4c50 2023-10-18T19:37:52.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f17623ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0a7d70 con 0x7f175c0a1790 2023-10-18T19:37:52.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f176099c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 0x7f175c0a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f175c0a4c50 0x7f175c0a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f176099c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47276/0 (socket says 172.21.15.88:47276) 2023-10-18T19:37:52.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f176099c700 1 -- 172.21.15.88:0/3408544149 learned_addr learned my addr 172.21.15.88:0/3408544149 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 -- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f175c0a4c50 msgr2=0x7f175c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f175c0a4c50 0x7f175c0a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 -- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 msgr2=0x7f175c1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f175bfff700 1 -- 172.21.15.88:0/3408544149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009370 con 0x7f175c0a1790 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.493+0000 7f176099c700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f175bfff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 0x7f175c0a8270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f175c0acb20 tx=0x7f174c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c000bc0 con 0x7f175c0a1790 2023-10-18T19:37:52.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00b850 con 0x7f175c0a1790 2023-10-18T19:37:52.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c000d20 con 0x7f175c0a1790 2023-10-18T19:37:52.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c148f20 con 0x7f175c0a1790 2023-10-18T19:37:52.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.494+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0a8760 con 0x7f175c0a1790 2023-10-18T19:37:52.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.495+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f174c01bb00 con 0x7f175c0a1790 2023-10-18T19:37:52.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.495+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c05f270 con 0x7f175c0a1790 2023-10-18T19:37:52.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.496+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f174c0573d0 con 0x7f175c0a1790 2023-10-18T19:37:52.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.499+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f174c025be0 con 0x7f175c0a1790 2023-10-18T19:37:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.647+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f175c0a3010 con 0x7f175c0a1790 2023-10-18T19:37:52.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.648+0000 7f1743fff700 1 -- 172.21.15.88:0/3408544149 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11424 (secure 0 0 0) 0x7f174c01f090 con 0x7f175c0a1790 2023-10-18T19:37:52.651 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:52.651 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":39,"fsid":"fe6fac15-13f3-4a33-b6ef-f18d02d18f87","created":"2023-10-18T19:33:59.453951+0000","modified":"2023-10-18T19:37:51.488687+0000","last_up_change":"2023-10-18T19:37:40.120819+0000","last_in_change":"2023-10-18T19:34:06.488799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-18T19:34:09.738627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-18T19:34:18.877868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-18T19:34:20.222147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2023-10-18T19:37:15.428276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8dd014e9-edff-49f4-a64e-a9a08eb5bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6801","nonce":115732}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6802","nonce":115732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6804","nonce":115732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6803","nonce":115732}]},"public_addr":"172.21.15.88:6801/115732","cluster_addr":"172.21.15.88:6802/115732","heartbeat_back_addr":"172.21.15.88:6804/115732","heartbeat_front_addr":"172.21.15.88:6803/115732","state":["exists","up"]},{"osd":1,"uuid":"b8c2b64b-e04e-435d-8eba-9cdc531cfd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6809","nonce":115836}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6810","nonce":115836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6812","nonce":115836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6811","nonce":115836}]},"public_addr":"172.21.15.88:6809/115836","cluster_addr":"172.21.15.88:6810/115836","heartbeat_back_addr":"172.21.15.88:6812/115836","heartbeat_front_addr":"172.21.15.88:6811/115836","state":["exists","up"]},{"osd":2,"uuid":"4527909d-9edd-46d9-abdd-6ab5a4da9e5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6805","nonce":115939}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6806","nonce":115939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6808","nonce":115939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6807","nonce":115939}]},"public_addr":"172.21.15.88:6805/115939","cluster_addr":"172.21.15.88:6806/115939","heartbeat_back_addr":"172.21.15.88:6808/115939","heartbeat_front_addr":"172.21.15.88:6807/115939","state":["exists","up"]},{"osd":3,"uuid":"60440fa3-794f-4b22-b0e6-76801bcaf0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6813","nonce":116057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6814","nonce":116057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6816","nonce":116057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.88:6815","nonce":116057}]},"public_addr":"172.21.15.88:6813/116057","cluster_addr":"172.21.15.88:6814/116057","heartbeat_back_addr":"172.21.15.88:6816/116057","heartbeat_front_addr":"172.21.15.88:6815/116057","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-18T19:37:34.079545+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6817/2557744719":"2023-10-19T19:37:45.614894+0000","172.21.15.88:6800/107321":"2023-10-19T19:37:15.335447+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T19:37:52.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 >> v1:172.21.15.88:6800/113625 conn(0x7f1748041ce0 legacy=0x7f17480441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 msgr2=0x7f175c0a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 0x7f175c0a8270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f175c0acb20 tx=0x7f174c017000).stop 2023-10-18T19:37:52.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 shutdown_connections 2023-10-18T19:37:52.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f175c0af970 0x7f175c1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f175c0a1790 0x7f175c0a8270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 --2- 172.21.15.88:0/3408544149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f175c0a4c50 0x7f175c0a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 >> 172.21.15.88:0/3408544149 conn(0x7f175c05eb60 msgr2=0x7f175c138ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.650+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 shutdown_connections 2023-10-18T19:37:52.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.651+0000 7f17623ff700 1 -- 172.21.15.88:0/3408544149 wait complete. 2023-10-18T19:37:52.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T19:37:52.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.857+0000 7ff2429ff700 1 Processor -- start 2023-10-18T19:37:52.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.857+0000 7ff2429ff700 1 -- start start 2023-10-18T19:37:52.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.858+0000 7ff2429ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff23c0af5e0 0x7ff23c138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.858+0000 7ff2429ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.858+0000 7ff2429ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0af9c0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.858+0000 7ff2429ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c0a4010 con 0x7ff23c0af5e0 2023-10-18T19:37:52.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.858+0000 7ff2429ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c139c20 con 0x7ff23c09fdf0 2023-10-18T19:37:52.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff23c0af5e0 0x7ff23c138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff240f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff240f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39622/0 (socket says 172.21.15.88:39622) 2023-10-18T19:37:52.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff23c0af5e0 0x7ff23c138d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47290/0 (socket says 172.21.15.88:47290) 2023-10-18T19:37:52.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff240f9c700 1 -- 172.21.15.88:0/2013352351 learned_addr learned my addr 172.21.15.88:0/2013352351 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 -- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 msgr2=0x7ff23c143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:52.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 -- 172.21.15.88:0/2013352351 >> v1:172.21.15.88:6789/0 conn(0x7ff23c0a4ec0 legacy=0x7ff23c139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 -- 172.21.15.88:0/2013352351 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c09f700 con 0x7ff23c0af5e0 2023-10-18T19:37:52.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff240f9c700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:52.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23bfff700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c138d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff22c009760 tx=0x7ff22c009060).ready entity=mon.0 client_cookie=3aef91bfa0d62141 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.859+0000 7ff23affd700 1 -- 172.21.15.88:0/2013352351 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00f510 con 0x7ff23c0af5e0 2023-10-18T19:37:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff23affd700 1 -- 172.21.15.88:0/2013352351 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00f670 con 0x7ff23c0af5e0 2023-10-18T19:37:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff23affd700 1 -- 172.21.15.88:0/2013352351 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00f9f0 con 0x7ff23c0af5e0 2023-10-18T19:37:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 -- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 msgr2=0x7ff23c138d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c138d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff22c009760 tx=0x7ff22c009060).stop 2023-10-18T19:37:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 -- 172.21.15.88:0/2013352351 shutdown_connections 2023-10-18T19:37:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c09fdf0 0x7ff23c143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 --2- 172.21.15.88:0/2013352351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c138d00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 -- 172.21.15.88:0/2013352351 >> 172.21.15.88:0/2013352351 conn(0x7ff23c062a80 msgr2=0x7ff23c062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 -- 172.21.15.88:0/2013352351 shutdown_connections 2023-10-18T19:37:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.860+0000 7ff2429ff700 1 -- 172.21.15.88:0/2013352351 wait complete. 2023-10-18T19:37:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.862+0000 7ff2429ff700 1 Processor -- start 2023-10-18T19:37:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.862+0000 7ff2429ff700 1 -- start start 2023-10-18T19:37:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff23c09fdf0 0x7ff23c13cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 0x7ff23c0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c0a6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0a8560 con 0x7ff23c0af5e0 2023-10-18T19:37:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0a9020 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.863+0000 7ff2429ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0ac4c0 con 0x7ff23c09fdf0 2023-10-18T19:37:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff23c09fdf0 0x7ff23c13cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 0x7ff23c0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 0x7ff23c0aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39624/0 (socket says 172.21.15.88:39624) 2023-10-18T19:37:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff23c09fdf0 0x7ff23c13cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32842/0 (socket says 172.21.15.88:32842) 2023-10-18T19:37:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 -- 172.21.15.88:0/1197918112 learned_addr learned my addr 172.21.15.88:0/1197918112 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff240f9c700 1 --2- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c0a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 -- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff23c09fdf0 msgr2=0x7ff23c13cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 --2- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff23c09fdf0 0x7ff23c13cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 -- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 msgr2=0x7ff23c0a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 --2- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff23c0af5e0 0x7ff23c0a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 -- 172.21.15.88:0/1197918112 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009ae0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff23b7fe700 1 --2- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 0x7ff23c0aac30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff23000c4c0 tx=0x7ff230007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000ce70 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff230001e90 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c0092a0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.864+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff230007270 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.865+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c0a98e0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.865+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff23c0a0730 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.866+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7ff2300066a0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.866+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff230055030 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.867+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 --> v1:172.21.15.88:6801/115732 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff22804f050 con 0x7ff22804b340 2023-10-18T19:37:52.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.867+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2300576c0 con 0x7ff23c0a4ec0 2023-10-18T19:37:52.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.868+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== osd.0 v1:172.21.15.88:6801/115732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7ff22804f050 con 0x7ff22804b340 2023-10-18T19:37:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.882+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 --> v1:172.21.15.88:6801/115732 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff23c0a9ad0 con 0x7ff22804b340 2023-10-18T19:37:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff223fff700 1 -- 172.21.15.88:0/1197918112 <== osd.0 v1:172.21.15.88:6801/115732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 655407495) 0x7ff23c0a9ad0 con 0x7ff22804b340 2023-10-18T19:37:52.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 >> v1:172.21.15.88:6801/115732 conn(0x7ff22804b340 legacy=0x7ff22804d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 >> v1:172.21.15.88:6800/113625 conn(0x7ff228041ce0 legacy=0x7ff2280441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 msgr2=0x7ff23c0aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:52.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff2429ff700 1 --2- 172.21.15.88:0/1197918112 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff23c0a4ec0 0x7ff23c0aac30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff23000c4c0 tx=0x7ff230007e00).stop 2023-10-18T19:37:52.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.883+0000 7ff240f9c700 1 -- 172.21.15.88:0/1197918112 reap_dead start 2023-10-18T19:37:52.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.884+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 shutdown_connections 2023-10-18T19:37:52.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.884+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 >> 172.21.15.88:0/1197918112 conn(0x7ff23c062a80 msgr2=0x7ff23c05e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:52.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.884+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 shutdown_connections 2023-10-18T19:37:52.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:52.884+0000 7ff2429ff700 1 -- 172.21.15.88:0/1197918112 wait complete. 2023-10-18T19:37:52.902 INFO:teuthology.orchestra.run.smithi088.stdout:115964116997 2023-10-18T19:37:52.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T19:37:53.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.088+0000 7f3fd57ff700 1 Processor -- start 2023-10-18T19:37:53.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.088+0000 7f3fd57ff700 1 -- start start 2023-10-18T19:37:53.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fd57ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fd57ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd0143390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fd57ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd00a4e00 con 0x7f3fd005e960 2023-10-18T19:37:53.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fd57ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00a4070 con 0x7f3fd00a4700 2023-10-18T19:37:53.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fd57ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd005ed40 con 0x7f3fd01361a0 2023-10-18T19:37:53.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fcf7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd0143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fceffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3fd005e960 0x7f3fd0138d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56872/0 (socket says 172.21.15.88:56872) 2023-10-18T19:37:53.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fceffd700 1 -- 172.21.15.88:0/1033224609 learned_addr learned my addr 172.21.15.88:0/1033224609 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:53.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39628/0 (socket says 172.21.15.88:39628) 2023-10-18T19:37:53.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 -- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 msgr2=0x7f3fd0143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd0143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 -- 172.21.15.88:0/1033224609 >> v1:172.21.15.88:6789/0 conn(0x7f3fd005e960 legacy=0x7f3fd0138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fcdffb700 1 -- 172.21.15.88:0/1033224609 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843444271 0 0) 0x7f3fd00a4e00 con 0x7f3fd005e960 2023-10-18T19:37:53.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fce7fc700 1 -- 172.21.15.88:0/1033224609 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0136620 con 0x7f3fd00a4700 2023-10-18T19:37:53.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.089+0000 7f3fcf7fe700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd0143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fce7fc700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3fc4009790 tx=0x7f3fc4009060).ready entity=mon.1 client_cookie=6b436ebb03296953 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fcdffb700 1 -- 172.21.15.88:0/1033224609 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400f510 con 0x7f3fd00a4700 2023-10-18T19:37:53.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fcdffb700 1 -- 172.21.15.88:0/1033224609 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400f670 con 0x7f3fd00a4700 2023-10-18T19:37:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fcdffb700 1 -- 172.21.15.88:0/1033224609 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400f9f0 con 0x7f3fd00a4700 2023-10-18T19:37:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fd57ff700 1 -- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 msgr2=0x7f3fd0135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.090+0000 7f3fd57ff700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3fc4009790 tx=0x7f3fc4009060).stop 2023-10-18T19:37:53.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 -- 172.21.15.88:0/1033224609 shutdown_connections 2023-10-18T19:37:53.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd0143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 --2- 172.21.15.88:0/1033224609 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd00a4700 0x7f3fd0135cb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 -- 172.21.15.88:0/1033224609 >> 172.21.15.88:0/1033224609 conn(0x7f3fd0063460 msgr2=0x7f3fd005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 -- 172.21.15.88:0/1033224609 shutdown_connections 2023-10-18T19:37:53.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.091+0000 7f3fd57ff700 1 -- 172.21.15.88:0/1033224609 wait complete. 2023-10-18T19:37:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.092+0000 7f3fd57ff700 1 Processor -- start 2023-10-18T19:37:53.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.092+0000 7f3fd57ff700 1 -- start start 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd005e960 0x7f3fd00a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fd00a4700 0x7f3fd00a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd01347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00a6370 con 0x7f3fd00a4700 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00a7fe0 con 0x7f3fd005e960 2023-10-18T19:37:53.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fd57ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00a65a0 con 0x7f3fd01361a0 2023-10-18T19:37:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fceffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd005e960 0x7f3fd00a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fd00a4700 0x7f3fd00a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fcf7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd01347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fceffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd005e960 0x7f3fd00a76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39634/0 (socket says 172.21.15.88:39634) 2023-10-18T19:37:53.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fceffd700 1 -- 172.21.15.88:0/10324499 learned_addr learned my addr 172.21.15.88:0/10324499 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 -- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 msgr2=0x7f3fd01347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 --2- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd01347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 -- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd005e960 msgr2=0x7f3fd00a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 --2- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fd005e960 0x7f3fd00a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fce7fc700 1 -- 172.21.15.88:0/10324499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8009a20 con 0x7f3fd00a4700 2023-10-18T19:37:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.093+0000 7f3fcf7fe700 1 --2- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3fd01361a0 0x7f3fd01347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fce7fc700 1 --2- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fd00a4700 0x7f3fd00a87c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3fc4014000 tx=0x7f3fc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400f7e0 con 0x7f3fd00a4700 2023-10-18T19:37:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400f960 con 0x7f3fd00a4700 2023-10-18T19:37:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc401b660 con 0x7f3fd00a4700 2023-10-18T19:37:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40092a0 con 0x7f3fd00a4700 2023-10-18T19:37:53.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.094+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd00a54b0 con 0x7f3fd00a4700 2023-10-18T19:37:53.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.095+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fd005f270 con 0x7f3fd00a4700 2023-10-18T19:37:53.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.095+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f3fc401ba10 con 0x7f3fd00a4700 2023-10-18T19:37:53.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.096+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f3fc4056f70 con 0x7f3fd00a4700 2023-10-18T19:37:53.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.096+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 --> v1:172.21.15.88:6809/115836 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fbc04f020 con 0x7f3fbc04b310 2023-10-18T19:37:53.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.096+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc40594d0 con 0x7f3fd00a4700 2023-10-18T19:37:53.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.097+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== osd.1 v1:172.21.15.88:6809/115836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f3fbc04f020 con 0x7f3fbc04b310 2023-10-18T19:37:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.112+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 --> v1:172.21.15.88:6809/115836 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fd00a1300 con 0x7f3fbc04b310 2023-10-18T19:37:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.112+0000 7f3fb6ffd700 1 -- 172.21.15.88:0/10324499 <== osd.1 v1:172.21.15.88:6809/115836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 851964294) 0x7f3fd00a1300 con 0x7f3fbc04b310 2023-10-18T19:37:53.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.112+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 >> v1:172.21.15.88:6809/115836 conn(0x7f3fbc04b310 legacy=0x7f3fbc04d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 >> v1:172.21.15.88:6800/113625 conn(0x7f3fbc041cb0 legacy=0x7f3fbc044170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fd00a4700 msgr2=0x7f3fd00a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 --2- 172.21.15.88:0/10324499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fd00a4700 0x7f3fd00a87c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3fc4014000 tx=0x7f3fc4017000).stop 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fcf7fe700 1 -- 172.21.15.88:0/10324499 reap_dead start 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 shutdown_connections 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 >> 172.21.15.88:0/10324499 conn(0x7f3fd0063460 msgr2=0x7f3fd00a31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 shutdown_connections 2023-10-18T19:37:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.113+0000 7f3fd57ff700 1 -- 172.21.15.88:0/10324499 wait complete. 2023-10-18T19:37:53.131 INFO:teuthology.orchestra.run.smithi088.stdout:120259084293 2023-10-18T19:37:53.131 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T19:37:53.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.317+0000 7efd60bff700 1 Processor -- start 2023-10-18T19:37:53.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.318+0000 7efd60bff700 1 -- start start 2023-10-18T19:37:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.318+0000 7efd60bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.318+0000 7efd60bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.318+0000 7efd60bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 0x7efd5c064030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.318+0000 7efd60bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c06a990 con 0x7efd5c06a4e0 2023-10-18T19:37:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd60bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c063280 con 0x7efd5c063bd0 2023-10-18T19:37:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd60bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c064520 con 0x7efd5c062ea0 2023-10-18T19:37:53.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd59d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5ad9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 0x7efd5c064030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32854/0 (socket says 172.21.15.88:32854) 2023-10-18T19:37:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd59d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47312/0 (socket says 172.21.15.88:47312) 2023-10-18T19:37:53.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 -- 172.21.15.88:0/527429323 learned_addr learned my addr 172.21.15.88:0/527429323 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 -- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 msgr2=0x7efd5c064030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 0x7efd5c064030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 -- 172.21.15.88:0/527429323 >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 msgr2=0x7efd5c0636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 --2- 172.21.15.88:0/527429323 >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 -- 172.21.15.88:0/527429323 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c069170 con 0x7efd5c062ea0 2023-10-18T19:37:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5ad9d700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 0x7efd5c064030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd59d9b700 1 --2- 172.21.15.88:0/527429323 >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.319+0000 7efd5a59c700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd4c009830 tx=0x7efd4c0090f0).ready entity=mon.2 client_cookie=db7365017c0e6886 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd5959a700 1 -- 172.21.15.88:0/527429323 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f510 con 0x7efd5c062ea0 2023-10-18T19:37:53.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd5959a700 1 -- 172.21.15.88:0/527429323 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c00f670 con 0x7efd5c062ea0 2023-10-18T19:37:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd5959a700 1 -- 172.21.15.88:0/527429323 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f9f0 con 0x7efd5c062ea0 2023-10-18T19:37:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 -- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 msgr2=0x7efd5c09dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd4c009830 tx=0x7efd4c0090f0).stop 2023-10-18T19:37:53.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 -- 172.21.15.88:0/527429323 shutdown_connections 2023-10-18T19:37:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c062ea0 0x7efd5c09dda0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 --2- 172.21.15.88:0/527429323 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c063bd0 0x7efd5c064030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 --2- 172.21.15.88:0/527429323 >> v2:172.21.15.88:3300/0 conn(0x7efd5c06a4e0 0x7efd5c0636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 -- 172.21.15.88:0/527429323 >> 172.21.15.88:0/527429323 conn(0x7efd5c067ed0 msgr2=0x7efd5c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 -- 172.21.15.88:0/527429323 shutdown_connections 2023-10-18T19:37:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.320+0000 7efd60bff700 1 -- 172.21.15.88:0/527429323 wait complete. 2023-10-18T19:37:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.322+0000 7efd60bff700 1 Processor -- start 2023-10-18T19:37:53.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.322+0000 7efd60bff700 1 -- start start 2023-10-18T19:37:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.322+0000 7efd60bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 0x7efd5c0a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd60bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c063bd0 0x7efd5c092de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd60bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5c06a4e0 0x7efd5c0a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd60bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0939b0 con 0x7efd5c06a4e0 2023-10-18T19:37:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd60bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c13bd40 con 0x7efd5c062ea0 2023-10-18T19:37:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd60bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0932d0 con 0x7efd5c063bd0 2023-10-18T19:37:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 0x7efd5c0a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd59d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c063bd0 0x7efd5c092de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 0x7efd5c0a80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39656/0 (socket says 172.21.15.88:39656) 2023-10-18T19:37:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 -- 172.21.15.88:0/1637449074 learned_addr learned my addr 172.21.15.88:0/1637449074 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5ad9d700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5c06a4e0 0x7efd5c0a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 -- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c063bd0 msgr2=0x7efd5c092de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c063bd0 0x7efd5c092de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 -- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5c06a4e0 msgr2=0x7efd5c0a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5c06a4e0 0x7efd5c0a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 -- 172.21.15.88:0/1637449074 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009a20 con 0x7efd5c062ea0 2023-10-18T19:37:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd59d9b700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efd5c063bd0 0x7efd5c092de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5ad9d700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5c06a4e0 0x7efd5c0a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.323+0000 7efd5a59c700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 0x7efd5c0a80b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd4c009e20 tx=0x7efd4c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.324+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f7e0 con 0x7efd5c062ea0 2023-10-18T19:37:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.324+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c00f940 con 0x7efd5c062ea0 2023-10-18T19:37:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.324+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c01c670 con 0x7efd5c062ea0 2023-10-18T19:37:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.324+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd500092a0 con 0x7efd5c062ea0 2023-10-18T19:37:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.324+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c009370 con 0x7efd5c062ea0 2023-10-18T19:37:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.325+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd5c05f270 con 0x7efd5c062ea0 2023-10-18T19:37:53.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.325+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7efd4c01ca20 con 0x7efd5c062ea0 2023-10-18T19:37:53.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.326+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7efd4c057480 con 0x7efd5c062ea0 2023-10-18T19:37:53.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.326+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 --> v1:172.21.15.88:6805/115939 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd3c04f080 con 0x7efd3c04b370 2023-10-18T19:37:53.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.326+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4c0599e0 con 0x7efd5c062ea0 2023-10-18T19:37:53.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.327+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== osd.2 v1:172.21.15.88:6805/115939 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7efd3c04f080 con 0x7efd3c04b370 2023-10-18T19:37:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.342+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 --> v1:172.21.15.88:6805/115939 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd5c068f50 con 0x7efd3c04b370 2023-10-18T19:37:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.342+0000 7efd4a7fc700 1 -- 172.21.15.88:0/1637449074 <== osd.2 v1:172.21.15.88:6805/115939 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3806383025) 0x7efd5c068f50 con 0x7efd3c04b370 2023-10-18T19:37:53.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.342+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 >> v1:172.21.15.88:6805/115939 conn(0x7efd3c04b370 legacy=0x7efd3c04d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 >> v1:172.21.15.88:6800/113625 conn(0x7efd3c041d10 legacy=0x7efd3c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 msgr2=0x7efd5c0a80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 --2- 172.21.15.88:0/1637449074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efd5c062ea0 0x7efd5c0a80b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd4c009e20 tx=0x7efd4c015000).stop 2023-10-18T19:37:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd5ad9d700 1 -- 172.21.15.88:0/1637449074 reap_dead start 2023-10-18T19:37:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 shutdown_connections 2023-10-18T19:37:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 >> 172.21.15.88:0/1637449074 conn(0x7efd5c067ed0 msgr2=0x7efd5c13f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 shutdown_connections 2023-10-18T19:37:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.343+0000 7efd60bff700 1 -- 172.21.15.88:0/1637449074 wait complete. 2023-10-18T19:37:53.361 INFO:teuthology.orchestra.run.smithi088.stdout:124554051589 2023-10-18T19:37:53.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T19:37:53.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.551+0000 7fb84b7ff700 1 Processor -- start 2023-10-18T19:37:53.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 -- start start 2023-10-18T19:37:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 0x7fb844138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb844143590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440af9c0 con 0x7fb8440a4ec0 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a4010 con 0x7fb8440af5e0 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.552+0000 7fb84b7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb844139c20 con 0x7fb84409fdf0 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb848d9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8440a4ec0 0x7fb844139510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56874/0 (socket says 172.21.15.88:56874) 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb848d9a700 1 -- 172.21.15.88:0/3088950544 learned_addr learned my addr 172.21.15.88:0/3088950544 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb84959b700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 0x7fb844138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb844143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb83bfff700 1 -- 172.21.15.88:0/3088950544 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197350846 0 0) 0x7fb8440af9c0 con 0x7fb8440a4ec0 2023-10-18T19:37:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 -- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 msgr2=0x7fb844138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 0x7fb844138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 -- 172.21.15.88:0/3088950544 >> v1:172.21.15.88:6789/0 conn(0x7fb8440a4ec0 legacy=0x7fb844139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 -- 172.21.15.88:0/3088950544 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84409f700 con 0x7fb84409fdf0 2023-10-18T19:37:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb84959b700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 0x7fb844138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.553+0000 7fb849d9c700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb844143590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb83c009e90 tx=0x7fb83c009780).ready entity=mon.2 client_cookie=5653d5fe5abe7637 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb83bfff700 1 -- 172.21.15.88:0/3088950544 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00e070 con 0x7fb84409fdf0 2023-10-18T19:37:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb83bfff700 1 -- 172.21.15.88:0/3088950544 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00bb00 con 0x7fb84409fdf0 2023-10-18T19:37:53.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb83bfff700 1 -- 172.21.15.88:0/3088950544 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00be80 con 0x7fb84409fdf0 2023-10-18T19:37:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 -- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 msgr2=0x7fb844143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb844143590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb83c009e90 tx=0x7fb83c009780).stop 2023-10-18T19:37:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 -- 172.21.15.88:0/3088950544 shutdown_connections 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb844143590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 --2- 172.21.15.88:0/3088950544 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440af5e0 0x7fb844138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 -- 172.21.15.88:0/3088950544 >> 172.21.15.88:0/3088950544 conn(0x7fb844062a80 msgr2=0x7fb844062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 -- 172.21.15.88:0/3088950544 shutdown_connections 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.554+0000 7fb84b7ff700 1 -- 172.21.15.88:0/3088950544 wait complete. 2023-10-18T19:37:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.555+0000 7fb84b7ff700 1 Processor -- start 2023-10-18T19:37:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 -- start start 2023-10-18T19:37:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb84413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440a4ec0 0x7fb8440a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 0x7fb84414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a75d0 con 0x7fb8440af5e0 2023-10-18T19:37:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84414bc10 con 0x7fb8440a4ec0 2023-10-18T19:37:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.556+0000 7fb84b7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a8f30 con 0x7fb84409fdf0 2023-10-18T19:37:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb84959b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb84413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 0x7fb84414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb848d9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440a4ec0 0x7fb8440a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb84959b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb84413c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32876/0 (socket says 172.21.15.88:32876) 2023-10-18T19:37:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 0x7fb84414c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47318/0 (socket says 172.21.15.88:47318) 2023-10-18T19:37:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb84959b700 1 -- 172.21.15.88:0/1641027111 learned_addr learned my addr 172.21.15.88:0/1641027111 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 -- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 msgr2=0x7fb84413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 --2- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb84409fdf0 0x7fb84413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 -- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440a4ec0 msgr2=0x7fb8440a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 --2- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440a4ec0 0x7fb8440a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 -- 172.21.15.88:0/1641027111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400092a0 con 0x7fb8440af5e0 2023-10-18T19:37:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb848d9a700 1 --2- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8440a4ec0 0x7fb8440a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.557+0000 7fb849d9c700 1 --2- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 0x7fb84414c060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fb83c014000 tx=0x7fb83c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c01d630 con 0x7fb8440af5e0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c01d790 con 0x7fb8440af5e0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c009a20 con 0x7fb8440af5e0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c01db50 con 0x7fb8440af5e0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440a6950 con 0x7fb8440af5e0 2023-10-18T19:37:53.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.558+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb84405f270 con 0x7fb8440af5e0 2023-10-18T19:37:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.559+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb83c003040 con 0x7fb8440af5e0 2023-10-18T19:37:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.560+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fb83c0578b0 con 0x7fb8440af5e0 2023-10-18T19:37:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.560+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 --> v1:172.21.15.88:6813/116057 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb82804f050 con 0x7fb82804b340 2023-10-18T19:37:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.560+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83c05c220 con 0x7fb8440af5e0 2023-10-18T19:37:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.561+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== osd.3 v1:172.21.15.88:6813/116057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fb82804f050 con 0x7fb82804b340 2023-10-18T19:37:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.576+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 --> v1:172.21.15.88:6813/116057 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8440a7710 con 0x7fb82804b340 2023-10-18T19:37:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.576+0000 7fb8397fa700 1 -- 172.21.15.88:0/1641027111 <== osd.3 v1:172.21.15.88:6813/116057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7fb8440a7710 con 0x7fb82804b340 2023-10-18T19:37:53.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 >> v1:172.21.15.88:6813/116057 conn(0x7fb82804b340 legacy=0x7fb82804d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 >> v1:172.21.15.88:6800/113625 conn(0x7fb828041ce0 legacy=0x7fb8280441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 msgr2=0x7fb84414c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 --2- 172.21.15.88:0/1641027111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8440af5e0 0x7fb84414c060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fb83c014000 tx=0x7fb83c009780).stop 2023-10-18T19:37:53.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb849d9c700 1 -- 172.21.15.88:0/1641027111 reap_dead start 2023-10-18T19:37:53.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 shutdown_connections 2023-10-18T19:37:53.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 >> 172.21.15.88:0/1641027111 conn(0x7fb844062a80 msgr2=0x7fb84405e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 shutdown_connections 2023-10-18T19:37:53.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.577+0000 7fb84b7ff700 1 -- 172.21.15.88:0/1641027111 wait complete. 2023-10-18T19:37:53.596 INFO:teuthology.orchestra.run.smithi088.stdout:128849018884 2023-10-18T19:37:53.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T19:37:53.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.783+0000 7f5e157ff700 1 Processor -- start 2023-10-18T19:37:53.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.783+0000 7f5e157ff700 1 -- start start 2023-10-18T19:37:53.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100a4070 con 0x7f5e10138d20 2023-10-18T19:37:53.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e10136690 con 0x7f5e101391a0 2023-10-18T19:37:53.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e157ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100a4e00 con 0x7f5e1005e960 2023-10-18T19:37:53.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47320/0 (socket says 172.21.15.88:47320) 2023-10-18T19:37:53.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32888/0 (socket says 172.21.15.88:32888) 2023-10-18T19:37:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0e7fc700 1 -- 172.21.15.88:0/2853908264 learned_addr learned my addr 172.21.15.88:0/2853908264 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.784+0000 7f5e0f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39678/0 (socket says 172.21.15.88:39678) 2023-10-18T19:37:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 msgr2=0x7f5e100a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/2853908264 >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 msgr2=0x7f5e10135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/2853908264 >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/2853908264 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1005ed40 con 0x7f5e101391a0 2023-10-18T19:37:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0e7fc700 1 --2- 172.21.15.88:0/2853908264 >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0effd700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5e08009e60 tx=0x7f5e08009780).ready entity=mon.1 client_cookie=8b97d5980c32e0ab server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0dffb700 1 -- 172.21.15.88:0/2853908264 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800e070 con 0x7f5e101391a0 2023-10-18T19:37:53.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0dffb700 1 -- 172.21.15.88:0/2853908264 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0800bab0 con 0x7f5e101391a0 2023-10-18T19:37:53.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.785+0000 7f5e0dffb700 1 -- 172.21.15.88:0/2853908264 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800be30 con 0x7f5e101391a0 2023-10-18T19:37:53.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 -- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 msgr2=0x7f5e101361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5e08009e60 tx=0x7f5e08009780).stop 2023-10-18T19:37:53.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 -- 172.21.15.88:0/2853908264 shutdown_connections 2023-10-18T19:37:53.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e1005e960 0x7f5e100a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 --2- 172.21.15.88:0/2853908264 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e101391a0 0x7f5e101361a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 --2- 172.21.15.88:0/2853908264 >> v2:172.21.15.88:3300/0 conn(0x7f5e10138d20 0x7f5e10135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 -- 172.21.15.88:0/2853908264 >> 172.21.15.88:0/2853908264 conn(0x7f5e10063460 msgr2=0x7f5e1005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 -- 172.21.15.88:0/2853908264 shutdown_connections 2023-10-18T19:37:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.786+0000 7f5e157ff700 1 -- 172.21.15.88:0/2853908264 wait complete. 2023-10-18T19:37:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.787+0000 7f5e157ff700 1 Processor -- start 2023-10-18T19:37:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.787+0000 7f5e157ff700 1 -- start start 2023-10-18T19:37:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 0x7f5e100a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e10138d20 0x7f5e1013c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100a6330 con 0x7f5e101391a0 2023-10-18T19:37:53.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100a8690 con 0x7f5e1005e960 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e157ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100a8930 con 0x7f5e10138d20 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e0f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e0effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 0x7f5e100a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e0e7fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e10138d20 0x7f5e1013c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e0f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47324/0 (socket says 172.21.15.88:47324) 2023-10-18T19:37:53.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.788+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/3771654387 learned_addr learned my addr 172.21.15.88:0/3771654387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e10138d20 msgr2=0x7f5e1013c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e10138d20 0x7f5e1013c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 msgr2=0x7f5e100a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 0x7f5e100a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 -- 172.21.15.88:0/3771654387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009250 con 0x7f5e101391a0 2023-10-18T19:37:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0effd700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 0x7f5e100a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e0f7fe700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5e0800b610 tx=0x7f5e08009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08013e70 con 0x7f5e101391a0 2023-10-18T19:37:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0801d630 con 0x7f5e101391a0 2023-10-18T19:37:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e04009370 con 0x7f5e101391a0 2023-10-18T19:37:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0801d9f0 con 0x7f5e101391a0 2023-10-18T19:37:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.789+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e08009a20 con 0x7f5e101391a0 2023-10-18T19:37:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.790+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1006a070 con 0x7f5e101391a0 2023-10-18T19:37:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.791+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f5e08003040 con 0x7f5e101391a0 2023-10-18T19:37:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.791+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f5e08057820 con 0x7f5e101391a0 2023-10-18T19:37:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.794+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5e1006a070 con 0x7f5e101391a0 2023-10-18T19:37:53.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.941+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e1006a070 con 0x7f5e101391a0 2023-10-18T19:37:53.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.941+0000 7f5df6ffd700 1 -- 172.21.15.88:0/3771654387 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e1006a070 con 0x7f5e101391a0 2023-10-18T19:37:53.944 INFO:teuthology.orchestra.run.smithi088.stdout:115964116997 2023-10-18T19:37:53.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 >> v1:172.21.15.88:6800/113625 conn(0x7f5dfc041ce0 legacy=0x7f5dfc0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 msgr2=0x7f5e10134b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:53.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5e0800b610 tx=0x7f5e08009780).stop 2023-10-18T19:37:53.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 shutdown_connections 2023-10-18T19:37:53.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e101391a0 0x7f5e10134b40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e1005e960 0x7f5e100a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 --2- 172.21.15.88:0/3771654387 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e10138d20 0x7f5e1013c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:53.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 >> 172.21.15.88:0/3771654387 conn(0x7f5e10063460 msgr2=0x7f5e100ad100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:53.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 shutdown_connections 2023-10-18T19:37:53.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:53.943+0000 7f5e157ff700 1 -- 172.21.15.88:0/3771654387 wait complete. 2023-10-18T19:37:53.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116997 got 115964116997 for osd.0 2023-10-18T19:37:53.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T19:37:54.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.148+0000 7ff49e1ff700 1 Processor -- start 2023-10-18T19:37:54.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.148+0000 7ff49e1ff700 1 -- start start 2023-10-18T19:37:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4980a4010 con 0x7ff498139a00 2023-10-18T19:37:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980af9c0 con 0x7ff4980af5e0 2023-10-18T19:37:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff49e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff49809f700 con 0x7ff4980a4ec0 2023-10-18T19:37:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff497fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.149+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39702/0 (socket says 172.21.15.88:39702) 2023-10-18T19:37:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff497fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47330/0 (socket says 172.21.15.88:47330) 2023-10-18T19:37:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32914/0 (socket says 172.21.15.88:32914) 2023-10-18T19:37:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4977fe700 1 -- 172.21.15.88:0/2292793945 learned_addr learned my addr 172.21.15.88:0/2292793945 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:54.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 -- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 msgr2=0x7ff498138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 -- 172.21.15.88:0/2292793945 >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 msgr2=0x7ff49809fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2292793945 >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 -- 172.21.15.88:0/2292793945 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49809f9a0 con 0x7ff4980a4ec0 2023-10-18T19:37:54.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4977fe700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff497fff700 1 --2- 172.21.15.88:0/2292793945 >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).ready entity=mon.2 client_cookie=2e680f84aa05fcb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4967fc700 1 -- 172.21.15.88:0/2292793945 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00d4a0 con 0x7ff4980a4ec0 2023-10-18T19:37:54.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4967fc700 1 -- 172.21.15.88:0/2292793945 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00d600 con 0x7ff4980a4ec0 2023-10-18T19:37:54.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.150+0000 7ff4967fc700 1 -- 172.21.15.88:0/2292793945 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00d980 con 0x7ff4980a4ec0 2023-10-18T19:37:54.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 msgr2=0x7ff498139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).stop 2023-10-18T19:37:54.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2292793945 shutdown_connections 2023-10-18T19:37:54.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2292793945 >> v2:172.21.15.88:3300/0 conn(0x7ff498139a00 0x7ff49809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980af5e0 0x7ff498138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2292793945 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980a4ec0 0x7ff498139510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2292793945 >> 172.21.15.88:0/2292793945 conn(0x7ff498062a80 msgr2=0x7ff498062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:54.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2292793945 shutdown_connections 2023-10-18T19:37:54.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.151+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2292793945 wait complete. 2023-10-18T19:37:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.152+0000 7ff49e1ff700 1 Processor -- start 2023-10-18T19:37:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.152+0000 7ff49e1ff700 1 -- start start 2023-10-18T19:37:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 0x7ff498148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980abf90 con 0x7ff498148b30 2023-10-18T19:37:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498148840 con 0x7ff4980a4ec0 2023-10-18T19:37:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff49e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980ac490 con 0x7ff4980af5e0 2023-10-18T19:37:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39710/0 (socket says 172.21.15.88:39710) 2023-10-18T19:37:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff496ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32926/0 (socket says 172.21.15.88:32926) 2023-10-18T19:37:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff4977fe700 1 -- 172.21.15.88:0/2109887808 learned_addr learned my addr 172.21.15.88:0/2109887808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.153+0000 7ff497fff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 0x7ff498148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 -- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 msgr2=0x7ff4980aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 -- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 msgr2=0x7ff498148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 0x7ff498148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 -- 172.21.15.88:0/2109887808 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009370 con 0x7ff4980af5e0 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff4977fe700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff497fff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 0x7ff498148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff496ffd700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff48c013000 tx=0x7ff48c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c000bc0 con 0x7ff4980af5e0 2023-10-18T19:37:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00d770 con 0x7ff4980af5e0 2023-10-18T19:37:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c000d20 con 0x7ff4980af5e0 2023-10-18T19:37:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.154+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff490009a20 con 0x7ff4980af5e0 2023-10-18T19:37:54.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.155+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0092a0 con 0x7ff4980af5e0 2023-10-18T19:37:54.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.156+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49805f270 con 0x7ff4980af5e0 2023-10-18T19:37:54.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.156+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7ff48c01d910 con 0x7ff4980af5e0 2023-10-18T19:37:54.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.156+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff48c056fe0 con 0x7ff4980af5e0 2023-10-18T19:37:54.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.159+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ff48c03afe0 con 0x7ff4980af5e0 2023-10-18T19:37:54.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.309+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff498149880 con 0x7ff4980af5e0 2023-10-18T19:37:54.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.309+0000 7ff47f7fe700 1 -- 172.21.15.88:0/2109887808 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff498149880 con 0x7ff4980af5e0 2023-10-18T19:37:54.312 INFO:teuthology.orchestra.run.smithi088.stdout:120259084293 2023-10-18T19:37:54.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 >> v1:172.21.15.88:6800/113625 conn(0x7ff484041ce0 legacy=0x7ff4840441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 msgr2=0x7ff4980ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff48c013000 tx=0x7ff48c016000).stop 2023-10-18T19:37:54.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 shutdown_connections 2023-10-18T19:37:54.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff498148b30 0x7ff498148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4980a4ec0 0x7ff4980aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 --2- 172.21.15.88:0/2109887808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4980af5e0 0x7ff4980ab210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 >> 172.21.15.88:0/2109887808 conn(0x7ff498062a80 msgr2=0x7ff498136ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:54.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 shutdown_connections 2023-10-18T19:37:54.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.311+0000 7ff49e1ff700 1 -- 172.21.15.88:0/2109887808 wait complete. 2023-10-18T19:37:54.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084293 for osd.1 2023-10-18T19:37:54.331 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T19:37:54.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.519+0000 7f2bef7ff700 1 Processor -- start 2023-10-18T19:37:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.519+0000 7f2bef7ff700 1 -- start start 2023-10-18T19:37:54.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bef7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 0x7f2be80a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bef7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2be8141520 0x7f2be8143910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bef7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be80a4f90 con 0x7f2be80a4bb0 2023-10-18T19:37:54.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bef7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be813caa0 con 0x7f2be8141520 2023-10-18T19:37:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bef7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be80a41f0 con 0x7f2be813c6a0 2023-10-18T19:37:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2becd9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 0x7f2be80a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bed59b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2be80a4bb0 0x7f2be80a0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:56882/0 (socket says 172.21.15.88:56882) 2023-10-18T19:37:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bed59b700 1 -- 172.21.15.88:0/3297362169 learned_addr learned my addr 172.21.15.88:0/3297362169 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.520+0000 7f2bedd9c700 1 --2- 172.21.15.88:0/3297362169 >> v2:172.21.15.88:3300/0 conn(0x7f2be8141520 0x7f2be8143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bedd9c700 1 -- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 msgr2=0x7f2be80a2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bedd9c700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 0x7f2be80a2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bedd9c700 1 -- 172.21.15.88:0/3297362169 >> v1:172.21.15.88:6789/0 conn(0x7f2be80a4bb0 legacy=0x7f2be80a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bedd9c700 1 -- 172.21.15.88:0/3297362169 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be80a3480 con 0x7f2be8141520 2023-10-18T19:37:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bdffff700 1 -- 172.21.15.88:0/3297362169 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882228094 0 0) 0x7f2be80a4f90 con 0x7f2be80a4bb0 2023-10-18T19:37:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2becd9a700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 0x7f2be80a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bedd9c700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be8141520 0x7f2be8143910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2be0009e60 tx=0x7f2be0009780).ready entity=mon.0 client_cookie=ce858fe48b40e9e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bdffff700 1 -- 172.21.15.88:0/3297362169 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be000e070 con 0x7f2be8141520 2023-10-18T19:37:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bdffff700 1 -- 172.21.15.88:0/3297362169 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be000bbf0 con 0x7f2be8141520 2023-10-18T19:37:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.521+0000 7f2bdffff700 1 -- 172.21.15.88:0/3297362169 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0012410 con 0x7f2be8141520 2023-10-18T19:37:54.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be8141520 msgr2=0x7f2be8143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be8141520 0x7f2be8143910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2be0009e60 tx=0x7f2be0009780).stop 2023-10-18T19:37:54.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3297362169 shutdown_connections 2023-10-18T19:37:54.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be8141520 0x7f2be8143910 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3297362169 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be813c6a0 0x7f2be80a2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3297362169 >> 172.21.15.88:0/3297362169 conn(0x7f2be80af0a0 msgr2=0x7f2be80af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:54.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3297362169 shutdown_connections 2023-10-18T19:37:54.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.522+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3297362169 wait complete. 2023-10-18T19:37:54.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.523+0000 7f2bef7ff700 1 Processor -- start 2023-10-18T19:37:54.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 -- start start 2023-10-18T19:37:54.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 0x7f2be80a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be80a8660 con 0x7f2be813c6a0 2023-10-18T19:37:54.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be80a7d70 con 0x7f2be80a4bb0 2023-10-18T19:37:54.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.524+0000 7f2bef7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be813e9b0 con 0x7f2be8141520 2023-10-18T19:37:54.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 0x7f2be80a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bedd9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2becd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bedd9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32946/0 (socket says 172.21.15.88:32946) 2023-10-18T19:37:54.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2becd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47360/0 (socket says 172.21.15.88:47360) 2023-10-18T19:37:54.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bedd9c700 1 -- 172.21.15.88:0/3794343269 learned_addr learned my addr 172.21.15.88:0/3794343269 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:54.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 -- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 msgr2=0x7f2be814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 -- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 msgr2=0x7f2be80a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 -- 172.21.15.88:0/3794343269 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80092a0 con 0x7f2be80a4bb0 2023-10-18T19:37:54.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bedd9c700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2becd9a700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bed59b700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 0x7f2be80a66b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2be4000c00 tx=0x7f2be4007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be40070d0 con 0x7f2be80a4bb0 2023-10-18T19:37:54.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be4007250 con 0x7f2be80a4bb0 2023-10-18T19:37:54.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4007610 con 0x7f2be80a4bb0 2023-10-18T19:37:54.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.525+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be0009a20 con 0x7f2be80a4bb0 2023-10-18T19:37:54.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.526+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be80a57e0 con 0x7f2be80a4bb0 2023-10-18T19:37:54.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.527+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f2be40059b0 con 0x7f2be80a4bb0 2023-10-18T19:37:54.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.527+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be80ac5f0 con 0x7f2be80a4bb0 2023-10-18T19:37:54.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.527+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f2be4054e20 con 0x7f2be80a4bb0 2023-10-18T19:37:54.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.531+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2be4035160 con 0x7f2be80a4bb0 2023-10-18T19:37:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.680+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2be805f270 con 0x7f2be80a4bb0 2023-10-18T19:37:54.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.680+0000 7f2bdd7fa700 1 -- 172.21.15.88:0/3794343269 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2be4038950 con 0x7f2be80a4bb0 2023-10-18T19:37:54.683 INFO:teuthology.orchestra.run.smithi088.stdout:124554051589 2023-10-18T19:37:54.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 >> v1:172.21.15.88:6800/113625 conn(0x7f2bcc041ce0 legacy=0x7f2bcc0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 msgr2=0x7f2be80a66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 0x7f2be80a66b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f2be4000c00 tx=0x7f2be4007b90).stop 2023-10-18T19:37:54.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 shutdown_connections 2023-10-18T19:37:54.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2be8141520 0x7f2be814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2be80a4bb0 0x7f2be80a66b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 --2- 172.21.15.88:0/3794343269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2be813c6a0 0x7f2be80a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 >> 172.21.15.88:0/3794343269 conn(0x7f2be80af0a0 msgr2=0x7f2be80ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:54.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 shutdown_connections 2023-10-18T19:37:54.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.682+0000 7f2bef7ff700 1 -- 172.21.15.88:0/3794343269 wait complete. 2023-10-18T19:37:54.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051589 got 124554051589 for osd.2 2023-10-18T19:37:54.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T19:37:54.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.889+0000 7fa8773ff700 1 Processor -- start 2023-10-18T19:37:54.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.889+0000 7fa8773ff700 1 -- start start 2023-10-18T19:37:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa8773ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa87005e960 0x7fa8700a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa8773ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa8773ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700a4e00 con 0x7fa8701391a0 2023-10-18T19:37:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa8773ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700a4070 con 0x7fa87005e960 2023-10-18T19:37:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa8773ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87005ed40 con 0x7fa870138d20 2023-10-18T19:37:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87519b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa87005e960 0x7fa8700a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39728/0 (socket says 172.21.15.88:39728) 2023-10-18T19:37:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 -- 172.21.15.88:0/2628340871 learned_addr learned my addr 172.21.15.88:0/2628340871 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 -- 172.21.15.88:0/2628340871 >> v2:172.21.15.88:3300/0 conn(0x7fa87005e960 msgr2=0x7fa8700a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 --2- 172.21.15.88:0/2628340871 >> v2:172.21.15.88:3300/0 conn(0x7fa87005e960 0x7fa8700a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 -- 172.21.15.88:0/2628340871 >> v1:172.21.15.88:6789/0 conn(0x7fa8701391a0 legacy=0x7fa87013c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.890+0000 7fa87499a700 1 -- 172.21.15.88:0/2628340871 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700a4bf0 con 0x7fa870138d20 2023-10-18T19:37:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa87499a700 1 --2- 172.21.15.88:0/2628340871 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa860006fd0 tx=0x7fa8600090f0).ready entity=mon.1 client_cookie=c7aa30774e0244b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa867fff700 1 -- 172.21.15.88:0/2628340871 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000b580 con 0x7fa870138d20 2023-10-18T19:37:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa867fff700 1 -- 172.21.15.88:0/2628340871 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86000b6e0 con 0x7fa870138d20 2023-10-18T19:37:54.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa867fff700 1 -- 172.21.15.88:0/2628340871 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000ba60 con 0x7fa870138d20 2023-10-18T19:37:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 -- 172.21.15.88:0/2628340871 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 msgr2=0x7fa870135cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2628340871 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa860006fd0 tx=0x7fa8600090f0).stop 2023-10-18T19:37:54.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 -- 172.21.15.88:0/2628340871 shutdown_connections 2023-10-18T19:37:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2628340871 >> v2:172.21.15.88:3300/0 conn(0x7fa87005e960 0x7fa8700a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2628340871 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa870135cb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 -- 172.21.15.88:0/2628340871 >> 172.21.15.88:0/2628340871 conn(0x7fa870063460 msgr2=0x7fa87005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.891+0000 7fa8773ff700 1 -- 172.21.15.88:0/2628340871 shutdown_connections 2023-10-18T19:37:54.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.892+0000 7fa8773ff700 1 -- 172.21.15.88:0/2628340871 wait complete. 2023-10-18T19:37:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.893+0000 7fa8773ff700 1 Processor -- start 2023-10-18T19:37:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.893+0000 7fa8773ff700 1 -- start start 2023-10-18T19:37:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.894+0000 7fa8773ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa8773ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa8700a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa8773ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 0x7fa87014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa8773ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700a7a10 con 0x7fa8701391a0 2023-10-18T19:37:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa8773ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87013af60 con 0x7fa870138d20 2023-10-18T19:37:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa8773ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700a6cf0 con 0x7fa87005e960 2023-10-18T19:37:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:32952/0 (socket says 172.21.15.88:32952) 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87499a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa8700a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 -- 172.21.15.88:0/2489188288 learned_addr learned my addr 172.21.15.88:0/2489188288 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87599c700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 0x7fa87014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 -- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 msgr2=0x7fa8700a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa8700a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 -- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 msgr2=0x7fa87014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:54.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 0x7fa87014c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:54.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 -- 172.21.15.88:0/2489188288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860009370 con 0x7fa87005e960 2023-10-18T19:37:54.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87499a700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa8700a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87599c700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 0x7fa87014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:54.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.895+0000 7fa87519b700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa86c00e8d0 tx=0x7fa86c006f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.896+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c009450 con 0x7fa87005e960 2023-10-18T19:37:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.896+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c012600 con 0x7fa87005e960 2023-10-18T19:37:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.896+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8700a86d0 con 0x7fa87005e960 2023-10-18T19:37:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.896+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c012980 con 0x7fa87005e960 2023-10-18T19:37:54.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.896+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87013cac0 con 0x7fa87005e960 2023-10-18T19:37:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.897+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700a88c0 con 0x7fa87005e960 2023-10-18T19:37:54.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.897+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fa86c012cf0 con 0x7fa87005e960 2023-10-18T19:37:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.898+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fa86c055c10 con 0x7fa87005e960 2023-10-18T19:37:54.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:54.901+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa8700a88c0 con 0x7fa87005e960 2023-10-18T19:37:55.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.048+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8700a88c0 con 0x7fa87005e960 2023-10-18T19:37:55.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.048+0000 7fa8657fa700 1 -- 172.21.15.88:0/2489188288 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8700a88c0 con 0x7fa87005e960 2023-10-18T19:37:55.052 INFO:teuthology.orchestra.run.smithi088.stdout:128849018883 2023-10-18T19:37:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 >> v1:172.21.15.88:6800/113625 conn(0x7fa854041ce0 legacy=0x7fa8540441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 msgr2=0x7fa8700a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:55.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fa86c00e8d0 tx=0x7fa86c006f40).stop 2023-10-18T19:37:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 shutdown_connections 2023-10-18T19:37:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8701391a0 0x7fa87014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa87005e960 0x7fa8700a7110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 --2- 172.21.15.88:0/2489188288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa870138d20 0x7fa8700a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:55.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 >> 172.21.15.88:0/2489188288 conn(0x7fa870063460 msgr2=0x7fa8700a31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 shutdown_connections 2023-10-18T19:37:55.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:55.050+0000 7fa8773ff700 1 -- 172.21.15.88:0/2489188288 wait complete. 2023-10-18T19:37:55.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.3 2023-10-18T19:37:56.072 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T19:37:56.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.270+0000 7f2277fff700 1 Processor -- start 2023-10-18T19:37:56.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 -- start start 2023-10-18T19:37:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270143390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700a4e00 con 0x7f2270138d20 2023-10-18T19:37:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700a4070 con 0x7f227005e960 2023-10-18T19:37:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.271+0000 7f2277fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f227005ed40 con 0x7f22701363c0 2023-10-18T19:37:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40236/0 (socket says 172.21.15.88:40236) 2023-10-18T19:37:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 -- 172.21.15.88:0/2283403981 learned_addr learned my addr 172.21.15.88:0/2283403981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f227659c700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 -- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 msgr2=0x7f2270143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 -- 172.21.15.88:0/2283403981 >> v1:172.21.15.88:6789/0 conn(0x7f2270138d20 legacy=0x7f2270135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 -- 172.21.15.88:0/2283403981 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700a4bf0 con 0x7f227005e960 2023-10-18T19:37:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2274d99700 1 -- 172.21.15.88:0/2283403981 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239051922 0 0) 0x7f22700a4e00 con 0x7f2270138d20 2023-10-18T19:37:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.272+0000 7f2275d9b700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f226c009840 tx=0x7f226c009060).ready entity=mon.1 client_cookie=6cec549deb9f07a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2274d99700 1 -- 172.21.15.88:0/2283403981 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c005880 con 0x7f227005e960 2023-10-18T19:37:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2274d99700 1 -- 172.21.15.88:0/2283403981 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c0059e0 con 0x7f227005e960 2023-10-18T19:37:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2274d99700 1 -- 172.21.15.88:0/2283403981 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c005d60 con 0x7f227005e960 2023-10-18T19:37:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 -- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 msgr2=0x7f22700a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f226c009840 tx=0x7f226c009060).stop 2023-10-18T19:37:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 -- 172.21.15.88:0/2283403981 shutdown_connections 2023-10-18T19:37:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 --2- 172.21.15.88:0/2283403981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f227005e960 0x7f22700a4700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 -- 172.21.15.88:0/2283403981 >> 172.21.15.88:0/2283403981 conn(0x7f2270063460 msgr2=0x7f227005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 -- 172.21.15.88:0/2283403981 shutdown_connections 2023-10-18T19:37:56.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.273+0000 7f2277fff700 1 -- 172.21.15.88:0/2283403981 wait complete. 2023-10-18T19:37:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.275+0000 7f2277fff700 1 Processor -- start 2023-10-18T19:37:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.275+0000 7f2277fff700 1 -- start start 2023-10-18T19:37:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.275+0000 7f2277fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 0x7f22700a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2277fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2277fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 0x7f2270147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2277fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700a7990 con 0x7f227005e960 2023-10-18T19:37:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2277fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700a8260 con 0x7f2270138d20 2023-10-18T19:37:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2277fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22701483e0 con 0x7f22701363c0 2023-10-18T19:37:56.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2275d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 0x7f22700a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 0x7f2270147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227559a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2275d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 0x7f22700a8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55144/0 (socket says 172.21.15.88:55144) 2023-10-18T19:37:56.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f2275d9b700 1 -- 172.21.15.88:0/973385596 learned_addr learned my addr 172.21.15.88:0/973385596 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 -- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 msgr2=0x7f2270136cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270136cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 -- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 msgr2=0x7f22700a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 0x7f22700a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 -- 172.21.15.88:0/973385596 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009300 con 0x7f2270138d20 2023-10-18T19:37:56.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.276+0000 7f227659c700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 0x7f2270147770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2268009e50 tx=0x7f226800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:56.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.277+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800caa0 con 0x7f2270138d20 2023-10-18T19:37:56.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.277+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226800f040 con 0x7f2270138d20 2023-10-18T19:37:56.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.277+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800ce10 con 0x7f2270138d20 2023-10-18T19:37:56.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.277+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22701486a0 con 0x7f2270138d20 2023-10-18T19:37:56.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.277+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2270148f40 con 0x7f2270138d20 2023-10-18T19:37:56.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.278+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22700a8780 con 0x7f2270138d20 2023-10-18T19:37:56.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.278+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f2268013610 con 0x7f2270138d20 2023-10-18T19:37:56.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.279+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f22680560f0 con 0x7f2270138d20 2023-10-18T19:37:56.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.283+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f22680363c0 con 0x7f2270138d20 2023-10-18T19:37:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.431+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f227005f270 con 0x7f2270138d20 2023-10-18T19:37:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.432+0000 7f2265ffb700 1 -- 172.21.15.88:0/973385596 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2268039bb0 con 0x7f2270138d20 2023-10-18T19:37:56.435 INFO:teuthology.orchestra.run.smithi088.stdout:128849018885 2023-10-18T19:37:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 >> v1:172.21.15.88:6800/113625 conn(0x7f2254041ce0 legacy=0x7f22540441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 msgr2=0x7f2270147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 0x7f2270147770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2268009e50 tx=0x7f226800b040).stop 2023-10-18T19:37:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 shutdown_connections 2023-10-18T19:37:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2270138d20 0x7f2270147770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f227005e960 0x7f22700a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 --2- 172.21.15.88:0/973385596 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f22701363c0 0x7f2270136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.433+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 >> 172.21.15.88:0/973385596 conn(0x7f2270063460 msgr2=0x7f227009f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:56.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.434+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 shutdown_connections 2023-10-18T19:37:56.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.434+0000 7f2277fff700 1 -- 172.21.15.88:0/973385596 wait complete. 2023-10-18T19:37:56.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018885 for osd.3 2023-10-18T19:37:56.453 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T19:37:56.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.640+0000 7f375cbff700 1 Processor -- start 2023-10-18T19:37:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.641+0000 7f375cbff700 1 -- start start 2023-10-18T19:37:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.641+0000 7f375cbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375cbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375cbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 0x7f3758138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375cbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37580a3a70 con 0x7f37581361c0 2023-10-18T19:37:56.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375cbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375805ed40 con 0x7f37580a4a20 2023-10-18T19:37:56.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375cbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3758136640 con 0x7f375805e960 2023-10-18T19:37:56.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40252/0 (socket says 172.21.15.88:40252) 2023-10-18T19:37:56.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 -- 172.21.15.88:0/2373912679 learned_addr learned my addr 172.21.15.88:0/2373912679 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:56.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3756d9d700 1 --2- 172.21.15.88:0/2373912679 >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 0x7f3758138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f375659c700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 -- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 msgr2=0x7f37580a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:56.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 -- 172.21.15.88:0/2373912679 >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 msgr2=0x7f3758138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 --2- 172.21.15.88:0/2373912679 >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 0x7f3758138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3755d9b700 1 -- 172.21.15.88:0/2373912679 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580a2ac0 con 0x7f37580a4a20 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.642+0000 7f3756d9d700 1 --2- 172.21.15.88:0/2373912679 >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 0x7f3758138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f3755d9b700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f374c009860 tx=0x7f374c0090f0).ready entity=mon.1 client_cookie=7ed1e3db1046fa48 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375559a700 1 -- 172.21.15.88:0/2373912679 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00f510 con 0x7f37580a4a20 2023-10-18T19:37:56.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375559a700 1 -- 172.21.15.88:0/2373912679 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00f670 con 0x7f37580a4a20 2023-10-18T19:37:56.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375559a700 1 -- 172.21.15.88:0/2373912679 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00f9f0 con 0x7f37580a4a20 2023-10-18T19:37:56.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 -- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 msgr2=0x7f3758135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f374c009860 tx=0x7f374c0090f0).stop 2023-10-18T19:37:56.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 -- 172.21.15.88:0/2373912679 shutdown_connections 2023-10-18T19:37:56.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 --2- 172.21.15.88:0/2373912679 >> v2:172.21.15.88:3300/0 conn(0x7f37581361c0 0x7f3758138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 --2- 172.21.15.88:0/2373912679 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37580a4a20 0x7f3758135cd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 -- 172.21.15.88:0/2373912679 >> 172.21.15.88:0/2373912679 conn(0x7f3758064bb0 msgr2=0x7f375805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:56.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.643+0000 7f375cbff700 1 -- 172.21.15.88:0/2373912679 shutdown_connections 2023-10-18T19:37:56.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.644+0000 7f375cbff700 1 -- 172.21.15.88:0/2373912679 wait complete. 2023-10-18T19:37:56.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.645+0000 7f375cbff700 1 Processor -- start 2023-10-18T19:37:56.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.645+0000 7f375cbff700 1 -- start start 2023-10-18T19:37:56.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 0x7f3758137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37581361c0 0x7f3758138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:56.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37580a8350 con 0x7f37580a4a20 2023-10-18T19:37:56.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37580a6880 con 0x7f37581361c0 2023-10-18T19:37:56.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375cbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37580a8fb0 con 0x7f375805e960 2023-10-18T19:37:56.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375659c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375659c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47820/0 (socket says 172.21.15.88:47820) 2023-10-18T19:37:56.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375659c700 1 -- 172.21.15.88:0/3031932362 learned_addr learned my addr 172.21.15.88:0/3031932362 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:56.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 0x7f3758137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3756d9d700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37581361c0 0x7f3758138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:56.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 -- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 msgr2=0x7f37580ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 -- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37581361c0 msgr2=0x7f3758138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37581361c0 0x7f3758138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f3755d9b700 1 -- 172.21.15.88:0/3031932362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009a20 con 0x7f37580a4a20 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.646+0000 7f375659c700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:56.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f3755d9b700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 0x7f3758137d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f374c014000 tx=0x7f374c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:56.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00f7e0 con 0x7f37580a4a20 2023-10-18T19:37:56.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00f960 con 0x7f37580a4a20 2023-10-18T19:37:56.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c01c670 con 0x7f37580a4a20 2023-10-18T19:37:56.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c009370 con 0x7f37580a4a20 2023-10-18T19:37:56.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.647+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37580a54b0 con 0x7f37580a4a20 2023-10-18T19:37:56.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.648+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375805f270 con 0x7f37580a4a20 2023-10-18T19:37:56.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.648+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f374c01ca60 con 0x7f37580a4a20 2023-10-18T19:37:56.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.649+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f374c0572b0 con 0x7f37580a4a20 2023-10-18T19:37:56.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.652+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f374c005f40 con 0x7f37580a4a20 2023-10-18T19:37:56.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.794+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37580a1100 con 0x7f3738041ce0 2023-10-18T19:37:56.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.804+0000 7f37467fc700 1 -- 172.21.15.88:0/3031932362 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+321121 (unknown 2965378022 0 3414633563) 0x7f37580a1100 con 0x7f3738041ce0 2023-10-18T19:37:56.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 >> v1:172.21.15.88:6800/113625 conn(0x7f3738041ce0 legacy=0x7f37380441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 msgr2=0x7f3758137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 0x7f3758137d70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f374c014000 tx=0x7f374c017000).stop 2023-10-18T19:37:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 shutdown_connections 2023-10-18T19:37:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37581361c0 0x7f3758138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f375805e960 0x7f37580ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 --2- 172.21.15.88:0/3031932362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37580a4a20 0x7f3758137d70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 >> 172.21.15.88:0/3031932362 conn(0x7f3758064bb0 msgr2=0x7f37580aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 shutdown_connections 2023-10-18T19:37:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:56.808+0000 7f375cbff700 1 -- 172.21.15.88:0/3031932362 wait complete. 2023-10-18T19:37:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-10-18T19:37:55.362940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":1190016,"kb_used_data":1376,"kb_used_omap":36,"kb_used_meta":1188571,"kb_avail":376297344,"statfs":{"total":386547056640,"available":385328480256,"internally_reserved":0,"allocated":1409024,"data_stored":587312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":1217097592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001585"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304162+0000","last_change":"2023-10-18T19:37:40.156800+0000","last_active":"2023-10-18T19:37:50.304162+0000","last_peered":"2023-10-18T19:37:50.304162+0000","last_clean":"2023-10-18T19:37:50.304162+0000","last_became_active":"2023-10-18T19:37:40.156384+0000","last_became_peered":"2023-10-18T19:37:40.156384+0000","last_unstale":"2023-10-18T19:37:50.304162+0000","last_undegraded":"2023-10-18T19:37:50.304162+0000","last_fullsized":"2023-10-18T19:37:50.304162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496088+0000","last_change":"2023-10-18T19:37:41.163499+0000","last_active":"2023-10-18T19:37:50.496088+0000","last_peered":"2023-10-18T19:37:50.496088+0000","last_clean":"2023-10-18T19:37:50.496088+0000","last_became_active":"2023-10-18T19:37:41.161563+0000","last_became_peered":"2023-10-18T19:37:41.161563+0000","last_unstale":"2023-10-18T19:37:50.496088+0000","last_undegraded":"2023-10-18T19:37:50.496088+0000","last_fullsized":"2023-10-18T19:37:50.496088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222243+0000","last_change":"2023-10-18T19:37:41.175363+0000","last_active":"2023-10-18T19:37:50.222243+0000","last_peered":"2023-10-18T19:37:50.222243+0000","last_clean":"2023-10-18T19:37:50.222243+0000","last_became_active":"2023-10-18T19:37:41.174057+0000","last_became_peered":"2023-10-18T19:37:41.174057+0000","last_unstale":"2023-10-18T19:37:50.222243+0000","last_undegraded":"2023-10-18T19:37:50.222243+0000","last_fullsized":"2023-10-18T19:37:50.222243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495454+0000","last_change":"2023-10-18T19:37:41.183364+0000","last_active":"2023-10-18T19:37:50.495454+0000","last_peered":"2023-10-18T19:37:50.495454+0000","last_clean":"2023-10-18T19:37:50.495454+0000","last_became_active":"2023-10-18T19:37:41.183031+0000","last_became_peered":"2023-10-18T19:37:41.183031+0000","last_unstale":"2023-10-18T19:37:50.495454+0000","last_undegraded":"2023-10-18T19:37:50.495454+0000","last_fullsized":"2023-10-18T19:37:50.495454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495160+0000","last_change":"2023-10-18T19:37:41.167771+0000","last_active":"2023-10-18T19:37:50.495160+0000","last_peered":"2023-10-18T19:37:50.495160+0000","last_clean":"2023-10-18T19:37:50.495160+0000","last_became_active":"2023-10-18T19:37:41.167443+0000","last_became_peered":"2023-10-18T19:37:41.167443+0000","last_unstale":"2023-10-18T19:37:50.495160+0000","last_undegraded":"2023-10-18T19:37:50.495160+0000","last_fullsized":"2023-10-18T19:37:50.495160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495274+0000","last_change":"2023-10-18T19:37:41.183248+0000","last_active":"2023-10-18T19:37:50.495274+0000","last_peered":"2023-10-18T19:37:50.495274+0000","last_clean":"2023-10-18T19:37:50.495274+0000","last_became_active":"2023-10-18T19:37:41.182944+0000","last_became_peered":"2023-10-18T19:37:41.182944+0000","last_unstale":"2023-10-18T19:37:50.495274+0000","last_undegraded":"2023-10-18T19:37:50.495274+0000","last_fullsized":"2023-10-18T19:37:50.495274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303697+0000","last_change":"2023-10-18T19:37:41.169690+0000","last_active":"2023-10-18T19:37:50.303697+0000","last_peered":"2023-10-18T19:37:50.303697+0000","last_clean":"2023-10-18T19:37:50.303697+0000","last_became_active":"2023-10-18T19:37:41.169425+0000","last_became_peered":"2023-10-18T19:37:41.169425+0000","last_unstale":"2023-10-18T19:37:50.303697+0000","last_undegraded":"2023-10-18T19:37:50.303697+0000","last_fullsized":"2023-10-18T19:37:50.303697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495258+0000","last_change":"2023-10-18T19:37:41.173351+0000","last_active":"2023-10-18T19:37:50.495258+0000","last_peered":"2023-10-18T19:37:50.495258+0000","last_clean":"2023-10-18T19:37:50.495258+0000","last_became_active":"2023-10-18T19:37:41.170664+0000","last_became_peered":"2023-10-18T19:37:41.170664+0000","last_unstale":"2023-10-18T19:37:50.495258+0000","last_undegraded":"2023-10-18T19:37:50.495258+0000","last_fullsized":"2023-10-18T19:37:50.495258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496303+0000","last_change":"2023-10-18T19:37:41.163809+0000","last_active":"2023-10-18T19:37:50.496303+0000","last_peered":"2023-10-18T19:37:50.496303+0000","last_clean":"2023-10-18T19:37:50.496303+0000","last_became_active":"2023-10-18T19:37:41.163487+0000","last_became_peered":"2023-10-18T19:37:41.163487+0000","last_unstale":"2023-10-18T19:37:50.496303+0000","last_undegraded":"2023-10-18T19:37:50.496303+0000","last_fullsized":"2023-10-18T19:37:50.496303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304589+0000","last_change":"2023-10-18T19:37:40.155058+0000","last_active":"2023-10-18T19:37:50.304589+0000","last_peered":"2023-10-18T19:37:50.304589+0000","last_clean":"2023-10-18T19:37:50.304589+0000","last_became_active":"2023-10-18T19:37:40.154735+0000","last_became_peered":"2023-10-18T19:37:40.154735+0000","last_unstale":"2023-10-18T19:37:50.304589+0000","last_undegraded":"2023-10-18T19:37:50.304589+0000","last_fullsized":"2023-10-18T19:37:50.304589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223423+0000","last_change":"2023-10-18T19:37:41.178985+0000","last_active":"2023-10-18T19:37:50.223423+0000","last_peered":"2023-10-18T19:37:50.223423+0000","last_clean":"2023-10-18T19:37:50.223423+0000","last_became_active":"2023-10-18T19:37:41.178508+0000","last_became_peered":"2023-10-18T19:37:41.178508+0000","last_unstale":"2023-10-18T19:37:50.223423+0000","last_undegraded":"2023-10-18T19:37:50.223423+0000","last_fullsized":"2023-10-18T19:37:50.223423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222870+0000","last_change":"2023-10-18T19:37:39.147263+0000","last_active":"2023-10-18T19:37:50.222870+0000","last_peered":"2023-10-18T19:37:50.222870+0000","last_clean":"2023-10-18T19:37:50.222870+0000","last_became_active":"2023-10-18T19:37:39.146491+0000","last_became_peered":"2023-10-18T19:37:39.146491+0000","last_unstale":"2023-10-18T19:37:50.222870+0000","last_undegraded":"2023-10-18T19:37:50.222870+0000","last_fullsized":"2023-10-18T19:37:50.222870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496272+0000","last_change":"2023-10-18T19:37:41.161719+0000","last_active":"2023-10-18T19:37:50.496272+0000","last_peered":"2023-10-18T19:37:50.496272+0000","last_clean":"2023-10-18T19:37:50.496272+0000","last_became_active":"2023-10-18T19:37:41.161382+0000","last_became_peered":"2023-10-18T19:37:41.161382+0000","last_unstale":"2023-10-18T19:37:50.496272+0000","last_undegraded":"2023-10-18T19:37:50.496272+0000","last_fullsized":"2023-10-18T19:37:50.496272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304234+0000","last_change":"2023-10-18T19:37:41.169665+0000","last_active":"2023-10-18T19:37:50.304234+0000","last_peered":"2023-10-18T19:37:50.304234+0000","last_clean":"2023-10-18T19:37:50.304234+0000","last_became_active":"2023-10-18T19:37:41.168871+0000","last_became_peered":"2023-10-18T19:37:41.168871+0000","last_unstale":"2023-10-18T19:37:50.304234+0000","last_undegraded":"2023-10-18T19:37:50.304234+0000","last_fullsized":"2023-10-18T19:37:50.304234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222929+0000","last_change":"2023-10-18T19:37:41.173493+0000","last_active":"2023-10-18T19:37:50.222929+0000","last_peered":"2023-10-18T19:37:50.222929+0000","last_clean":"2023-10-18T19:37:50.222929+0000","last_became_active":"2023-10-18T19:37:41.173140+0000","last_became_peered":"2023-10-18T19:37:41.173140+0000","last_unstale":"2023-10-18T19:37:50.222929+0000","last_undegraded":"2023-10-18T19:37:50.222929+0000","last_fullsized":"2023-10-18T19:37:50.222929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496976+0000","last_change":"2023-10-18T19:37:41.164504+0000","last_active":"2023-10-18T19:37:50.496976+0000","last_peered":"2023-10-18T19:37:50.496976+0000","last_clean":"2023-10-18T19:37:50.496976+0000","last_became_active":"2023-10-18T19:37:41.164140+0000","last_became_peered":"2023-10-18T19:37:41.164140+0000","last_unstale":"2023-10-18T19:37:50.496976+0000","last_undegraded":"2023-10-18T19:37:50.496976+0000","last_fullsized":"2023-10-18T19:37:50.496976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222358+0000","last_change":"2023-10-18T19:37:41.176293+0000","last_active":"2023-10-18T19:37:50.222358+0000","last_peered":"2023-10-18T19:37:50.222358+0000","last_clean":"2023-10-18T19:37:50.222358+0000","last_became_active":"2023-10-18T19:37:41.175856+0000","last_became_peered":"2023-10-18T19:37:41.175856+0000","last_unstale":"2023-10-18T19:37:50.222358+0000","last_undegraded":"2023-10-18T19:37:50.222358+0000","last_fullsized":"2023-10-18T19:37:50.222358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222453+0000","last_change":"2023-10-18T19:37:41.175551+0000","last_active":"2023-10-18T19:37:50.222453+0000","last_peered":"2023-10-18T19:37:50.222453+0000","last_clean":"2023-10-18T19:37:50.222453+0000","last_became_active":"2023-10-18T19:37:41.174401+0000","last_became_peered":"2023-10-18T19:37:41.174401+0000","last_unstale":"2023-10-18T19:37:50.222453+0000","last_undegraded":"2023-10-18T19:37:50.222453+0000","last_fullsized":"2023-10-18T19:37:50.222453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496752+0000","last_change":"2023-10-18T19:37:41.165936+0000","last_active":"2023-10-18T19:37:50.496752+0000","last_peered":"2023-10-18T19:37:50.496752+0000","last_clean":"2023-10-18T19:37:50.496752+0000","last_became_active":"2023-10-18T19:37:41.162921+0000","last_became_peered":"2023-10-18T19:37:41.162921+0000","last_unstale":"2023-10-18T19:37:50.496752+0000","last_undegraded":"2023-10-18T19:37:50.496752+0000","last_fullsized":"2023-10-18T19:37:50.496752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495564+0000","last_change":"2023-10-18T19:37:41.160827+0000","last_active":"2023-10-18T19:37:50.495564+0000","last_peered":"2023-10-18T19:37:50.495564+0000","last_clean":"2023-10-18T19:37:50.495564+0000","last_became_active":"2023-10-18T19:37:41.160515+0000","last_became_peered":"2023-10-18T19:37:41.160515+0000","last_unstale":"2023-10-18T19:37:50.495564+0000","last_undegraded":"2023-10-18T19:37:50.495564+0000","last_fullsized":"2023-10-18T19:37:50.495564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304149+0000","last_change":"2023-10-18T19:37:39.150862+0000","last_active":"2023-10-18T19:37:50.304149+0000","last_peered":"2023-10-18T19:37:50.304149+0000","last_clean":"2023-10-18T19:37:50.304149+0000","last_became_active":"2023-10-18T19:37:39.149899+0000","last_became_peered":"2023-10-18T19:37:39.149899+0000","last_unstale":"2023-10-18T19:37:50.304149+0000","last_undegraded":"2023-10-18T19:37:50.304149+0000","last_fullsized":"2023-10-18T19:37:50.304149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222509+0000","last_change":"2023-10-18T19:37:41.172824+0000","last_active":"2023-10-18T19:37:50.222509+0000","last_peered":"2023-10-18T19:37:50.222509+0000","last_clean":"2023-10-18T19:37:50.222509+0000","last_became_active":"2023-10-18T19:37:41.172527+0000","last_became_peered":"2023-10-18T19:37:41.172527+0000","last_unstale":"2023-10-18T19:37:50.222509+0000","last_undegraded":"2023-10-18T19:37:50.222509+0000","last_fullsized":"2023-10-18T19:37:50.222509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494956+0000","last_change":"2023-10-18T19:37:41.165042+0000","last_active":"2023-10-18T19:37:50.494956+0000","last_peered":"2023-10-18T19:37:50.494956+0000","last_clean":"2023-10-18T19:37:50.494956+0000","last_became_active":"2023-10-18T19:37:41.161986+0000","last_became_peered":"2023-10-18T19:37:41.161986+0000","last_unstale":"2023-10-18T19:37:50.494956+0000","last_undegraded":"2023-10-18T19:37:50.494956+0000","last_fullsized":"2023-10-18T19:37:50.494956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494410+0000","last_change":"2023-10-18T19:37:40.152762+0000","last_active":"2023-10-18T19:37:50.494410+0000","last_peered":"2023-10-18T19:37:50.494410+0000","last_clean":"2023-10-18T19:37:50.494410+0000","last_became_active":"2023-10-18T19:37:40.152421+0000","last_became_peered":"2023-10-18T19:37:40.152421+0000","last_unstale":"2023-10-18T19:37:50.494410+0000","last_undegraded":"2023-10-18T19:37:50.494410+0000","last_fullsized":"2023-10-18T19:37:50.494410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496113+0000","last_change":"2023-10-18T19:37:40.173613+0000","last_active":"2023-10-18T19:37:50.496113+0000","last_peered":"2023-10-18T19:37:50.496113+0000","last_clean":"2023-10-18T19:37:50.496113+0000","last_became_active":"2023-10-18T19:37:40.173304+0000","last_became_peered":"2023-10-18T19:37:40.173304+0000","last_unstale":"2023-10-18T19:37:50.496113+0000","last_undegraded":"2023-10-18T19:37:50.496113+0000","last_fullsized":"2023-10-18T19:37:50.496113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223112+0000","last_change":"2023-10-18T19:37:39.159657+0000","last_active":"2023-10-18T19:37:50.223112+0000","last_peered":"2023-10-18T19:37:50.223112+0000","last_clean":"2023-10-18T19:37:50.223112+0000","last_became_active":"2023-10-18T19:37:39.159083+0000","last_became_peered":"2023-10-18T19:37:39.159083+0000","last_unstale":"2023-10-18T19:37:50.223112+0000","last_undegraded":"2023-10-18T19:37:50.223112+0000","last_fullsized":"2023-10-18T19:37:50.223112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223277+0000","last_change":"2023-10-18T19:37:39.159721+0000","last_active":"2023-10-18T19:37:50.223277+0000","last_peered":"2023-10-18T19:37:50.223277+0000","last_clean":"2023-10-18T19:37:50.223277+0000","last_became_active":"2023-10-18T19:37:39.159327+0000","last_became_peered":"2023-10-18T19:37:39.159327+0000","last_unstale":"2023-10-18T19:37:50.223277+0000","last_undegraded":"2023-10-18T19:37:50.223277+0000","last_fullsized":"2023-10-18T19:37:50.223277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496573+0000","last_change":"2023-10-18T19:37:41.164967+0000","last_active":"2023-10-18T19:37:50.496573+0000","last_peered":"2023-10-18T19:37:50.496573+0000","last_clean":"2023-10-18T19:37:50.496573+0000","last_became_active":"2023-10-18T19:37:41.164617+0000","last_became_peered":"2023-10-18T19:37:41.164617+0000","last_unstale":"2023-10-18T19:37:50.496573+0000","last_undegraded":"2023-10-18T19:37:50.496573+0000","last_fullsized":"2023-10-18T19:37:50.496573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222874+0000","last_change":"2023-10-18T19:37:41.173718+0000","last_active":"2023-10-18T19:37:50.222874+0000","last_peered":"2023-10-18T19:37:50.222874+0000","last_clean":"2023-10-18T19:37:50.222874+0000","last_became_active":"2023-10-18T19:37:41.171781+0000","last_became_peered":"2023-10-18T19:37:41.171781+0000","last_unstale":"2023-10-18T19:37:50.222874+0000","last_undegraded":"2023-10-18T19:37:50.222874+0000","last_fullsized":"2023-10-18T19:37:50.222874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304592+0000","last_change":"2023-10-18T19:37:41.169566+0000","last_active":"2023-10-18T19:37:50.304592+0000","last_peered":"2023-10-18T19:37:50.304592+0000","last_clean":"2023-10-18T19:37:50.304592+0000","last_became_active":"2023-10-18T19:37:41.168842+0000","last_became_peered":"2023-10-18T19:37:41.168842+0000","last_unstale":"2023-10-18T19:37:50.304592+0000","last_undegraded":"2023-10-18T19:37:50.304592+0000","last_fullsized":"2023-10-18T19:37:50.304592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496546+0000","last_change":"2023-10-18T19:37:41.170576+0000","last_active":"2023-10-18T19:37:50.496546+0000","last_peered":"2023-10-18T19:37:50.496546+0000","last_clean":"2023-10-18T19:37:50.496546+0000","last_became_active":"2023-10-18T19:37:41.170274+0000","last_became_peered":"2023-10-18T19:37:41.170274+0000","last_unstale":"2023-10-18T19:37:50.496546+0000","last_undegraded":"2023-10-18T19:37:50.496546+0000","last_fullsized":"2023-10-18T19:37:50.496546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497207+0000","last_change":"2023-10-18T19:37:40.182143+0000","last_active":"2023-10-18T19:37:50.497207+0000","last_peered":"2023-10-18T19:37:50.497207+0000","last_clean":"2023-10-18T19:37:50.497207+0000","last_became_active":"2023-10-18T19:37:40.181853+0000","last_became_peered":"2023-10-18T19:37:40.181853+0000","last_unstale":"2023-10-18T19:37:50.497207+0000","last_undegraded":"2023-10-18T19:37:50.497207+0000","last_fullsized":"2023-10-18T19:37:50.497207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495730+0000","last_change":"2023-10-18T19:37:41.170066+0000","last_active":"2023-10-18T19:37:50.495730+0000","last_peered":"2023-10-18T19:37:50.495730+0000","last_clean":"2023-10-18T19:37:50.495730+0000","last_became_active":"2023-10-18T19:37:41.168793+0000","last_became_peered":"2023-10-18T19:37:41.168793+0000","last_unstale":"2023-10-18T19:37:50.495730+0000","last_undegraded":"2023-10-18T19:37:50.495730+0000","last_fullsized":"2023-10-18T19:37:50.495730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496842+0000","last_change":"2023-10-18T19:37:41.163332+0000","last_active":"2023-10-18T19:37:50.496842+0000","last_peered":"2023-10-18T19:37:50.496842+0000","last_clean":"2023-10-18T19:37:50.496842+0000","last_became_active":"2023-10-18T19:37:41.161951+0000","last_became_peered":"2023-10-18T19:37:41.161951+0000","last_unstale":"2023-10-18T19:37:50.496842+0000","last_undegraded":"2023-10-18T19:37:50.496842+0000","last_fullsized":"2023-10-18T19:37:50.496842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496126+0000","last_change":"2023-10-18T19:37:41.163520+0000","last_active":"2023-10-18T19:37:50.496126+0000","last_peered":"2023-10-18T19:37:50.496126+0000","last_clean":"2023-10-18T19:37:50.496126+0000","last_became_active":"2023-10-18T19:37:41.162538+0000","last_became_peered":"2023-10-18T19:37:41.162538+0000","last_unstale":"2023-10-18T19:37:50.496126+0000","last_undegraded":"2023-10-18T19:37:50.496126+0000","last_fullsized":"2023-10-18T19:37:50.496126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304263+0000","last_change":"2023-10-18T19:37:41.168529+0000","last_active":"2023-10-18T19:37:50.304263+0000","last_peered":"2023-10-18T19:37:50.304263+0000","last_clean":"2023-10-18T19:37:50.304263+0000","last_became_active":"2023-10-18T19:37:41.168250+0000","last_became_peered":"2023-10-18T19:37:41.168250+0000","last_unstale":"2023-10-18T19:37:50.304263+0000","last_undegraded":"2023-10-18T19:37:50.304263+0000","last_fullsized":"2023-10-18T19:37:50.304263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494567+0000","last_change":"2023-10-18T19:37:41.174026+0000","last_active":"2023-10-18T19:37:50.494567+0000","last_peered":"2023-10-18T19:37:50.494567+0000","last_clean":"2023-10-18T19:37:50.494567+0000","last_became_active":"2023-10-18T19:37:41.172584+0000","last_became_peered":"2023-10-18T19:37:41.172584+0000","last_unstale":"2023-10-18T19:37:50.494567+0000","last_undegraded":"2023-10-18T19:37:50.494567+0000","last_fullsized":"2023-10-18T19:37:50.494567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303869+0000","last_change":"2023-10-18T19:37:39.152226+0000","last_active":"2023-10-18T19:37:50.303869+0000","last_peered":"2023-10-18T19:37:50.303869+0000","last_clean":"2023-10-18T19:37:50.303869+0000","last_became_active":"2023-10-18T19:37:39.151683+0000","last_became_peered":"2023-10-18T19:37:39.151683+0000","last_unstale":"2023-10-18T19:37:50.303869+0000","last_undegraded":"2023-10-18T19:37:50.303869+0000","last_fullsized":"2023-10-18T19:37:50.303869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495190+0000","last_change":"2023-10-18T19:37:41.161230+0000","last_active":"2023-10-18T19:37:50.495190+0000","last_peered":"2023-10-18T19:37:50.495190+0000","last_clean":"2023-10-18T19:37:50.495190+0000","last_became_active":"2023-10-18T19:37:41.160273+0000","last_became_peered":"2023-10-18T19:37:41.160273+0000","last_unstale":"2023-10-18T19:37:50.495190+0000","last_undegraded":"2023-10-18T19:37:50.495190+0000","last_fullsized":"2023-10-18T19:37:50.495190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222094+0000","last_change":"2023-10-18T19:37:40.173247+0000","last_active":"2023-10-18T19:37:50.222094+0000","last_peered":"2023-10-18T19:37:50.222094+0000","last_clean":"2023-10-18T19:37:50.222094+0000","last_became_active":"2023-10-18T19:37:40.172802+0000","last_became_peered":"2023-10-18T19:37:40.172802+0000","last_unstale":"2023-10-18T19:37:50.222094+0000","last_undegraded":"2023-10-18T19:37:50.222094+0000","last_fullsized":"2023-10-18T19:37:50.222094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494666+0000","last_change":"2023-10-18T19:37:41.173853+0000","last_active":"2023-10-18T19:37:50.494666+0000","last_peered":"2023-10-18T19:37:50.494666+0000","last_clean":"2023-10-18T19:37:50.494666+0000","last_became_active":"2023-10-18T19:37:41.171900+0000","last_became_peered":"2023-10-18T19:37:41.171900+0000","last_unstale":"2023-10-18T19:37:50.494666+0000","last_undegraded":"2023-10-18T19:37:50.494666+0000","last_fullsized":"2023-10-18T19:37:50.494666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497682+0000","last_change":"2023-10-18T19:37:41.180316+0000","last_active":"2023-10-18T19:37:50.497682+0000","last_peered":"2023-10-18T19:37:50.497682+0000","last_clean":"2023-10-18T19:37:50.497682+0000","last_became_active":"2023-10-18T19:37:41.179783+0000","last_became_peered":"2023-10-18T19:37:41.179783+0000","last_unstale":"2023-10-18T19:37:50.497682+0000","last_undegraded":"2023-10-18T19:37:50.497682+0000","last_fullsized":"2023-10-18T19:37:50.497682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495648+0000","last_change":"2023-10-18T19:37:41.168332+0000","last_active":"2023-10-18T19:37:50.495648+0000","last_peered":"2023-10-18T19:37:50.495648+0000","last_clean":"2023-10-18T19:37:50.495648+0000","last_became_active":"2023-10-18T19:37:41.167890+0000","last_became_peered":"2023-10-18T19:37:41.167890+0000","last_unstale":"2023-10-18T19:37:50.495648+0000","last_undegraded":"2023-10-18T19:37:50.495648+0000","last_fullsized":"2023-10-18T19:37:50.495648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304325+0000","last_change":"2023-10-18T19:37:39.151297+0000","last_active":"2023-10-18T19:37:50.304325+0000","last_peered":"2023-10-18T19:37:50.304325+0000","last_clean":"2023-10-18T19:37:50.304325+0000","last_became_active":"2023-10-18T19:37:39.150978+0000","last_became_peered":"2023-10-18T19:37:39.150978+0000","last_unstale":"2023-10-18T19:37:50.304325+0000","last_undegraded":"2023-10-18T19:37:50.304325+0000","last_fullsized":"2023-10-18T19:37:50.304325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223054+0000","last_change":"2023-10-18T19:37:39.147350+0000","last_active":"2023-10-18T19:37:50.223054+0000","last_peered":"2023-10-18T19:37:50.223054+0000","last_clean":"2023-10-18T19:37:50.223054+0000","last_became_active":"2023-10-18T19:37:39.146876+0000","last_became_peered":"2023-10-18T19:37:39.146876+0000","last_unstale":"2023-10-18T19:37:50.223054+0000","last_undegraded":"2023-10-18T19:37:50.223054+0000","last_fullsized":"2023-10-18T19:37:50.223054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496685+0000","last_change":"2023-10-18T19:37:41.164714+0000","last_active":"2023-10-18T19:37:50.496685+0000","last_peered":"2023-10-18T19:37:50.496685+0000","last_clean":"2023-10-18T19:37:50.496685+0000","last_became_active":"2023-10-18T19:37:41.161777+0000","last_became_peered":"2023-10-18T19:37:41.161777+0000","last_unstale":"2023-10-18T19:37:50.496685+0000","last_undegraded":"2023-10-18T19:37:50.496685+0000","last_fullsized":"2023-10-18T19:37:50.496685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497611+0000","last_change":"2023-10-18T19:37:41.184294+0000","last_active":"2023-10-18T19:37:50.497611+0000","last_peered":"2023-10-18T19:37:50.497611+0000","last_clean":"2023-10-18T19:37:50.497611+0000","last_became_active":"2023-10-18T19:37:41.183439+0000","last_became_peered":"2023-10-18T19:37:41.183439+0000","last_unstale":"2023-10-18T19:37:50.497611+0000","last_undegraded":"2023-10-18T19:37:50.497611+0000","last_fullsized":"2023-10-18T19:37:50.497611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303811+0000","last_change":"2023-10-18T19:37:40.166435+0000","last_active":"2023-10-18T19:37:50.303811+0000","last_peered":"2023-10-18T19:37:50.303811+0000","last_clean":"2023-10-18T19:37:50.303811+0000","last_became_active":"2023-10-18T19:37:40.165350+0000","last_became_peered":"2023-10-18T19:37:40.165350+0000","last_unstale":"2023-10-18T19:37:50.303811+0000","last_undegraded":"2023-10-18T19:37:50.303811+0000","last_fullsized":"2023-10-18T19:37:50.303811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494400+0000","last_change":"2023-10-18T19:37:41.174150+0000","last_active":"2023-10-18T19:37:50.494400+0000","last_peered":"2023-10-18T19:37:50.494400+0000","last_clean":"2023-10-18T19:37:50.494400+0000","last_became_active":"2023-10-18T19:37:41.172901+0000","last_became_peered":"2023-10-18T19:37:41.172901+0000","last_unstale":"2023-10-18T19:37:50.494400+0000","last_undegraded":"2023-10-18T19:37:50.494400+0000","last_fullsized":"2023-10-18T19:37:50.494400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222439+0000","last_change":"2023-10-18T19:37:40.173744+0000","last_active":"2023-10-18T19:37:50.222439+0000","last_peered":"2023-10-18T19:37:50.222439+0000","last_clean":"2023-10-18T19:37:50.222439+0000","last_became_active":"2023-10-18T19:37:40.173367+0000","last_became_peered":"2023-10-18T19:37:40.173367+0000","last_unstale":"2023-10-18T19:37:50.222439+0000","last_undegraded":"2023-10-18T19:37:50.222439+0000","last_fullsized":"2023-10-18T19:37:50.222439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222150+0000","last_change":"2023-10-18T19:37:39.143141+0000","last_active":"2023-10-18T19:37:50.222150+0000","last_peered":"2023-10-18T19:37:50.222150+0000","last_clean":"2023-10-18T19:37:50.222150+0000","last_became_active":"2023-10-18T19:37:39.142854+0000","last_became_peered":"2023-10-18T19:37:39.142854+0000","last_unstale":"2023-10-18T19:37:50.222150+0000","last_undegraded":"2023-10-18T19:37:50.222150+0000","last_fullsized":"2023-10-18T19:37:50.222150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494482+0000","last_change":"2023-10-18T19:37:41.165125+0000","last_active":"2023-10-18T19:37:50.494482+0000","last_peered":"2023-10-18T19:37:50.494482+0000","last_clean":"2023-10-18T19:37:50.494482+0000","last_became_active":"2023-10-18T19:37:41.164231+0000","last_became_peered":"2023-10-18T19:37:41.164231+0000","last_unstale":"2023-10-18T19:37:50.494482+0000","last_undegraded":"2023-10-18T19:37:50.494482+0000","last_fullsized":"2023-10-18T19:37:50.494482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303903+0000","last_change":"2023-10-18T19:37:40.156557+0000","last_active":"2023-10-18T19:37:50.303903+0000","last_peered":"2023-10-18T19:37:50.303903+0000","last_clean":"2023-10-18T19:37:50.303903+0000","last_became_active":"2023-10-18T19:37:40.156220+0000","last_became_peered":"2023-10-18T19:37:40.156220+0000","last_unstale":"2023-10-18T19:37:50.303903+0000","last_undegraded":"2023-10-18T19:37:50.303903+0000","last_fullsized":"2023-10-18T19:37:50.303903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303492+0000","last_change":"2023-10-18T19:37:39.150156+0000","last_active":"2023-10-18T19:37:50.303492+0000","last_peered":"2023-10-18T19:37:50.303492+0000","last_clean":"2023-10-18T19:37:50.303492+0000","last_became_active":"2023-10-18T19:37:39.149511+0000","last_became_peered":"2023-10-18T19:37:39.149511+0000","last_unstale":"2023-10-18T19:37:50.303492+0000","last_undegraded":"2023-10-18T19:37:50.303492+0000","last_fullsized":"2023-10-18T19:37:50.303492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495983+0000","last_change":"2023-10-18T19:37:41.162904+0000","last_active":"2023-10-18T19:37:50.495983+0000","last_peered":"2023-10-18T19:37:50.495983+0000","last_clean":"2023-10-18T19:37:50.495983+0000","last_became_active":"2023-10-18T19:37:41.160957+0000","last_became_peered":"2023-10-18T19:37:41.160957+0000","last_unstale":"2023-10-18T19:37:50.495983+0000","last_undegraded":"2023-10-18T19:37:50.495983+0000","last_fullsized":"2023-10-18T19:37:50.495983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495461+0000","last_change":"2023-10-18T19:37:41.161220+0000","last_active":"2023-10-18T19:37:50.495461+0000","last_peered":"2023-10-18T19:37:50.495461+0000","last_clean":"2023-10-18T19:37:50.495461+0000","last_became_active":"2023-10-18T19:37:41.160799+0000","last_became_peered":"2023-10-18T19:37:41.160799+0000","last_unstale":"2023-10-18T19:37:50.495461+0000","last_undegraded":"2023-10-18T19:37:50.495461+0000","last_fullsized":"2023-10-18T19:37:50.495461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494551+0000","last_change":"2023-10-18T19:37:41.183271+0000","last_active":"2023-10-18T19:37:50.494551+0000","last_peered":"2023-10-18T19:37:50.494551+0000","last_clean":"2023-10-18T19:37:50.494551+0000","last_became_active":"2023-10-18T19:37:41.182944+0000","last_became_peered":"2023-10-18T19:37:41.182944+0000","last_unstale":"2023-10-18T19:37:50.494551+0000","last_undegraded":"2023-10-18T19:37:50.494551+0000","last_fullsized":"2023-10-18T19:37:50.494551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495809+0000","last_change":"2023-10-18T19:37:41.174344+0000","last_active":"2023-10-18T19:37:50.495809+0000","last_peered":"2023-10-18T19:37:50.495809+0000","last_clean":"2023-10-18T19:37:50.495809+0000","last_became_active":"2023-10-18T19:37:41.169184+0000","last_became_peered":"2023-10-18T19:37:41.169184+0000","last_unstale":"2023-10-18T19:37:50.495809+0000","last_undegraded":"2023-10-18T19:37:50.495809+0000","last_fullsized":"2023-10-18T19:37:50.495809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222414+0000","last_change":"2023-10-18T19:37:40.179737+0000","last_active":"2023-10-18T19:37:50.222414+0000","last_peered":"2023-10-18T19:37:50.222414+0000","last_clean":"2023-10-18T19:37:50.222414+0000","last_became_active":"2023-10-18T19:37:40.179379+0000","last_became_peered":"2023-10-18T19:37:40.179379+0000","last_unstale":"2023-10-18T19:37:50.222414+0000","last_undegraded":"2023-10-18T19:37:50.222414+0000","last_fullsized":"2023-10-18T19:37:50.222414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496379+0000","last_change":"2023-10-18T19:37:41.167178+0000","last_active":"2023-10-18T19:37:50.496379+0000","last_peered":"2023-10-18T19:37:50.496379+0000","last_clean":"2023-10-18T19:37:50.496379+0000","last_became_active":"2023-10-18T19:37:41.166516+0000","last_became_peered":"2023-10-18T19:37:41.166516+0000","last_unstale":"2023-10-18T19:37:50.496379+0000","last_undegraded":"2023-10-18T19:37:50.496379+0000","last_fullsized":"2023-10-18T19:37:50.496379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496264+0000","last_change":"2023-10-18T19:37:41.162014+0000","last_active":"2023-10-18T19:37:50.496264+0000","last_peered":"2023-10-18T19:37:50.496264+0000","last_clean":"2023-10-18T19:37:50.496264+0000","last_became_active":"2023-10-18T19:37:41.161648+0000","last_became_peered":"2023-10-18T19:37:41.161648+0000","last_unstale":"2023-10-18T19:37:50.496264+0000","last_undegraded":"2023-10-18T19:37:50.496264+0000","last_fullsized":"2023-10-18T19:37:50.496264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303960+0000","last_change":"2023-10-18T19:37:40.155795+0000","last_active":"2023-10-18T19:37:50.303960+0000","last_peered":"2023-10-18T19:37:50.303960+0000","last_clean":"2023-10-18T19:37:50.303960+0000","last_became_active":"2023-10-18T19:37:40.155458+0000","last_became_peered":"2023-10-18T19:37:40.155458+0000","last_unstale":"2023-10-18T19:37:50.303960+0000","last_undegraded":"2023-10-18T19:37:50.303960+0000","last_fullsized":"2023-10-18T19:37:50.303960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304303+0000","last_change":"2023-10-18T19:37:41.167469+0000","last_active":"2023-10-18T19:37:50.304303+0000","last_peered":"2023-10-18T19:37:50.304303+0000","last_clean":"2023-10-18T19:37:50.304303+0000","last_became_active":"2023-10-18T19:37:41.166881+0000","last_became_peered":"2023-10-18T19:37:41.166881+0000","last_unstale":"2023-10-18T19:37:50.304303+0000","last_undegraded":"2023-10-18T19:37:50.304303+0000","last_fullsized":"2023-10-18T19:37:50.304303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303854+0000","last_change":"2023-10-18T19:37:39.153660+0000","last_active":"2023-10-18T19:37:50.303854+0000","last_peered":"2023-10-18T19:37:50.303854+0000","last_clean":"2023-10-18T19:37:50.303854+0000","last_became_active":"2023-10-18T19:37:39.149264+0000","last_became_peered":"2023-10-18T19:37:39.149264+0000","last_unstale":"2023-10-18T19:37:50.303854+0000","last_undegraded":"2023-10-18T19:37:50.303854+0000","last_fullsized":"2023-10-18T19:37:50.303854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495577+0000","last_change":"2023-10-18T19:37:41.157722+0000","last_active":"2023-10-18T19:37:50.495577+0000","last_peered":"2023-10-18T19:37:50.495577+0000","last_clean":"2023-10-18T19:37:50.495577+0000","last_became_active":"2023-10-18T19:37:41.157561+0000","last_became_peered":"2023-10-18T19:37:41.157561+0000","last_unstale":"2023-10-18T19:37:50.495577+0000","last_undegraded":"2023-10-18T19:37:50.495577+0000","last_fullsized":"2023-10-18T19:37:50.495577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496848+0000","last_change":"2023-10-18T19:37:41.165870+0000","last_active":"2023-10-18T19:37:50.496848+0000","last_peered":"2023-10-18T19:37:50.496848+0000","last_clean":"2023-10-18T19:37:50.496848+0000","last_became_active":"2023-10-18T19:37:41.165159+0000","last_became_peered":"2023-10-18T19:37:41.165159+0000","last_unstale":"2023-10-18T19:37:50.496848+0000","last_undegraded":"2023-10-18T19:37:50.496848+0000","last_fullsized":"2023-10-18T19:37:50.496848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223024+0000","last_change":"2023-10-18T19:37:39.149247+0000","last_active":"2023-10-18T19:37:50.223024+0000","last_peered":"2023-10-18T19:37:50.223024+0000","last_clean":"2023-10-18T19:37:50.223024+0000","last_became_active":"2023-10-18T19:37:39.147834+0000","last_became_peered":"2023-10-18T19:37:39.147834+0000","last_unstale":"2023-10-18T19:37:50.223024+0000","last_undegraded":"2023-10-18T19:37:50.223024+0000","last_fullsized":"2023-10-18T19:37:50.223024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304302+0000","last_change":"2023-10-18T19:37:39.154705+0000","last_active":"2023-10-18T19:37:50.304302+0000","last_peered":"2023-10-18T19:37:50.304302+0000","last_clean":"2023-10-18T19:37:50.304302+0000","last_became_active":"2023-10-18T19:37:39.153930+0000","last_became_peered":"2023-10-18T19:37:39.153930+0000","last_unstale":"2023-10-18T19:37:50.304302+0000","last_undegraded":"2023-10-18T19:37:50.304302+0000","last_fullsized":"2023-10-18T19:37:50.304302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222697+0000","last_change":"2023-10-18T19:37:39.144587+0000","last_active":"2023-10-18T19:37:50.222697+0000","last_peered":"2023-10-18T19:37:50.222697+0000","last_clean":"2023-10-18T19:37:50.222697+0000","last_became_active":"2023-10-18T19:37:39.144232+0000","last_became_peered":"2023-10-18T19:37:39.144232+0000","last_unstale":"2023-10-18T19:37:50.222697+0000","last_undegraded":"2023-10-18T19:37:50.222697+0000","last_fullsized":"2023-10-18T19:37:50.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223344+0000","last_change":"2023-10-18T19:37:39.159913+0000","last_active":"2023-10-18T19:37:50.223344+0000","last_peered":"2023-10-18T19:37:50.223344+0000","last_clean":"2023-10-18T19:37:50.223344+0000","last_became_active":"2023-10-18T19:37:39.159446+0000","last_became_peered":"2023-10-18T19:37:39.159446+0000","last_unstale":"2023-10-18T19:37:50.223344+0000","last_undegraded":"2023-10-18T19:37:50.223344+0000","last_fullsized":"2023-10-18T19:37:50.223344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497177+0000","last_change":"2023-10-18T19:37:41.167408+0000","last_active":"2023-10-18T19:37:50.497177+0000","last_peered":"2023-10-18T19:37:50.497177+0000","last_clean":"2023-10-18T19:37:50.497177+0000","last_became_active":"2023-10-18T19:37:41.166881+0000","last_became_peered":"2023-10-18T19:37:41.166881+0000","last_unstale":"2023-10-18T19:37:50.497177+0000","last_undegraded":"2023-10-18T19:37:50.497177+0000","last_fullsized":"2023-10-18T19:37:50.497177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497365+0000","last_change":"2023-10-18T19:37:41.167932+0000","last_active":"2023-10-18T19:37:50.497365+0000","last_peered":"2023-10-18T19:37:50.497365+0000","last_clean":"2023-10-18T19:37:50.497365+0000","last_became_active":"2023-10-18T19:37:41.161270+0000","last_became_peered":"2023-10-18T19:37:41.161270+0000","last_unstale":"2023-10-18T19:37:50.497365+0000","last_undegraded":"2023-10-18T19:37:50.497365+0000","last_fullsized":"2023-10-18T19:37:50.497365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223262+0000","last_change":"2023-10-18T19:37:41.178806+0000","last_active":"2023-10-18T19:37:50.223262+0000","last_peered":"2023-10-18T19:37:50.223262+0000","last_clean":"2023-10-18T19:37:50.223262+0000","last_became_active":"2023-10-18T19:37:41.178163+0000","last_became_peered":"2023-10-18T19:37:41.178163+0000","last_unstale":"2023-10-18T19:37:50.223262+0000","last_undegraded":"2023-10-18T19:37:50.223262+0000","last_fullsized":"2023-10-18T19:37:50.223262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495095+0000","last_change":"2023-10-18T19:37:40.166579+0000","last_active":"2023-10-18T19:37:50.495095+0000","last_peered":"2023-10-18T19:37:50.495095+0000","last_clean":"2023-10-18T19:37:50.495095+0000","last_became_active":"2023-10-18T19:37:40.166226+0000","last_became_peered":"2023-10-18T19:37:40.166226+0000","last_unstale":"2023-10-18T19:37:50.495095+0000","last_undegraded":"2023-10-18T19:37:50.495095+0000","last_fullsized":"2023-10-18T19:37:50.495095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494759+0000","last_change":"2023-10-18T19:37:41.173254+0000","last_active":"2023-10-18T19:37:50.494759+0000","last_peered":"2023-10-18T19:37:50.494759+0000","last_clean":"2023-10-18T19:37:50.494759+0000","last_became_active":"2023-10-18T19:37:41.171043+0000","last_became_peered":"2023-10-18T19:37:41.171043+0000","last_unstale":"2023-10-18T19:37:50.494759+0000","last_undegraded":"2023-10-18T19:37:50.494759+0000","last_fullsized":"2023-10-18T19:37:50.494759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494612+0000","last_change":"2023-10-18T19:37:40.163654+0000","last_active":"2023-10-18T19:37:50.494612+0000","last_peered":"2023-10-18T19:37:50.494612+0000","last_clean":"2023-10-18T19:37:50.494612+0000","last_became_active":"2023-10-18T19:37:40.163372+0000","last_became_peered":"2023-10-18T19:37:40.163372+0000","last_unstale":"2023-10-18T19:37:50.494612+0000","last_undegraded":"2023-10-18T19:37:50.494612+0000","last_fullsized":"2023-10-18T19:37:50.494612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495262+0000","last_change":"2023-10-18T19:37:40.162838+0000","last_active":"2023-10-18T19:37:50.495262+0000","last_peered":"2023-10-18T19:37:50.495262+0000","last_clean":"2023-10-18T19:37:50.495262+0000","last_became_active":"2023-10-18T19:37:40.162533+0000","last_became_peered":"2023-10-18T19:37:40.162533+0000","last_unstale":"2023-10-18T19:37:50.495262+0000","last_undegraded":"2023-10-18T19:37:50.495262+0000","last_fullsized":"2023-10-18T19:37:50.495262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222823+0000","last_change":"2023-10-18T19:37:41.175659+0000","last_active":"2023-10-18T19:37:50.222823+0000","last_peered":"2023-10-18T19:37:50.222823+0000","last_clean":"2023-10-18T19:37:50.222823+0000","last_became_active":"2023-10-18T19:37:41.174767+0000","last_became_peered":"2023-10-18T19:37:41.174767+0000","last_unstale":"2023-10-18T19:37:50.222823+0000","last_undegraded":"2023-10-18T19:37:50.222823+0000","last_fullsized":"2023-10-18T19:37:50.222823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495547+0000","last_change":"2023-10-18T19:37:41.169907+0000","last_active":"2023-10-18T19:37:50.495547+0000","last_peered":"2023-10-18T19:37:50.495547+0000","last_clean":"2023-10-18T19:37:50.495547+0000","last_became_active":"2023-10-18T19:37:41.168450+0000","last_became_peered":"2023-10-18T19:37:41.168450+0000","last_unstale":"2023-10-18T19:37:50.495547+0000","last_undegraded":"2023-10-18T19:37:50.495547+0000","last_fullsized":"2023-10-18T19:37:50.495547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495724+0000","last_change":"2023-10-18T19:37:41.167955+0000","last_active":"2023-10-18T19:37:50.495724+0000","last_peered":"2023-10-18T19:37:50.495724+0000","last_clean":"2023-10-18T19:37:50.495724+0000","last_became_active":"2023-10-18T19:37:41.166135+0000","last_became_peered":"2023-10-18T19:37:41.166135+0000","last_unstale":"2023-10-18T19:37:50.495724+0000","last_undegraded":"2023-10-18T19:37:50.495724+0000","last_fullsized":"2023-10-18T19:37:50.495724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496342+0000","last_change":"2023-10-18T19:37:41.173581+0000","last_active":"2023-10-18T19:37:50.496342+0000","last_peered":"2023-10-18T19:37:50.496342+0000","last_clean":"2023-10-18T19:37:50.496342+0000","last_became_active":"2023-10-18T19:37:41.170243+0000","last_became_peered":"2023-10-18T19:37:41.170243+0000","last_unstale":"2023-10-18T19:37:50.496342+0000","last_undegraded":"2023-10-18T19:37:50.496342+0000","last_fullsized":"2023-10-18T19:37:50.496342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304656+0000","last_change":"2023-10-18T19:37:41.169756+0000","last_active":"2023-10-18T19:37:50.304656+0000","last_peered":"2023-10-18T19:37:50.304656+0000","last_clean":"2023-10-18T19:37:50.304656+0000","last_became_active":"2023-10-18T19:37:41.169220+0000","last_became_peered":"2023-10-18T19:37:41.169220+0000","last_unstale":"2023-10-18T19:37:50.304656+0000","last_undegraded":"2023-10-18T19:37:50.304656+0000","last_fullsized":"2023-10-18T19:37:50.304656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304497+0000","last_change":"2023-10-18T19:37:39.155004+0000","last_active":"2023-10-18T19:37:50.304497+0000","last_peered":"2023-10-18T19:37:50.304497+0000","last_clean":"2023-10-18T19:37:50.304497+0000","last_became_active":"2023-10-18T19:37:39.154322+0000","last_became_peered":"2023-10-18T19:37:39.154322+0000","last_unstale":"2023-10-18T19:37:50.304497+0000","last_undegraded":"2023-10-18T19:37:50.304497+0000","last_fullsized":"2023-10-18T19:37:50.304497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496164+0000","last_change":"2023-10-18T19:37:41.163332+0000","last_active":"2023-10-18T19:37:50.496164+0000","last_peered":"2023-10-18T19:37:50.496164+0000","last_clean":"2023-10-18T19:37:50.496164+0000","last_became_active":"2023-10-18T19:37:41.162656+0000","last_became_peered":"2023-10-18T19:37:41.162656+0000","last_unstale":"2023-10-18T19:37:50.496164+0000","last_undegraded":"2023-10-18T19:37:50.496164+0000","last_fullsized":"2023-10-18T19:37:50.496164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495755+0000","last_change":"2023-10-18T19:37:40.182220+0000","last_active":"2023-10-18T19:37:50.495755+0000","last_peered":"2023-10-18T19:37:50.495755+0000","last_clean":"2023-10-18T19:37:50.495755+0000","last_became_active":"2023-10-18T19:37:40.181852+0000","last_became_peered":"2023-10-18T19:37:40.181852+0000","last_unstale":"2023-10-18T19:37:50.495755+0000","last_undegraded":"2023-10-18T19:37:50.495755+0000","last_fullsized":"2023-10-18T19:37:50.495755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497627+0000","last_change":"2023-10-18T19:37:41.180058+0000","last_active":"2023-10-18T19:37:50.497627+0000","last_peered":"2023-10-18T19:37:50.497627+0000","last_clean":"2023-10-18T19:37:50.497627+0000","last_became_active":"2023-10-18T19:37:41.179445+0000","last_became_peered":"2023-10-18T19:37:41.179445+0000","last_unstale":"2023-10-18T19:37:50.497627+0000","last_undegraded":"2023-10-18T19:37:50.497627+0000","last_fullsized":"2023-10-18T19:37:50.497627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223279+0000","last_change":"2023-10-18T19:37:41.181600+0000","last_active":"2023-10-18T19:37:50.223279+0000","last_peered":"2023-10-18T19:37:50.223279+0000","last_clean":"2023-10-18T19:37:50.223279+0000","last_became_active":"2023-10-18T19:37:41.180925+0000","last_became_peered":"2023-10-18T19:37:41.180925+0000","last_unstale":"2023-10-18T19:37:50.223279+0000","last_undegraded":"2023-10-18T19:37:50.223279+0000","last_fullsized":"2023-10-18T19:37:50.223279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496395+0000","last_change":"2023-10-18T19:37:41.164342+0000","last_active":"2023-10-18T19:37:50.496395+0000","last_peered":"2023-10-18T19:37:50.496395+0000","last_clean":"2023-10-18T19:37:50.496395+0000","last_became_active":"2023-10-18T19:37:41.164048+0000","last_became_peered":"2023-10-18T19:37:41.164048+0000","last_unstale":"2023-10-18T19:37:50.496395+0000","last_undegraded":"2023-10-18T19:37:50.496395+0000","last_fullsized":"2023-10-18T19:37:50.496395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497818+0000","last_change":"2023-10-18T19:37:41.180100+0000","last_active":"2023-10-18T19:37:50.497818+0000","last_peered":"2023-10-18T19:37:50.497818+0000","last_clean":"2023-10-18T19:37:50.497818+0000","last_became_active":"2023-10-18T19:37:41.179653+0000","last_became_peered":"2023-10-18T19:37:41.179653+0000","last_unstale":"2023-10-18T19:37:50.497818+0000","last_undegraded":"2023-10-18T19:37:50.497818+0000","last_fullsized":"2023-10-18T19:37:50.497818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494836+0000","last_change":"2023-10-18T19:37:41.163544+0000","last_active":"2023-10-18T19:37:50.494836+0000","last_peered":"2023-10-18T19:37:50.494836+0000","last_clean":"2023-10-18T19:37:50.494836+0000","last_became_active":"2023-10-18T19:37:41.163136+0000","last_became_peered":"2023-10-18T19:37:41.163136+0000","last_unstale":"2023-10-18T19:37:50.494836+0000","last_undegraded":"2023-10-18T19:37:50.494836+0000","last_fullsized":"2023-10-18T19:37:50.494836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494929+0000","last_change":"2023-10-18T19:37:41.174321+0000","last_active":"2023-10-18T19:37:50.494929+0000","last_peered":"2023-10-18T19:37:50.494929+0000","last_clean":"2023-10-18T19:37:50.494929+0000","last_became_active":"2023-10-18T19:37:41.173008+0000","last_became_peered":"2023-10-18T19:37:41.173008+0000","last_unstale":"2023-10-18T19:37:50.494929+0000","last_undegraded":"2023-10-18T19:37:50.494929+0000","last_fullsized":"2023-10-18T19:37:50.494929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495387+0000","last_change":"2023-10-18T19:37:41.159495+0000","last_active":"2023-10-18T19:37:50.495387+0000","last_peered":"2023-10-18T19:37:50.495387+0000","last_clean":"2023-10-18T19:37:50.495387+0000","last_became_active":"2023-10-18T19:37:41.159127+0000","last_became_peered":"2023-10-18T19:37:41.159127+0000","last_unstale":"2023-10-18T19:37:50.495387+0000","last_undegraded":"2023-10-18T19:37:50.495387+0000","last_fullsized":"2023-10-18T19:37:50.495387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303765+0000","last_change":"2023-10-18T19:37:41.169563+0000","last_active":"2023-10-18T19:37:50.303765+0000","last_peered":"2023-10-18T19:37:50.303765+0000","last_clean":"2023-10-18T19:37:50.303765+0000","last_became_active":"2023-10-18T19:37:41.169031+0000","last_became_peered":"2023-10-18T19:37:41.169031+0000","last_unstale":"2023-10-18T19:37:50.303765+0000","last_undegraded":"2023-10-18T19:37:50.303765+0000","last_fullsized":"2023-10-18T19:37:50.303765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222621+0000","last_change":"2023-10-18T19:37:40.179076+0000","last_active":"2023-10-18T19:37:50.222621+0000","last_peered":"2023-10-18T19:37:50.222621+0000","last_clean":"2023-10-18T19:37:50.222621+0000","last_became_active":"2023-10-18T19:37:40.172767+0000","last_became_peered":"2023-10-18T19:37:40.172767+0000","last_unstale":"2023-10-18T19:37:50.222621+0000","last_undegraded":"2023-10-18T19:37:50.222621+0000","last_fullsized":"2023-10-18T19:37:50.222621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303714+0000","last_change":"2023-10-18T19:37:39.150062+0000","last_active":"2023-10-18T19:37:50.303714+0000","last_peered":"2023-10-18T19:37:50.303714+0000","last_clean":"2023-10-18T19:37:50.303714+0000","last_became_active":"2023-10-18T19:37:39.148976+0000","last_became_peered":"2023-10-18T19:37:39.148976+0000","last_unstale":"2023-10-18T19:37:50.303714+0000","last_undegraded":"2023-10-18T19:37:50.303714+0000","last_fullsized":"2023-10-18T19:37:50.303714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304027+0000","last_change":"2023-10-18T19:37:39.156186+0000","last_active":"2023-10-18T19:37:50.304027+0000","last_peered":"2023-10-18T19:37:50.304027+0000","last_clean":"2023-10-18T19:37:50.304027+0000","last_became_active":"2023-10-18T19:37:39.155568+0000","last_became_peered":"2023-10-18T19:37:39.155568+0000","last_unstale":"2023-10-18T19:37:50.304027+0000","last_undegraded":"2023-10-18T19:37:50.304027+0000","last_fullsized":"2023-10-18T19:37:50.304027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496805+0000","last_change":"2023-10-18T19:37:41.168831+0000","last_active":"2023-10-18T19:37:50.496805+0000","last_peered":"2023-10-18T19:37:50.496805+0000","last_clean":"2023-10-18T19:37:50.496805+0000","last_became_active":"2023-10-18T19:37:41.165471+0000","last_became_peered":"2023-10-18T19:37:41.165471+0000","last_unstale":"2023-10-18T19:37:50.496805+0000","last_undegraded":"2023-10-18T19:37:50.496805+0000","last_fullsized":"2023-10-18T19:37:50.496805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496632+0000","last_change":"2023-10-18T19:37:41.165501+0000","last_active":"2023-10-18T19:37:50.496632+0000","last_peered":"2023-10-18T19:37:50.496632+0000","last_clean":"2023-10-18T19:37:50.496632+0000","last_became_active":"2023-10-18T19:37:41.162971+0000","last_became_peered":"2023-10-18T19:37:41.162971+0000","last_unstale":"2023-10-18T19:37:50.496632+0000","last_undegraded":"2023-10-18T19:37:50.496632+0000","last_fullsized":"2023-10-18T19:37:50.496632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497019+0000","last_change":"2023-10-18T19:37:40.182170+0000","last_active":"2023-10-18T19:37:50.497019+0000","last_peered":"2023-10-18T19:37:50.497019+0000","last_clean":"2023-10-18T19:37:50.497019+0000","last_became_active":"2023-10-18T19:37:40.181862+0000","last_became_peered":"2023-10-18T19:37:40.181862+0000","last_unstale":"2023-10-18T19:37:50.497019+0000","last_undegraded":"2023-10-18T19:37:50.497019+0000","last_fullsized":"2023-10-18T19:37:50.497019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222989+0000","last_change":"2023-10-18T19:37:39.149600+0000","last_active":"2023-10-18T19:37:50.222989+0000","last_peered":"2023-10-18T19:37:50.222989+0000","last_clean":"2023-10-18T19:37:50.222989+0000","last_became_active":"2023-10-18T19:37:39.148179+0000","last_became_peered":"2023-10-18T19:37:39.148179+0000","last_unstale":"2023-10-18T19:37:50.222989+0000","last_undegraded":"2023-10-18T19:37:50.222989+0000","last_fullsized":"2023-10-18T19:37:50.222989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496945+0000","last_change":"2023-10-18T19:37:41.166036+0000","last_active":"2023-10-18T19:37:50.496945+0000","last_peered":"2023-10-18T19:37:50.496945+0000","last_clean":"2023-10-18T19:37:50.496945+0000","last_became_active":"2023-10-18T19:37:41.163393+0000","last_became_peered":"2023-10-18T19:37:41.163393+0000","last_unstale":"2023-10-18T19:37:50.496945+0000","last_undegraded":"2023-10-18T19:37:50.496945+0000","last_fullsized":"2023-10-18T19:37:50.496945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497835+0000","last_change":"2023-10-18T19:37:41.184293+0000","last_active":"2023-10-18T19:37:50.497835+0000","last_peered":"2023-10-18T19:37:50.497835+0000","last_clean":"2023-10-18T19:37:50.497835+0000","last_became_active":"2023-10-18T19:37:41.183766+0000","last_became_peered":"2023-10-18T19:37:41.183766+0000","last_unstale":"2023-10-18T19:37:50.497835+0000","last_undegraded":"2023-10-18T19:37:50.497835+0000","last_fullsized":"2023-10-18T19:37:50.497835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304388+0000","last_change":"2023-10-18T19:37:41.167186+0000","last_active":"2023-10-18T19:37:50.304388+0000","last_peered":"2023-10-18T19:37:50.304388+0000","last_clean":"2023-10-18T19:37:50.304388+0000","last_became_active":"2023-10-18T19:37:41.166566+0000","last_became_peered":"2023-10-18T19:37:41.166566+0000","last_unstale":"2023-10-18T19:37:50.304388+0000","last_undegraded":"2023-10-18T19:37:50.304388+0000","last_fullsized":"2023-10-18T19:37:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496205+0000","last_change":"2023-10-18T19:37:41.163752+0000","last_active":"2023-10-18T19:37:50.496205+0000","last_peered":"2023-10-18T19:37:50.496205+0000","last_clean":"2023-10-18T19:37:50.496205+0000","last_became_active":"2023-10-18T19:37:41.163120+0000","last_became_peered":"2023-10-18T19:37:41.163120+0000","last_unstale":"2023-10-18T19:37:50.496205+0000","last_undegraded":"2023-10-18T19:37:50.496205+0000","last_fullsized":"2023-10-18T19:37:50.496205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497087+0000","last_change":"2023-10-18T19:37:41.183832+0000","last_active":"2023-10-18T19:37:50.497087+0000","last_peered":"2023-10-18T19:37:50.497087+0000","last_clean":"2023-10-18T19:37:50.497087+0000","last_became_active":"2023-10-18T19:37:41.182965+0000","last_became_peered":"2023-10-18T19:37:41.182965+0000","last_unstale":"2023-10-18T19:37:50.497087+0000","last_undegraded":"2023-10-18T19:37:50.497087+0000","last_fullsized":"2023-10-18T19:37:50.497087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303640+0000","last_change":"2023-10-18T19:37:39.152006+0000","last_active":"2023-10-18T19:37:50.303640+0000","last_peered":"2023-10-18T19:37:50.303640+0000","last_clean":"2023-10-18T19:37:50.303640+0000","last_became_active":"2023-10-18T19:37:39.151325+0000","last_became_peered":"2023-10-18T19:37:39.151325+0000","last_unstale":"2023-10-18T19:37:50.303640+0000","last_undegraded":"2023-10-18T19:37:50.303640+0000","last_fullsized":"2023-10-18T19:37:50.303640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.221982+0000","last_change":"2023-10-18T19:37:39.146819+0000","last_active":"2023-10-18T19:37:50.221982+0000","last_peered":"2023-10-18T19:37:50.221982+0000","last_clean":"2023-10-18T19:37:50.221982+0000","last_became_active":"2023-10-18T19:37:39.146123+0000","last_became_peered":"2023-10-18T19:37:39.146123+0000","last_unstale":"2023-10-18T19:37:50.221982+0000","last_undegraded":"2023-10-18T19:37:50.221982+0000","last_fullsized":"2023-10-18T19:37:50.221982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494814+0000","last_change":"2023-10-18T19:37:41.160594+0000","last_active":"2023-10-18T19:37:50.494814+0000","last_peered":"2023-10-18T19:37:50.494814+0000","last_clean":"2023-10-18T19:37:50.494814+0000","last_became_active":"2023-10-18T19:37:41.159675+0000","last_became_peered":"2023-10-18T19:37:41.159675+0000","last_unstale":"2023-10-18T19:37:50.494814+0000","last_undegraded":"2023-10-18T19:37:50.494814+0000","last_fullsized":"2023-10-18T19:37:50.494814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222140+0000","last_change":"2023-10-18T19:37:39.143701+0000","last_active":"2023-10-18T19:37:50.222140+0000","last_peered":"2023-10-18T19:37:50.222140+0000","last_clean":"2023-10-18T19:37:50.222140+0000","last_became_active":"2023-10-18T19:37:39.143358+0000","last_became_peered":"2023-10-18T19:37:39.143358+0000","last_unstale":"2023-10-18T19:37:50.222140+0000","last_undegraded":"2023-10-18T19:37:50.222140+0000","last_fullsized":"2023-10-18T19:37:50.222140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495974+0000","last_change":"2023-10-18T19:37:41.163139+0000","last_active":"2023-10-18T19:37:50.495974+0000","last_peered":"2023-10-18T19:37:50.495974+0000","last_clean":"2023-10-18T19:37:50.495974+0000","last_became_active":"2023-10-18T19:37:41.161539+0000","last_became_peered":"2023-10-18T19:37:41.161539+0000","last_unstale":"2023-10-18T19:37:50.495974+0000","last_undegraded":"2023-10-18T19:37:50.495974+0000","last_fullsized":"2023-10-18T19:37:50.495974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495057+0000","last_change":"2023-10-18T19:37:41.165875+0000","last_active":"2023-10-18T19:37:50.495057+0000","last_peered":"2023-10-18T19:37:50.495057+0000","last_clean":"2023-10-18T19:37:50.495057+0000","last_became_active":"2023-10-18T19:37:41.165604+0000","last_became_peered":"2023-10-18T19:37:41.165604+0000","last_unstale":"2023-10-18T19:37:50.495057+0000","last_undegraded":"2023-10-18T19:37:50.495057+0000","last_fullsized":"2023-10-18T19:37:50.495057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222491+0000","last_change":"2023-10-18T19:37:39.147907+0000","last_active":"2023-10-18T19:37:50.222491+0000","last_peered":"2023-10-18T19:37:50.222491+0000","last_clean":"2023-10-18T19:37:50.222491+0000","last_became_active":"2023-10-18T19:37:39.146960+0000","last_became_peered":"2023-10-18T19:37:39.146960+0000","last_unstale":"2023-10-18T19:37:50.222491+0000","last_undegraded":"2023-10-18T19:37:50.222491+0000","last_fullsized":"2023-10-18T19:37:50.222491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304237+0000","last_change":"2023-10-18T19:37:40.160110+0000","last_active":"2023-10-18T19:37:50.304237+0000","last_peered":"2023-10-18T19:37:50.304237+0000","last_clean":"2023-10-18T19:37:50.304237+0000","last_became_active":"2023-10-18T19:37:40.157972+0000","last_became_peered":"2023-10-18T19:37:40.157972+0000","last_unstale":"2023-10-18T19:37:50.304237+0000","last_undegraded":"2023-10-18T19:37:50.304237+0000","last_fullsized":"2023-10-18T19:37:50.304237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222869+0000","last_change":"2023-10-18T19:37:41.173368+0000","last_active":"2023-10-18T19:37:50.222869+0000","last_peered":"2023-10-18T19:37:50.222869+0000","last_clean":"2023-10-18T19:37:50.222869+0000","last_became_active":"2023-10-18T19:37:41.172145+0000","last_became_peered":"2023-10-18T19:37:41.172145+0000","last_unstale":"2023-10-18T19:37:50.222869+0000","last_undegraded":"2023-10-18T19:37:50.222869+0000","last_fullsized":"2023-10-18T19:37:50.222869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496409+0000","last_change":"2023-10-18T19:37:41.163519+0000","last_active":"2023-10-18T19:37:50.496409+0000","last_peered":"2023-10-18T19:37:50.496409+0000","last_clean":"2023-10-18T19:37:50.496409+0000","last_became_active":"2023-10-18T19:37:41.162988+0000","last_became_peered":"2023-10-18T19:37:41.162988+0000","last_unstale":"2023-10-18T19:37:50.496409+0000","last_undegraded":"2023-10-18T19:37:50.496409+0000","last_fullsized":"2023-10-18T19:37:50.496409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222891+0000","last_change":"2023-10-18T19:37:39.149688+0000","last_active":"2023-10-18T19:37:50.222891+0000","last_peered":"2023-10-18T19:37:50.222891+0000","last_clean":"2023-10-18T19:37:50.222891+0000","last_became_active":"2023-10-18T19:37:39.148924+0000","last_became_peered":"2023-10-18T19:37:39.148924+0000","last_unstale":"2023-10-18T19:37:50.222891+0000","last_undegraded":"2023-10-18T19:37:50.222891+0000","last_fullsized":"2023-10-18T19:37:50.222891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304650+0000","last_change":"2023-10-18T19:37:41.169895+0000","last_active":"2023-10-18T19:37:50.304650+0000","last_peered":"2023-10-18T19:37:50.304650+0000","last_clean":"2023-10-18T19:37:50.304650+0000","last_became_active":"2023-10-18T19:37:41.169278+0000","last_became_peered":"2023-10-18T19:37:41.169278+0000","last_unstale":"2023-10-18T19:37:50.304650+0000","last_undegraded":"2023-10-18T19:37:50.304650+0000","last_fullsized":"2023-10-18T19:37:50.304650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304574+0000","last_change":"2023-10-18T19:37:41.167675+0000","last_active":"2023-10-18T19:37:50.304574+0000","last_peered":"2023-10-18T19:37:50.304574+0000","last_clean":"2023-10-18T19:37:50.304574+0000","last_became_active":"2023-10-18T19:37:41.167180+0000","last_became_peered":"2023-10-18T19:37:41.167180+0000","last_unstale":"2023-10-18T19:37:50.304574+0000","last_undegraded":"2023-10-18T19:37:50.304574+0000","last_fullsized":"2023-10-18T19:37:50.304574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304542+0000","last_change":"2023-10-18T19:37:41.167593+0000","last_active":"2023-10-18T19:37:50.304542+0000","last_peered":"2023-10-18T19:37:50.304542+0000","last_clean":"2023-10-18T19:37:50.304542+0000","last_became_active":"2023-10-18T19:37:41.166890+0000","last_became_peered":"2023-10-18T19:37:41.166890+0000","last_unstale":"2023-10-18T19:37:50.304542+0000","last_undegraded":"2023-10-18T19:37:50.304542+0000","last_fullsized":"2023-10-18T19:37:50.304542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223193+0000","last_change":"2023-10-18T19:37:40.173415+0000","last_active":"2023-10-18T19:37:50.223193+0000","last_peered":"2023-10-18T19:37:50.223193+0000","last_clean":"2023-10-18T19:37:50.223193+0000","last_became_active":"2023-10-18T19:37:40.172948+0000","last_became_peered":"2023-10-18T19:37:40.172948+0000","last_unstale":"2023-10-18T19:37:50.223193+0000","last_undegraded":"2023-10-18T19:37:50.223193+0000","last_fullsized":"2023-10-18T19:37:50.223193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223132+0000","last_change":"2023-10-18T19:37:40.177295+0000","last_active":"2023-10-18T19:37:50.223132+0000","last_peered":"2023-10-18T19:37:50.223132+0000","last_clean":"2023-10-18T19:37:50.223132+0000","last_became_active":"2023-10-18T19:37:40.176692+0000","last_became_peered":"2023-10-18T19:37:40.176692+0000","last_unstale":"2023-10-18T19:37:50.223132+0000","last_undegraded":"2023-10-18T19:37:50.223132+0000","last_fullsized":"2023-10-18T19:37:50.223132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222047+0000","last_change":"2023-10-18T19:37:39.143430+0000","last_active":"2023-10-18T19:37:50.222047+0000","last_peered":"2023-10-18T19:37:50.222047+0000","last_clean":"2023-10-18T19:37:50.222047+0000","last_became_active":"2023-10-18T19:37:39.143020+0000","last_became_peered":"2023-10-18T19:37:39.143020+0000","last_unstale":"2023-10-18T19:37:50.222047+0000","last_undegraded":"2023-10-18T19:37:50.222047+0000","last_fullsized":"2023-10-18T19:37:50.222047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222253+0000","last_change":"2023-10-18T19:37:39.148097+0000","last_active":"2023-10-18T19:37:50.222253+0000","last_peered":"2023-10-18T19:37:50.222253+0000","last_clean":"2023-10-18T19:37:50.222253+0000","last_became_active":"2023-10-18T19:37:39.146463+0000","last_became_peered":"2023-10-18T19:37:39.146463+0000","last_unstale":"2023-10-18T19:37:50.222253+0000","last_undegraded":"2023-10-18T19:37:50.222253+0000","last_fullsized":"2023-10-18T19:37:50.222253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495042+0000","last_change":"2023-10-18T19:37:41.165027+0000","last_active":"2023-10-18T19:37:50.495042+0000","last_peered":"2023-10-18T19:37:50.495042+0000","last_clean":"2023-10-18T19:37:50.495042+0000","last_became_active":"2023-10-18T19:37:41.164753+0000","last_became_peered":"2023-10-18T19:37:41.164753+0000","last_unstale":"2023-10-18T19:37:50.495042+0000","last_undegraded":"2023-10-18T19:37:50.495042+0000","last_fullsized":"2023-10-18T19:37:50.495042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303890+0000","last_change":"2023-10-18T19:37:40.156608+0000","last_active":"2023-10-18T19:37:50.303890+0000","last_peered":"2023-10-18T19:37:50.303890+0000","last_clean":"2023-10-18T19:37:50.303890+0000","last_became_active":"2023-10-18T19:37:40.156273+0000","last_became_peered":"2023-10-18T19:37:40.156273+0000","last_unstale":"2023-10-18T19:37:50.303890+0000","last_undegraded":"2023-10-18T19:37:50.303890+0000","last_fullsized":"2023-10-18T19:37:50.303890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222227+0000","last_change":"2023-10-18T19:37:40.176646+0000","last_active":"2023-10-18T19:37:50.222227+0000","last_peered":"2023-10-18T19:37:50.222227+0000","last_clean":"2023-10-18T19:37:50.222227+0000","last_became_active":"2023-10-18T19:37:40.172763+0000","last_became_peered":"2023-10-18T19:37:40.172763+0000","last_unstale":"2023-10-18T19:37:50.222227+0000","last_undegraded":"2023-10-18T19:37:50.222227+0000","last_fullsized":"2023-10-18T19:37:50.222227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494952+0000","last_change":"2023-10-18T19:37:41.165840+0000","last_active":"2023-10-18T19:37:50.494952+0000","last_peered":"2023-10-18T19:37:50.494952+0000","last_clean":"2023-10-18T19:37:50.494952+0000","last_became_active":"2023-10-18T19:37:41.163803+0000","last_became_peered":"2023-10-18T19:37:41.163803+0000","last_unstale":"2023-10-18T19:37:50.494952+0000","last_undegraded":"2023-10-18T19:37:50.494952+0000","last_fullsized":"2023-10-18T19:37:50.494952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495184+0000","last_change":"2023-10-18T19:37:40.173589+0000","last_active":"2023-10-18T19:37:50.495184+0000","last_peered":"2023-10-18T19:37:50.495184+0000","last_clean":"2023-10-18T19:37:50.495184+0000","last_became_active":"2023-10-18T19:37:40.173206+0000","last_became_peered":"2023-10-18T19:37:40.173206+0000","last_unstale":"2023-10-18T19:37:50.495184+0000","last_undegraded":"2023-10-18T19:37:50.495184+0000","last_fullsized":"2023-10-18T19:37:50.495184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222658+0000","last_change":"2023-10-18T19:37:39.149127+0000","last_active":"2023-10-18T19:37:50.222658+0000","last_peered":"2023-10-18T19:37:50.222658+0000","last_clean":"2023-10-18T19:37:50.222658+0000","last_became_active":"2023-10-18T19:37:39.147872+0000","last_became_peered":"2023-10-18T19:37:39.147872+0000","last_unstale":"2023-10-18T19:37:50.222658+0000","last_undegraded":"2023-10-18T19:37:50.222658+0000","last_fullsized":"2023-10-18T19:37:50.222658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222725+0000","last_change":"2023-10-18T19:37:40.176947+0000","last_active":"2023-10-18T19:37:50.222725+0000","last_peered":"2023-10-18T19:37:50.222725+0000","last_clean":"2023-10-18T19:37:50.222725+0000","last_became_active":"2023-10-18T19:37:40.174092+0000","last_became_peered":"2023-10-18T19:37:40.174092+0000","last_unstale":"2023-10-18T19:37:50.222725+0000","last_undegraded":"2023-10-18T19:37:50.222725+0000","last_fullsized":"2023-10-18T19:37:50.222725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222683+0000","last_change":"2023-10-18T19:37:39.149495+0000","last_active":"2023-10-18T19:37:50.222683+0000","last_peered":"2023-10-18T19:37:50.222683+0000","last_clean":"2023-10-18T19:37:50.222683+0000","last_became_active":"2023-10-18T19:37:39.146736+0000","last_became_peered":"2023-10-18T19:37:39.146736+0000","last_unstale":"2023-10-18T19:37:50.222683+0000","last_undegraded":"2023-10-18T19:37:50.222683+0000","last_fullsized":"2023-10-18T19:37:50.222683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497127+0000","last_change":"2023-10-18T19:37:41.164895+0000","last_active":"2023-10-18T19:37:50.497127+0000","last_peered":"2023-10-18T19:37:50.497127+0000","last_clean":"2023-10-18T19:37:50.497127+0000","last_became_active":"2023-10-18T19:37:41.164433+0000","last_became_peered":"2023-10-18T19:37:41.164433+0000","last_unstale":"2023-10-18T19:37:50.497127+0000","last_undegraded":"2023-10-18T19:37:50.497127+0000","last_fullsized":"2023-10-18T19:37:50.497127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304571+0000","last_change":"2023-10-18T19:37:39.155328+0000","last_active":"2023-10-18T19:37:50.304571+0000","last_peered":"2023-10-18T19:37:50.304571+0000","last_clean":"2023-10-18T19:37:50.304571+0000","last_became_active":"2023-10-18T19:37:39.154893+0000","last_became_peered":"2023-10-18T19:37:39.154893+0000","last_unstale":"2023-10-18T19:37:50.304571+0000","last_undegraded":"2023-10-18T19:37:50.304571+0000","last_fullsized":"2023-10-18T19:37:50.304571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223223+0000","last_change":"2023-10-18T19:37:41.176991+0000","last_active":"2023-10-18T19:37:50.223223+0000","last_peered":"2023-10-18T19:37:50.223223+0000","last_clean":"2023-10-18T19:37:50.223223+0000","last_became_active":"2023-10-18T19:37:41.176688+0000","last_became_peered":"2023-10-18T19:37:41.176688+0000","last_unstale":"2023-10-18T19:37:50.223223+0000","last_undegraded":"2023-10-18T19:37:50.223223+0000","last_fullsized":"2023-10-18T19:37:50.223223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223013+0000","last_change":"2023-10-18T19:37:41.176028+0000","last_active":"2023-10-18T19:37:50.223013+0000","last_peered":"2023-10-18T19:37:50.223013+0000","last_clean":"2023-10-18T19:37:50.223013+0000","last_became_active":"2023-10-18T19:37:41.175640+0000","last_became_peered":"2023-10-18T19:37:41.175640+0000","last_unstale":"2023-10-18T19:37:50.223013+0000","last_undegraded":"2023-10-18T19:37:50.223013+0000","last_fullsized":"2023-10-18T19:37:50.223013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304502+0000","last_change":"2023-10-18T19:37:39.154845+0000","last_active":"2023-10-18T19:37:50.304502+0000","last_peered":"2023-10-18T19:37:50.304502+0000","last_clean":"2023-10-18T19:37:50.304502+0000","last_became_active":"2023-10-18T19:37:39.153794+0000","last_became_peered":"2023-10-18T19:37:39.153794+0000","last_unstale":"2023-10-18T19:37:50.304502+0000","last_undegraded":"2023-10-18T19:37:50.304502+0000","last_fullsized":"2023-10-18T19:37:50.304502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304776+0000","last_change":"2023-10-18T19:37:39.154257+0000","last_active":"2023-10-18T19:37:50.304776+0000","last_peered":"2023-10-18T19:37:50.304776+0000","last_clean":"2023-10-18T19:37:50.304776+0000","last_became_active":"2023-10-18T19:37:39.153936+0000","last_became_peered":"2023-10-18T19:37:39.153936+0000","last_unstale":"2023-10-18T19:37:50.304776+0000","last_undegraded":"2023-10-18T19:37:50.304776+0000","last_fullsized":"2023-10-18T19:37:50.304776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":30,"seq":128849018885,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297516,"kb_used_data":356,"kb_used_omap":14,"kb_used_meta":297137,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":364544,"data_stored":152412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15130,"internal_metadata":304268518},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297500,"kb_used_data":340,"kb_used_omap":8,"kb_used_meta":297143,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":348160,"data_stored":145644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8264,"internal_metadata":304275384},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":27,"seq":115964116997,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297504,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297152,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":352256,"data_stored":147400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304283648},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":1,"up_from":28,"seq":120259084293,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297496,"kb_used_data":336,"kb_used_omap":13,"kb_used_meta":297138,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":344064,"data_stored":141856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13606,"internal_metadata":304270042},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:56.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T19:37:57.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.053+0000 7f3bb79ff700 1 Processor -- start 2023-10-18T19:37:57.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.053+0000 7f3bb79ff700 1 -- start start 2023-10-18T19:37:57.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.054+0000 7f3bb79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 0x7f3bb0135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.054+0000 7f3bb79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 0x7f3bb0136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.054+0000 7f3bb79ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00afd50 con 0x7f3bb00a1790 2023-10-18T19:37:57.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.054+0000 7f3bb79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00a47a0 con 0x7f3bb00a4c50 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.054+0000 7f3bb79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00a3a10 con 0x7f3bb00af970 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb4f9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3bb00a1790 0x7f3bb013bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33386/0 (socket says 172.21.15.88:33386) 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb5f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 0x7f3bb0136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb4f9a700 1 -- 172.21.15.88:0/1321508908 learned_addr learned my addr 172.21.15.88:0/1321508908 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 0x7f3bb0135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3ba7fff700 1 -- 172.21.15.88:0/1321508908 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707337960 0 0) 0x7f3bb00afd50 con 0x7f3bb00a1790 2023-10-18T19:37:57.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3ba7fff700 1 -- 172.21.15.88:0/1321508908 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b9c0033f0 con 0x7f3bb00a1790 2023-10-18T19:37:57.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 -- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 msgr2=0x7f3bb0136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:57.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 0x7f3bb0136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 -- 172.21.15.88:0/1321508908 >> v1:172.21.15.88:6789/0 conn(0x7f3bb00a1790 legacy=0x7f3bb013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 -- 172.21.15.88:0/1321508908 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00a32d0 con 0x7f3bb00af970 2023-10-18T19:37:57.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb5f9c700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 0x7f3bb0136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:57.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.055+0000 7f3bb579b700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 0x7f3bb0135d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3bac0097c0 tx=0x7f3bac009060).ready entity=mon.2 client_cookie=ca2669a6972e1d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:57.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3ba7fff700 1 -- 172.21.15.88:0/1321508908 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00d4a0 con 0x7f3bb00af970 2023-10-18T19:37:57.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3ba7fff700 1 -- 172.21.15.88:0/1321508908 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00d600 con 0x7f3bb00af970 2023-10-18T19:37:57.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3ba7fff700 1 -- 172.21.15.88:0/1321508908 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00d980 con 0x7f3bb00af970 2023-10-18T19:37:57.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 -- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 msgr2=0x7f3bb0135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 0x7f3bb0135d30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3bac0097c0 tx=0x7f3bac009060).stop 2023-10-18T19:37:57.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 -- 172.21.15.88:0/1321508908 shutdown_connections 2023-10-18T19:37:57.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a4c50 0x7f3bb0136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/1321508908 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00af970 0x7f3bb0135d30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 -- 172.21.15.88:0/1321508908 >> 172.21.15.88:0/1321508908 conn(0x7f3bb005eb60 msgr2=0x7f3bb00af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:57.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 -- 172.21.15.88:0/1321508908 shutdown_connections 2023-10-18T19:37:57.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.056+0000 7f3bb79ff700 1 -- 172.21.15.88:0/1321508908 wait complete. 2023-10-18T19:37:57.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.057+0000 7f3bb79ff700 1 Processor -- start 2023-10-18T19:37:57.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 -- start start 2023-10-18T19:37:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00a4c50 0x7f3bb00aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb00af970 0x7f3bb00aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00ab910 con 0x7f3bb00af970 2023-10-18T19:37:57.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb01489d0 con 0x7f3bb00a1790 2023-10-18T19:37:57.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.058+0000 7f3bb79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0148670 con 0x7f3bb00a4c50 2023-10-18T19:37:57.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40276/0 (socket says 172.21.15.88:40276) 2023-10-18T19:37:57.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb4f9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00a4c50 0x7f3bb00aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 -- 172.21.15.88:0/3654449978 learned_addr learned my addr 172.21.15.88:0/3654449978 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb5f9c700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb00af970 0x7f3bb00aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 -- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00a4c50 msgr2=0x7f3bb00aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00a4c50 0x7f3bb00aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 -- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb00af970 msgr2=0x7f3bb00aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb00af970 0x7f3bb00aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 -- 172.21.15.88:0/3654449978 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8009a20 con 0x7f3bb00a1790 2023-10-18T19:37:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb579b700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3bb00a3ba0 tx=0x7f3bac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac000c90 con 0x7f3bb00a1790 2023-10-18T19:37:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00d770 con 0x7f3bb00a1790 2023-10-18T19:37:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.059+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac0092a0 con 0x7f3bb00a1790 2023-10-18T19:37:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.060+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac01d430 con 0x7f3bb00a1790 2023-10-18T19:37:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.060+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb00a94c0 con 0x7f3bb00a1790 2023-10-18T19:37:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.061+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb00aa200 con 0x7f3bb00a1790 2023-10-18T19:37:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.061+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f3bac01d7e0 con 0x7f3bb00a1790 2023-10-18T19:37:57.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.061+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f3bac056860 con 0x7f3bb00a1790 2023-10-18T19:37:57.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.065+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3bac0292d0 con 0x7f3bb00a1790 2023-10-18T19:37:57.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.212+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 --> v1:172.21.15.88:6800/113625 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bb005f270 con 0x7f3b94041ce0 2023-10-18T19:37:57.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.221+0000 7f3ba57fa700 1 -- 172.21.15.88:0/3654449978 <== mgr.14098 v1:172.21.15.88:6800/113625 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+321121 (unknown 2965378022 0 3414633563) 0x7f3bb005f270 con 0x7f3b94041ce0 2023-10-18T19:37:57.227 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.224+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 >> v1:172.21.15.88:6800/113625 conn(0x7f3b94041ce0 legacy=0x7f3b940441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 msgr2=0x7f3bb00ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3bb00a3ba0 tx=0x7f3bac016000).stop 2023-10-18T19:37:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 shutdown_connections 2023-10-18T19:37:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb00af970 0x7f3bb00aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3bb00a1790 0x7f3bb00ab420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 --2- 172.21.15.88:0/3654449978 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3bb00a4c50 0x7f3bb00aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 >> 172.21.15.88:0/3654449978 conn(0x7f3bb005eb60 msgr2=0x7f3bb0138030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 shutdown_connections 2023-10-18T19:37:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.225+0000 7f3bb79ff700 1 -- 172.21.15.88:0/3654449978 wait complete. 2023-10-18T19:37:57.232 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-10-18T19:37:57.244 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-10-18T19:37:55.362940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8352,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":1190016,"kb_used_data":1376,"kb_used_omap":36,"kb_used_meta":1188571,"kb_avail":376297344,"statfs":{"total":386547056640,"available":385328480256,"internally_reserved":0,"allocated":1409024,"data_stored":587312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37000,"internal_metadata":1217097592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001585"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304162+0000","last_change":"2023-10-18T19:37:40.156800+0000","last_active":"2023-10-18T19:37:50.304162+0000","last_peered":"2023-10-18T19:37:50.304162+0000","last_clean":"2023-10-18T19:37:50.304162+0000","last_became_active":"2023-10-18T19:37:40.156384+0000","last_became_peered":"2023-10-18T19:37:40.156384+0000","last_unstale":"2023-10-18T19:37:50.304162+0000","last_undegraded":"2023-10-18T19:37:50.304162+0000","last_fullsized":"2023-10-18T19:37:50.304162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496088+0000","last_change":"2023-10-18T19:37:41.163499+0000","last_active":"2023-10-18T19:37:50.496088+0000","last_peered":"2023-10-18T19:37:50.496088+0000","last_clean":"2023-10-18T19:37:50.496088+0000","last_became_active":"2023-10-18T19:37:41.161563+0000","last_became_peered":"2023-10-18T19:37:41.161563+0000","last_unstale":"2023-10-18T19:37:50.496088+0000","last_undegraded":"2023-10-18T19:37:50.496088+0000","last_fullsized":"2023-10-18T19:37:50.496088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2192,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222243+0000","last_change":"2023-10-18T19:37:41.175363+0000","last_active":"2023-10-18T19:37:50.222243+0000","last_peered":"2023-10-18T19:37:50.222243+0000","last_clean":"2023-10-18T19:37:50.222243+0000","last_became_active":"2023-10-18T19:37:41.174057+0000","last_became_peered":"2023-10-18T19:37:41.174057+0000","last_unstale":"2023-10-18T19:37:50.222243+0000","last_undegraded":"2023-10-18T19:37:50.222243+0000","last_fullsized":"2023-10-18T19:37:50.222243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495454+0000","last_change":"2023-10-18T19:37:41.183364+0000","last_active":"2023-10-18T19:37:50.495454+0000","last_peered":"2023-10-18T19:37:50.495454+0000","last_clean":"2023-10-18T19:37:50.495454+0000","last_became_active":"2023-10-18T19:37:41.183031+0000","last_became_peered":"2023-10-18T19:37:41.183031+0000","last_unstale":"2023-10-18T19:37:50.495454+0000","last_undegraded":"2023-10-18T19:37:50.495454+0000","last_fullsized":"2023-10-18T19:37:50.495454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495160+0000","last_change":"2023-10-18T19:37:41.167771+0000","last_active":"2023-10-18T19:37:50.495160+0000","last_peered":"2023-10-18T19:37:50.495160+0000","last_clean":"2023-10-18T19:37:50.495160+0000","last_became_active":"2023-10-18T19:37:41.167443+0000","last_became_peered":"2023-10-18T19:37:41.167443+0000","last_unstale":"2023-10-18T19:37:50.495160+0000","last_undegraded":"2023-10-18T19:37:50.495160+0000","last_fullsized":"2023-10-18T19:37:50.495160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495274+0000","last_change":"2023-10-18T19:37:41.183248+0000","last_active":"2023-10-18T19:37:50.495274+0000","last_peered":"2023-10-18T19:37:50.495274+0000","last_clean":"2023-10-18T19:37:50.495274+0000","last_became_active":"2023-10-18T19:37:41.182944+0000","last_became_peered":"2023-10-18T19:37:41.182944+0000","last_unstale":"2023-10-18T19:37:50.495274+0000","last_undegraded":"2023-10-18T19:37:50.495274+0000","last_fullsized":"2023-10-18T19:37:50.495274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303697+0000","last_change":"2023-10-18T19:37:41.169690+0000","last_active":"2023-10-18T19:37:50.303697+0000","last_peered":"2023-10-18T19:37:50.303697+0000","last_clean":"2023-10-18T19:37:50.303697+0000","last_became_active":"2023-10-18T19:37:41.169425+0000","last_became_peered":"2023-10-18T19:37:41.169425+0000","last_unstale":"2023-10-18T19:37:50.303697+0000","last_undegraded":"2023-10-18T19:37:50.303697+0000","last_fullsized":"2023-10-18T19:37:50.303697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495258+0000","last_change":"2023-10-18T19:37:41.173351+0000","last_active":"2023-10-18T19:37:50.495258+0000","last_peered":"2023-10-18T19:37:50.495258+0000","last_clean":"2023-10-18T19:37:50.495258+0000","last_became_active":"2023-10-18T19:37:41.170664+0000","last_became_peered":"2023-10-18T19:37:41.170664+0000","last_unstale":"2023-10-18T19:37:50.495258+0000","last_undegraded":"2023-10-18T19:37:50.495258+0000","last_fullsized":"2023-10-18T19:37:50.495258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496303+0000","last_change":"2023-10-18T19:37:41.163809+0000","last_active":"2023-10-18T19:37:50.496303+0000","last_peered":"2023-10-18T19:37:50.496303+0000","last_clean":"2023-10-18T19:37:50.496303+0000","last_became_active":"2023-10-18T19:37:41.163487+0000","last_became_peered":"2023-10-18T19:37:41.163487+0000","last_unstale":"2023-10-18T19:37:50.496303+0000","last_undegraded":"2023-10-18T19:37:50.496303+0000","last_fullsized":"2023-10-18T19:37:50.496303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'8","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304589+0000","last_change":"2023-10-18T19:37:40.155058+0000","last_active":"2023-10-18T19:37:50.304589+0000","last_peered":"2023-10-18T19:37:50.304589+0000","last_clean":"2023-10-18T19:37:50.304589+0000","last_became_active":"2023-10-18T19:37:40.154735+0000","last_became_peered":"2023-10-18T19:37:40.154735+0000","last_unstale":"2023-10-18T19:37:50.304589+0000","last_undegraded":"2023-10-18T19:37:50.304589+0000","last_fullsized":"2023-10-18T19:37:50.304589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223423+0000","last_change":"2023-10-18T19:37:41.178985+0000","last_active":"2023-10-18T19:37:50.223423+0000","last_peered":"2023-10-18T19:37:50.223423+0000","last_clean":"2023-10-18T19:37:50.223423+0000","last_became_active":"2023-10-18T19:37:41.178508+0000","last_became_peered":"2023-10-18T19:37:41.178508+0000","last_unstale":"2023-10-18T19:37:50.223423+0000","last_undegraded":"2023-10-18T19:37:50.223423+0000","last_fullsized":"2023-10-18T19:37:50.223423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222870+0000","last_change":"2023-10-18T19:37:39.147263+0000","last_active":"2023-10-18T19:37:50.222870+0000","last_peered":"2023-10-18T19:37:50.222870+0000","last_clean":"2023-10-18T19:37:50.222870+0000","last_became_active":"2023-10-18T19:37:39.146491+0000","last_became_peered":"2023-10-18T19:37:39.146491+0000","last_unstale":"2023-10-18T19:37:50.222870+0000","last_undegraded":"2023-10-18T19:37:50.222870+0000","last_fullsized":"2023-10-18T19:37:50.222870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496272+0000","last_change":"2023-10-18T19:37:41.161719+0000","last_active":"2023-10-18T19:37:50.496272+0000","last_peered":"2023-10-18T19:37:50.496272+0000","last_clean":"2023-10-18T19:37:50.496272+0000","last_became_active":"2023-10-18T19:37:41.161382+0000","last_became_peered":"2023-10-18T19:37:41.161382+0000","last_unstale":"2023-10-18T19:37:50.496272+0000","last_undegraded":"2023-10-18T19:37:50.496272+0000","last_fullsized":"2023-10-18T19:37:50.496272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304234+0000","last_change":"2023-10-18T19:37:41.169665+0000","last_active":"2023-10-18T19:37:50.304234+0000","last_peered":"2023-10-18T19:37:50.304234+0000","last_clean":"2023-10-18T19:37:50.304234+0000","last_became_active":"2023-10-18T19:37:41.168871+0000","last_became_peered":"2023-10-18T19:37:41.168871+0000","last_unstale":"2023-10-18T19:37:50.304234+0000","last_undegraded":"2023-10-18T19:37:50.304234+0000","last_fullsized":"2023-10-18T19:37:50.304234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222929+0000","last_change":"2023-10-18T19:37:41.173493+0000","last_active":"2023-10-18T19:37:50.222929+0000","last_peered":"2023-10-18T19:37:50.222929+0000","last_clean":"2023-10-18T19:37:50.222929+0000","last_became_active":"2023-10-18T19:37:41.173140+0000","last_became_peered":"2023-10-18T19:37:41.173140+0000","last_unstale":"2023-10-18T19:37:50.222929+0000","last_undegraded":"2023-10-18T19:37:50.222929+0000","last_fullsized":"2023-10-18T19:37:50.222929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496976+0000","last_change":"2023-10-18T19:37:41.164504+0000","last_active":"2023-10-18T19:37:50.496976+0000","last_peered":"2023-10-18T19:37:50.496976+0000","last_clean":"2023-10-18T19:37:50.496976+0000","last_became_active":"2023-10-18T19:37:41.164140+0000","last_became_peered":"2023-10-18T19:37:41.164140+0000","last_unstale":"2023-10-18T19:37:50.496976+0000","last_undegraded":"2023-10-18T19:37:50.496976+0000","last_fullsized":"2023-10-18T19:37:50.496976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222358+0000","last_change":"2023-10-18T19:37:41.176293+0000","last_active":"2023-10-18T19:37:50.222358+0000","last_peered":"2023-10-18T19:37:50.222358+0000","last_clean":"2023-10-18T19:37:50.222358+0000","last_became_active":"2023-10-18T19:37:41.175856+0000","last_became_peered":"2023-10-18T19:37:41.175856+0000","last_unstale":"2023-10-18T19:37:50.222358+0000","last_undegraded":"2023-10-18T19:37:50.222358+0000","last_fullsized":"2023-10-18T19:37:50.222358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222453+0000","last_change":"2023-10-18T19:37:41.175551+0000","last_active":"2023-10-18T19:37:50.222453+0000","last_peered":"2023-10-18T19:37:50.222453+0000","last_clean":"2023-10-18T19:37:50.222453+0000","last_became_active":"2023-10-18T19:37:41.174401+0000","last_became_peered":"2023-10-18T19:37:41.174401+0000","last_unstale":"2023-10-18T19:37:50.222453+0000","last_undegraded":"2023-10-18T19:37:50.222453+0000","last_fullsized":"2023-10-18T19:37:50.222453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496752+0000","last_change":"2023-10-18T19:37:41.165936+0000","last_active":"2023-10-18T19:37:50.496752+0000","last_peered":"2023-10-18T19:37:50.496752+0000","last_clean":"2023-10-18T19:37:50.496752+0000","last_became_active":"2023-10-18T19:37:41.162921+0000","last_became_peered":"2023-10-18T19:37:41.162921+0000","last_unstale":"2023-10-18T19:37:50.496752+0000","last_undegraded":"2023-10-18T19:37:50.496752+0000","last_fullsized":"2023-10-18T19:37:50.496752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495564+0000","last_change":"2023-10-18T19:37:41.160827+0000","last_active":"2023-10-18T19:37:50.495564+0000","last_peered":"2023-10-18T19:37:50.495564+0000","last_clean":"2023-10-18T19:37:50.495564+0000","last_became_active":"2023-10-18T19:37:41.160515+0000","last_became_peered":"2023-10-18T19:37:41.160515+0000","last_unstale":"2023-10-18T19:37:50.495564+0000","last_undegraded":"2023-10-18T19:37:50.495564+0000","last_fullsized":"2023-10-18T19:37:50.495564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304149+0000","last_change":"2023-10-18T19:37:39.150862+0000","last_active":"2023-10-18T19:37:50.304149+0000","last_peered":"2023-10-18T19:37:50.304149+0000","last_clean":"2023-10-18T19:37:50.304149+0000","last_became_active":"2023-10-18T19:37:39.149899+0000","last_became_peered":"2023-10-18T19:37:39.149899+0000","last_unstale":"2023-10-18T19:37:50.304149+0000","last_undegraded":"2023-10-18T19:37:50.304149+0000","last_fullsized":"2023-10-18T19:37:50.304149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222509+0000","last_change":"2023-10-18T19:37:41.172824+0000","last_active":"2023-10-18T19:37:50.222509+0000","last_peered":"2023-10-18T19:37:50.222509+0000","last_clean":"2023-10-18T19:37:50.222509+0000","last_became_active":"2023-10-18T19:37:41.172527+0000","last_became_peered":"2023-10-18T19:37:41.172527+0000","last_unstale":"2023-10-18T19:37:50.222509+0000","last_undegraded":"2023-10-18T19:37:50.222509+0000","last_fullsized":"2023-10-18T19:37:50.222509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494956+0000","last_change":"2023-10-18T19:37:41.165042+0000","last_active":"2023-10-18T19:37:50.494956+0000","last_peered":"2023-10-18T19:37:50.494956+0000","last_clean":"2023-10-18T19:37:50.494956+0000","last_became_active":"2023-10-18T19:37:41.161986+0000","last_became_peered":"2023-10-18T19:37:41.161986+0000","last_unstale":"2023-10-18T19:37:50.494956+0000","last_undegraded":"2023-10-18T19:37:50.494956+0000","last_fullsized":"2023-10-18T19:37:50.494956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494410+0000","last_change":"2023-10-18T19:37:40.152762+0000","last_active":"2023-10-18T19:37:50.494410+0000","last_peered":"2023-10-18T19:37:50.494410+0000","last_clean":"2023-10-18T19:37:50.494410+0000","last_became_active":"2023-10-18T19:37:40.152421+0000","last_became_peered":"2023-10-18T19:37:40.152421+0000","last_unstale":"2023-10-18T19:37:50.494410+0000","last_undegraded":"2023-10-18T19:37:50.494410+0000","last_fullsized":"2023-10-18T19:37:50.494410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496113+0000","last_change":"2023-10-18T19:37:40.173613+0000","last_active":"2023-10-18T19:37:50.496113+0000","last_peered":"2023-10-18T19:37:50.496113+0000","last_clean":"2023-10-18T19:37:50.496113+0000","last_became_active":"2023-10-18T19:37:40.173304+0000","last_became_peered":"2023-10-18T19:37:40.173304+0000","last_unstale":"2023-10-18T19:37:50.496113+0000","last_undegraded":"2023-10-18T19:37:50.496113+0000","last_fullsized":"2023-10-18T19:37:50.496113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223112+0000","last_change":"2023-10-18T19:37:39.159657+0000","last_active":"2023-10-18T19:37:50.223112+0000","last_peered":"2023-10-18T19:37:50.223112+0000","last_clean":"2023-10-18T19:37:50.223112+0000","last_became_active":"2023-10-18T19:37:39.159083+0000","last_became_peered":"2023-10-18T19:37:39.159083+0000","last_unstale":"2023-10-18T19:37:50.223112+0000","last_undegraded":"2023-10-18T19:37:50.223112+0000","last_fullsized":"2023-10-18T19:37:50.223112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223277+0000","last_change":"2023-10-18T19:37:39.159721+0000","last_active":"2023-10-18T19:37:50.223277+0000","last_peered":"2023-10-18T19:37:50.223277+0000","last_clean":"2023-10-18T19:37:50.223277+0000","last_became_active":"2023-10-18T19:37:39.159327+0000","last_became_peered":"2023-10-18T19:37:39.159327+0000","last_unstale":"2023-10-18T19:37:50.223277+0000","last_undegraded":"2023-10-18T19:37:50.223277+0000","last_fullsized":"2023-10-18T19:37:50.223277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496573+0000","last_change":"2023-10-18T19:37:41.164967+0000","last_active":"2023-10-18T19:37:50.496573+0000","last_peered":"2023-10-18T19:37:50.496573+0000","last_clean":"2023-10-18T19:37:50.496573+0000","last_became_active":"2023-10-18T19:37:41.164617+0000","last_became_peered":"2023-10-18T19:37:41.164617+0000","last_unstale":"2023-10-18T19:37:50.496573+0000","last_undegraded":"2023-10-18T19:37:50.496573+0000","last_fullsized":"2023-10-18T19:37:50.496573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222874+0000","last_change":"2023-10-18T19:37:41.173718+0000","last_active":"2023-10-18T19:37:50.222874+0000","last_peered":"2023-10-18T19:37:50.222874+0000","last_clean":"2023-10-18T19:37:50.222874+0000","last_became_active":"2023-10-18T19:37:41.171781+0000","last_became_peered":"2023-10-18T19:37:41.171781+0000","last_unstale":"2023-10-18T19:37:50.222874+0000","last_undegraded":"2023-10-18T19:37:50.222874+0000","last_fullsized":"2023-10-18T19:37:50.222874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304592+0000","last_change":"2023-10-18T19:37:41.169566+0000","last_active":"2023-10-18T19:37:50.304592+0000","last_peered":"2023-10-18T19:37:50.304592+0000","last_clean":"2023-10-18T19:37:50.304592+0000","last_became_active":"2023-10-18T19:37:41.168842+0000","last_became_peered":"2023-10-18T19:37:41.168842+0000","last_unstale":"2023-10-18T19:37:50.304592+0000","last_undegraded":"2023-10-18T19:37:50.304592+0000","last_fullsized":"2023-10-18T19:37:50.304592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496546+0000","last_change":"2023-10-18T19:37:41.170576+0000","last_active":"2023-10-18T19:37:50.496546+0000","last_peered":"2023-10-18T19:37:50.496546+0000","last_clean":"2023-10-18T19:37:50.496546+0000","last_became_active":"2023-10-18T19:37:41.170274+0000","last_became_peered":"2023-10-18T19:37:41.170274+0000","last_unstale":"2023-10-18T19:37:50.496546+0000","last_undegraded":"2023-10-18T19:37:50.496546+0000","last_fullsized":"2023-10-18T19:37:50.496546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497207+0000","last_change":"2023-10-18T19:37:40.182143+0000","last_active":"2023-10-18T19:37:50.497207+0000","last_peered":"2023-10-18T19:37:50.497207+0000","last_clean":"2023-10-18T19:37:50.497207+0000","last_became_active":"2023-10-18T19:37:40.181853+0000","last_became_peered":"2023-10-18T19:37:40.181853+0000","last_unstale":"2023-10-18T19:37:50.497207+0000","last_undegraded":"2023-10-18T19:37:50.497207+0000","last_fullsized":"2023-10-18T19:37:50.497207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495730+0000","last_change":"2023-10-18T19:37:41.170066+0000","last_active":"2023-10-18T19:37:50.495730+0000","last_peered":"2023-10-18T19:37:50.495730+0000","last_clean":"2023-10-18T19:37:50.495730+0000","last_became_active":"2023-10-18T19:37:41.168793+0000","last_became_peered":"2023-10-18T19:37:41.168793+0000","last_unstale":"2023-10-18T19:37:50.495730+0000","last_undegraded":"2023-10-18T19:37:50.495730+0000","last_fullsized":"2023-10-18T19:37:50.495730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496842+0000","last_change":"2023-10-18T19:37:41.163332+0000","last_active":"2023-10-18T19:37:50.496842+0000","last_peered":"2023-10-18T19:37:50.496842+0000","last_clean":"2023-10-18T19:37:50.496842+0000","last_became_active":"2023-10-18T19:37:41.161951+0000","last_became_peered":"2023-10-18T19:37:41.161951+0000","last_unstale":"2023-10-18T19:37:50.496842+0000","last_undegraded":"2023-10-18T19:37:50.496842+0000","last_fullsized":"2023-10-18T19:37:50.496842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496126+0000","last_change":"2023-10-18T19:37:41.163520+0000","last_active":"2023-10-18T19:37:50.496126+0000","last_peered":"2023-10-18T19:37:50.496126+0000","last_clean":"2023-10-18T19:37:50.496126+0000","last_became_active":"2023-10-18T19:37:41.162538+0000","last_became_peered":"2023-10-18T19:37:41.162538+0000","last_unstale":"2023-10-18T19:37:50.496126+0000","last_undegraded":"2023-10-18T19:37:50.496126+0000","last_fullsized":"2023-10-18T19:37:50.496126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304263+0000","last_change":"2023-10-18T19:37:41.168529+0000","last_active":"2023-10-18T19:37:50.304263+0000","last_peered":"2023-10-18T19:37:50.304263+0000","last_clean":"2023-10-18T19:37:50.304263+0000","last_became_active":"2023-10-18T19:37:41.168250+0000","last_became_peered":"2023-10-18T19:37:41.168250+0000","last_unstale":"2023-10-18T19:37:50.304263+0000","last_undegraded":"2023-10-18T19:37:50.304263+0000","last_fullsized":"2023-10-18T19:37:50.304263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494567+0000","last_change":"2023-10-18T19:37:41.174026+0000","last_active":"2023-10-18T19:37:50.494567+0000","last_peered":"2023-10-18T19:37:50.494567+0000","last_clean":"2023-10-18T19:37:50.494567+0000","last_became_active":"2023-10-18T19:37:41.172584+0000","last_became_peered":"2023-10-18T19:37:41.172584+0000","last_unstale":"2023-10-18T19:37:50.494567+0000","last_undegraded":"2023-10-18T19:37:50.494567+0000","last_fullsized":"2023-10-18T19:37:50.494567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303869+0000","last_change":"2023-10-18T19:37:39.152226+0000","last_active":"2023-10-18T19:37:50.303869+0000","last_peered":"2023-10-18T19:37:50.303869+0000","last_clean":"2023-10-18T19:37:50.303869+0000","last_became_active":"2023-10-18T19:37:39.151683+0000","last_became_peered":"2023-10-18T19:37:39.151683+0000","last_unstale":"2023-10-18T19:37:50.303869+0000","last_undegraded":"2023-10-18T19:37:50.303869+0000","last_fullsized":"2023-10-18T19:37:50.303869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495190+0000","last_change":"2023-10-18T19:37:41.161230+0000","last_active":"2023-10-18T19:37:50.495190+0000","last_peered":"2023-10-18T19:37:50.495190+0000","last_clean":"2023-10-18T19:37:50.495190+0000","last_became_active":"2023-10-18T19:37:41.160273+0000","last_became_peered":"2023-10-18T19:37:41.160273+0000","last_unstale":"2023-10-18T19:37:50.495190+0000","last_undegraded":"2023-10-18T19:37:50.495190+0000","last_fullsized":"2023-10-18T19:37:50.495190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222094+0000","last_change":"2023-10-18T19:37:40.173247+0000","last_active":"2023-10-18T19:37:50.222094+0000","last_peered":"2023-10-18T19:37:50.222094+0000","last_clean":"2023-10-18T19:37:50.222094+0000","last_became_active":"2023-10-18T19:37:40.172802+0000","last_became_peered":"2023-10-18T19:37:40.172802+0000","last_unstale":"2023-10-18T19:37:50.222094+0000","last_undegraded":"2023-10-18T19:37:50.222094+0000","last_fullsized":"2023-10-18T19:37:50.222094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494666+0000","last_change":"2023-10-18T19:37:41.173853+0000","last_active":"2023-10-18T19:37:50.494666+0000","last_peered":"2023-10-18T19:37:50.494666+0000","last_clean":"2023-10-18T19:37:50.494666+0000","last_became_active":"2023-10-18T19:37:41.171900+0000","last_became_peered":"2023-10-18T19:37:41.171900+0000","last_unstale":"2023-10-18T19:37:50.494666+0000","last_undegraded":"2023-10-18T19:37:50.494666+0000","last_fullsized":"2023-10-18T19:37:50.494666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:37:16.342037+0000","last_clean_scrub_stamp":"2023-10-18T19:37:16.342037+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497682+0000","last_change":"2023-10-18T19:37:41.180316+0000","last_active":"2023-10-18T19:37:50.497682+0000","last_peered":"2023-10-18T19:37:50.497682+0000","last_clean":"2023-10-18T19:37:50.497682+0000","last_became_active":"2023-10-18T19:37:41.179783+0000","last_became_peered":"2023-10-18T19:37:41.179783+0000","last_unstale":"2023-10-18T19:37:50.497682+0000","last_undegraded":"2023-10-18T19:37:50.497682+0000","last_fullsized":"2023-10-18T19:37:50.497682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495648+0000","last_change":"2023-10-18T19:37:41.168332+0000","last_active":"2023-10-18T19:37:50.495648+0000","last_peered":"2023-10-18T19:37:50.495648+0000","last_clean":"2023-10-18T19:37:50.495648+0000","last_became_active":"2023-10-18T19:37:41.167890+0000","last_became_peered":"2023-10-18T19:37:41.167890+0000","last_unstale":"2023-10-18T19:37:50.495648+0000","last_undegraded":"2023-10-18T19:37:50.495648+0000","last_fullsized":"2023-10-18T19:37:50.495648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304325+0000","last_change":"2023-10-18T19:37:39.151297+0000","last_active":"2023-10-18T19:37:50.304325+0000","last_peered":"2023-10-18T19:37:50.304325+0000","last_clean":"2023-10-18T19:37:50.304325+0000","last_became_active":"2023-10-18T19:37:39.150978+0000","last_became_peered":"2023-10-18T19:37:39.150978+0000","last_unstale":"2023-10-18T19:37:50.304325+0000","last_undegraded":"2023-10-18T19:37:50.304325+0000","last_fullsized":"2023-10-18T19:37:50.304325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223054+0000","last_change":"2023-10-18T19:37:39.147350+0000","last_active":"2023-10-18T19:37:50.223054+0000","last_peered":"2023-10-18T19:37:50.223054+0000","last_clean":"2023-10-18T19:37:50.223054+0000","last_became_active":"2023-10-18T19:37:39.146876+0000","last_became_peered":"2023-10-18T19:37:39.146876+0000","last_unstale":"2023-10-18T19:37:50.223054+0000","last_undegraded":"2023-10-18T19:37:50.223054+0000","last_fullsized":"2023-10-18T19:37:50.223054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496685+0000","last_change":"2023-10-18T19:37:41.164714+0000","last_active":"2023-10-18T19:37:50.496685+0000","last_peered":"2023-10-18T19:37:50.496685+0000","last_clean":"2023-10-18T19:37:50.496685+0000","last_became_active":"2023-10-18T19:37:41.161777+0000","last_became_peered":"2023-10-18T19:37:41.161777+0000","last_unstale":"2023-10-18T19:37:50.496685+0000","last_undegraded":"2023-10-18T19:37:50.496685+0000","last_fullsized":"2023-10-18T19:37:50.496685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497611+0000","last_change":"2023-10-18T19:37:41.184294+0000","last_active":"2023-10-18T19:37:50.497611+0000","last_peered":"2023-10-18T19:37:50.497611+0000","last_clean":"2023-10-18T19:37:50.497611+0000","last_became_active":"2023-10-18T19:37:41.183439+0000","last_became_peered":"2023-10-18T19:37:41.183439+0000","last_unstale":"2023-10-18T19:37:50.497611+0000","last_undegraded":"2023-10-18T19:37:50.497611+0000","last_fullsized":"2023-10-18T19:37:50.497611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303811+0000","last_change":"2023-10-18T19:37:40.166435+0000","last_active":"2023-10-18T19:37:50.303811+0000","last_peered":"2023-10-18T19:37:50.303811+0000","last_clean":"2023-10-18T19:37:50.303811+0000","last_became_active":"2023-10-18T19:37:40.165350+0000","last_became_peered":"2023-10-18T19:37:40.165350+0000","last_unstale":"2023-10-18T19:37:50.303811+0000","last_undegraded":"2023-10-18T19:37:50.303811+0000","last_fullsized":"2023-10-18T19:37:50.303811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494400+0000","last_change":"2023-10-18T19:37:41.174150+0000","last_active":"2023-10-18T19:37:50.494400+0000","last_peered":"2023-10-18T19:37:50.494400+0000","last_clean":"2023-10-18T19:37:50.494400+0000","last_became_active":"2023-10-18T19:37:41.172901+0000","last_became_peered":"2023-10-18T19:37:41.172901+0000","last_unstale":"2023-10-18T19:37:50.494400+0000","last_undegraded":"2023-10-18T19:37:50.494400+0000","last_fullsized":"2023-10-18T19:37:50.494400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222439+0000","last_change":"2023-10-18T19:37:40.173744+0000","last_active":"2023-10-18T19:37:50.222439+0000","last_peered":"2023-10-18T19:37:50.222439+0000","last_clean":"2023-10-18T19:37:50.222439+0000","last_became_active":"2023-10-18T19:37:40.173367+0000","last_became_peered":"2023-10-18T19:37:40.173367+0000","last_unstale":"2023-10-18T19:37:50.222439+0000","last_undegraded":"2023-10-18T19:37:50.222439+0000","last_fullsized":"2023-10-18T19:37:50.222439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222150+0000","last_change":"2023-10-18T19:37:39.143141+0000","last_active":"2023-10-18T19:37:50.222150+0000","last_peered":"2023-10-18T19:37:50.222150+0000","last_clean":"2023-10-18T19:37:50.222150+0000","last_became_active":"2023-10-18T19:37:39.142854+0000","last_became_peered":"2023-10-18T19:37:39.142854+0000","last_unstale":"2023-10-18T19:37:50.222150+0000","last_undegraded":"2023-10-18T19:37:50.222150+0000","last_fullsized":"2023-10-18T19:37:50.222150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494482+0000","last_change":"2023-10-18T19:37:41.165125+0000","last_active":"2023-10-18T19:37:50.494482+0000","last_peered":"2023-10-18T19:37:50.494482+0000","last_clean":"2023-10-18T19:37:50.494482+0000","last_became_active":"2023-10-18T19:37:41.164231+0000","last_became_peered":"2023-10-18T19:37:41.164231+0000","last_unstale":"2023-10-18T19:37:50.494482+0000","last_undegraded":"2023-10-18T19:37:50.494482+0000","last_fullsized":"2023-10-18T19:37:50.494482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303903+0000","last_change":"2023-10-18T19:37:40.156557+0000","last_active":"2023-10-18T19:37:50.303903+0000","last_peered":"2023-10-18T19:37:50.303903+0000","last_clean":"2023-10-18T19:37:50.303903+0000","last_became_active":"2023-10-18T19:37:40.156220+0000","last_became_peered":"2023-10-18T19:37:40.156220+0000","last_unstale":"2023-10-18T19:37:50.303903+0000","last_undegraded":"2023-10-18T19:37:50.303903+0000","last_fullsized":"2023-10-18T19:37:50.303903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303492+0000","last_change":"2023-10-18T19:37:39.150156+0000","last_active":"2023-10-18T19:37:50.303492+0000","last_peered":"2023-10-18T19:37:50.303492+0000","last_clean":"2023-10-18T19:37:50.303492+0000","last_became_active":"2023-10-18T19:37:39.149511+0000","last_became_peered":"2023-10-18T19:37:39.149511+0000","last_unstale":"2023-10-18T19:37:50.303492+0000","last_undegraded":"2023-10-18T19:37:50.303492+0000","last_fullsized":"2023-10-18T19:37:50.303492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495983+0000","last_change":"2023-10-18T19:37:41.162904+0000","last_active":"2023-10-18T19:37:50.495983+0000","last_peered":"2023-10-18T19:37:50.495983+0000","last_clean":"2023-10-18T19:37:50.495983+0000","last_became_active":"2023-10-18T19:37:41.160957+0000","last_became_peered":"2023-10-18T19:37:41.160957+0000","last_unstale":"2023-10-18T19:37:50.495983+0000","last_undegraded":"2023-10-18T19:37:50.495983+0000","last_fullsized":"2023-10-18T19:37:50.495983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495461+0000","last_change":"2023-10-18T19:37:41.161220+0000","last_active":"2023-10-18T19:37:50.495461+0000","last_peered":"2023-10-18T19:37:50.495461+0000","last_clean":"2023-10-18T19:37:50.495461+0000","last_became_active":"2023-10-18T19:37:41.160799+0000","last_became_peered":"2023-10-18T19:37:41.160799+0000","last_unstale":"2023-10-18T19:37:50.495461+0000","last_undegraded":"2023-10-18T19:37:50.495461+0000","last_fullsized":"2023-10-18T19:37:50.495461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494551+0000","last_change":"2023-10-18T19:37:41.183271+0000","last_active":"2023-10-18T19:37:50.494551+0000","last_peered":"2023-10-18T19:37:50.494551+0000","last_clean":"2023-10-18T19:37:50.494551+0000","last_became_active":"2023-10-18T19:37:41.182944+0000","last_became_peered":"2023-10-18T19:37:41.182944+0000","last_unstale":"2023-10-18T19:37:50.494551+0000","last_undegraded":"2023-10-18T19:37:50.494551+0000","last_fullsized":"2023-10-18T19:37:50.494551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495809+0000","last_change":"2023-10-18T19:37:41.174344+0000","last_active":"2023-10-18T19:37:50.495809+0000","last_peered":"2023-10-18T19:37:50.495809+0000","last_clean":"2023-10-18T19:37:50.495809+0000","last_became_active":"2023-10-18T19:37:41.169184+0000","last_became_peered":"2023-10-18T19:37:41.169184+0000","last_unstale":"2023-10-18T19:37:50.495809+0000","last_undegraded":"2023-10-18T19:37:50.495809+0000","last_fullsized":"2023-10-18T19:37:50.495809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222414+0000","last_change":"2023-10-18T19:37:40.179737+0000","last_active":"2023-10-18T19:37:50.222414+0000","last_peered":"2023-10-18T19:37:50.222414+0000","last_clean":"2023-10-18T19:37:50.222414+0000","last_became_active":"2023-10-18T19:37:40.179379+0000","last_became_peered":"2023-10-18T19:37:40.179379+0000","last_unstale":"2023-10-18T19:37:50.222414+0000","last_undegraded":"2023-10-18T19:37:50.222414+0000","last_fullsized":"2023-10-18T19:37:50.222414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496379+0000","last_change":"2023-10-18T19:37:41.167178+0000","last_active":"2023-10-18T19:37:50.496379+0000","last_peered":"2023-10-18T19:37:50.496379+0000","last_clean":"2023-10-18T19:37:50.496379+0000","last_became_active":"2023-10-18T19:37:41.166516+0000","last_became_peered":"2023-10-18T19:37:41.166516+0000","last_unstale":"2023-10-18T19:37:50.496379+0000","last_undegraded":"2023-10-18T19:37:50.496379+0000","last_fullsized":"2023-10-18T19:37:50.496379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496264+0000","last_change":"2023-10-18T19:37:41.162014+0000","last_active":"2023-10-18T19:37:50.496264+0000","last_peered":"2023-10-18T19:37:50.496264+0000","last_clean":"2023-10-18T19:37:50.496264+0000","last_became_active":"2023-10-18T19:37:41.161648+0000","last_became_peered":"2023-10-18T19:37:41.161648+0000","last_unstale":"2023-10-18T19:37:50.496264+0000","last_undegraded":"2023-10-18T19:37:50.496264+0000","last_fullsized":"2023-10-18T19:37:50.496264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303960+0000","last_change":"2023-10-18T19:37:40.155795+0000","last_active":"2023-10-18T19:37:50.303960+0000","last_peered":"2023-10-18T19:37:50.303960+0000","last_clean":"2023-10-18T19:37:50.303960+0000","last_became_active":"2023-10-18T19:37:40.155458+0000","last_became_peered":"2023-10-18T19:37:40.155458+0000","last_unstale":"2023-10-18T19:37:50.303960+0000","last_undegraded":"2023-10-18T19:37:50.303960+0000","last_fullsized":"2023-10-18T19:37:50.303960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304303+0000","last_change":"2023-10-18T19:37:41.167469+0000","last_active":"2023-10-18T19:37:50.304303+0000","last_peered":"2023-10-18T19:37:50.304303+0000","last_clean":"2023-10-18T19:37:50.304303+0000","last_became_active":"2023-10-18T19:37:41.166881+0000","last_became_peered":"2023-10-18T19:37:41.166881+0000","last_unstale":"2023-10-18T19:37:50.304303+0000","last_undegraded":"2023-10-18T19:37:50.304303+0000","last_fullsized":"2023-10-18T19:37:50.304303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:10.512706+0000","last_clean_scrub_stamp":"2023-10-18T19:34:10.512706+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303854+0000","last_change":"2023-10-18T19:37:39.153660+0000","last_active":"2023-10-18T19:37:50.303854+0000","last_peered":"2023-10-18T19:37:50.303854+0000","last_clean":"2023-10-18T19:37:50.303854+0000","last_became_active":"2023-10-18T19:37:39.149264+0000","last_became_peered":"2023-10-18T19:37:39.149264+0000","last_unstale":"2023-10-18T19:37:50.303854+0000","last_undegraded":"2023-10-18T19:37:50.303854+0000","last_fullsized":"2023-10-18T19:37:50.303854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495577+0000","last_change":"2023-10-18T19:37:41.157722+0000","last_active":"2023-10-18T19:37:50.495577+0000","last_peered":"2023-10-18T19:37:50.495577+0000","last_clean":"2023-10-18T19:37:50.495577+0000","last_became_active":"2023-10-18T19:37:41.157561+0000","last_became_peered":"2023-10-18T19:37:41.157561+0000","last_unstale":"2023-10-18T19:37:50.495577+0000","last_undegraded":"2023-10-18T19:37:50.495577+0000","last_fullsized":"2023-10-18T19:37:50.495577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496848+0000","last_change":"2023-10-18T19:37:41.165870+0000","last_active":"2023-10-18T19:37:50.496848+0000","last_peered":"2023-10-18T19:37:50.496848+0000","last_clean":"2023-10-18T19:37:50.496848+0000","last_became_active":"2023-10-18T19:37:41.165159+0000","last_became_peered":"2023-10-18T19:37:41.165159+0000","last_unstale":"2023-10-18T19:37:50.496848+0000","last_undegraded":"2023-10-18T19:37:50.496848+0000","last_fullsized":"2023-10-18T19:37:50.496848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223024+0000","last_change":"2023-10-18T19:37:39.149247+0000","last_active":"2023-10-18T19:37:50.223024+0000","last_peered":"2023-10-18T19:37:50.223024+0000","last_clean":"2023-10-18T19:37:50.223024+0000","last_became_active":"2023-10-18T19:37:39.147834+0000","last_became_peered":"2023-10-18T19:37:39.147834+0000","last_unstale":"2023-10-18T19:37:50.223024+0000","last_undegraded":"2023-10-18T19:37:50.223024+0000","last_fullsized":"2023-10-18T19:37:50.223024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304302+0000","last_change":"2023-10-18T19:37:39.154705+0000","last_active":"2023-10-18T19:37:50.304302+0000","last_peered":"2023-10-18T19:37:50.304302+0000","last_clean":"2023-10-18T19:37:50.304302+0000","last_became_active":"2023-10-18T19:37:39.153930+0000","last_became_peered":"2023-10-18T19:37:39.153930+0000","last_unstale":"2023-10-18T19:37:50.304302+0000","last_undegraded":"2023-10-18T19:37:50.304302+0000","last_fullsized":"2023-10-18T19:37:50.304302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222697+0000","last_change":"2023-10-18T19:37:39.144587+0000","last_active":"2023-10-18T19:37:50.222697+0000","last_peered":"2023-10-18T19:37:50.222697+0000","last_clean":"2023-10-18T19:37:50.222697+0000","last_became_active":"2023-10-18T19:37:39.144232+0000","last_became_peered":"2023-10-18T19:37:39.144232+0000","last_unstale":"2023-10-18T19:37:50.222697+0000","last_undegraded":"2023-10-18T19:37:50.222697+0000","last_fullsized":"2023-10-18T19:37:50.222697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223344+0000","last_change":"2023-10-18T19:37:39.159913+0000","last_active":"2023-10-18T19:37:50.223344+0000","last_peered":"2023-10-18T19:37:50.223344+0000","last_clean":"2023-10-18T19:37:50.223344+0000","last_became_active":"2023-10-18T19:37:39.159446+0000","last_became_peered":"2023-10-18T19:37:39.159446+0000","last_unstale":"2023-10-18T19:37:50.223344+0000","last_undegraded":"2023-10-18T19:37:50.223344+0000","last_fullsized":"2023-10-18T19:37:50.223344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497177+0000","last_change":"2023-10-18T19:37:41.167408+0000","last_active":"2023-10-18T19:37:50.497177+0000","last_peered":"2023-10-18T19:37:50.497177+0000","last_clean":"2023-10-18T19:37:50.497177+0000","last_became_active":"2023-10-18T19:37:41.166881+0000","last_became_peered":"2023-10-18T19:37:41.166881+0000","last_unstale":"2023-10-18T19:37:50.497177+0000","last_undegraded":"2023-10-18T19:37:50.497177+0000","last_fullsized":"2023-10-18T19:37:50.497177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497365+0000","last_change":"2023-10-18T19:37:41.167932+0000","last_active":"2023-10-18T19:37:50.497365+0000","last_peered":"2023-10-18T19:37:50.497365+0000","last_clean":"2023-10-18T19:37:50.497365+0000","last_became_active":"2023-10-18T19:37:41.161270+0000","last_became_peered":"2023-10-18T19:37:41.161270+0000","last_unstale":"2023-10-18T19:37:50.497365+0000","last_undegraded":"2023-10-18T19:37:50.497365+0000","last_fullsized":"2023-10-18T19:37:50.497365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223262+0000","last_change":"2023-10-18T19:37:41.178806+0000","last_active":"2023-10-18T19:37:50.223262+0000","last_peered":"2023-10-18T19:37:50.223262+0000","last_clean":"2023-10-18T19:37:50.223262+0000","last_became_active":"2023-10-18T19:37:41.178163+0000","last_became_peered":"2023-10-18T19:37:41.178163+0000","last_unstale":"2023-10-18T19:37:50.223262+0000","last_undegraded":"2023-10-18T19:37:50.223262+0000","last_fullsized":"2023-10-18T19:37:50.223262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495095+0000","last_change":"2023-10-18T19:37:40.166579+0000","last_active":"2023-10-18T19:37:50.495095+0000","last_peered":"2023-10-18T19:37:50.495095+0000","last_clean":"2023-10-18T19:37:50.495095+0000","last_became_active":"2023-10-18T19:37:40.166226+0000","last_became_peered":"2023-10-18T19:37:40.166226+0000","last_unstale":"2023-10-18T19:37:50.495095+0000","last_undegraded":"2023-10-18T19:37:50.495095+0000","last_fullsized":"2023-10-18T19:37:50.495095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494759+0000","last_change":"2023-10-18T19:37:41.173254+0000","last_active":"2023-10-18T19:37:50.494759+0000","last_peered":"2023-10-18T19:37:50.494759+0000","last_clean":"2023-10-18T19:37:50.494759+0000","last_became_active":"2023-10-18T19:37:41.171043+0000","last_became_peered":"2023-10-18T19:37:41.171043+0000","last_unstale":"2023-10-18T19:37:50.494759+0000","last_undegraded":"2023-10-18T19:37:50.494759+0000","last_fullsized":"2023-10-18T19:37:50.494759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494612+0000","last_change":"2023-10-18T19:37:40.163654+0000","last_active":"2023-10-18T19:37:50.494612+0000","last_peered":"2023-10-18T19:37:50.494612+0000","last_clean":"2023-10-18T19:37:50.494612+0000","last_became_active":"2023-10-18T19:37:40.163372+0000","last_became_peered":"2023-10-18T19:37:40.163372+0000","last_unstale":"2023-10-18T19:37:50.494612+0000","last_undegraded":"2023-10-18T19:37:50.494612+0000","last_fullsized":"2023-10-18T19:37:50.494612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495262+0000","last_change":"2023-10-18T19:37:40.162838+0000","last_active":"2023-10-18T19:37:50.495262+0000","last_peered":"2023-10-18T19:37:50.495262+0000","last_clean":"2023-10-18T19:37:50.495262+0000","last_became_active":"2023-10-18T19:37:40.162533+0000","last_became_peered":"2023-10-18T19:37:40.162533+0000","last_unstale":"2023-10-18T19:37:50.495262+0000","last_undegraded":"2023-10-18T19:37:50.495262+0000","last_fullsized":"2023-10-18T19:37:50.495262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222823+0000","last_change":"2023-10-18T19:37:41.175659+0000","last_active":"2023-10-18T19:37:50.222823+0000","last_peered":"2023-10-18T19:37:50.222823+0000","last_clean":"2023-10-18T19:37:50.222823+0000","last_became_active":"2023-10-18T19:37:41.174767+0000","last_became_peered":"2023-10-18T19:37:41.174767+0000","last_unstale":"2023-10-18T19:37:50.222823+0000","last_undegraded":"2023-10-18T19:37:50.222823+0000","last_fullsized":"2023-10-18T19:37:50.222823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495547+0000","last_change":"2023-10-18T19:37:41.169907+0000","last_active":"2023-10-18T19:37:50.495547+0000","last_peered":"2023-10-18T19:37:50.495547+0000","last_clean":"2023-10-18T19:37:50.495547+0000","last_became_active":"2023-10-18T19:37:41.168450+0000","last_became_peered":"2023-10-18T19:37:41.168450+0000","last_unstale":"2023-10-18T19:37:50.495547+0000","last_undegraded":"2023-10-18T19:37:50.495547+0000","last_fullsized":"2023-10-18T19:37:50.495547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495724+0000","last_change":"2023-10-18T19:37:41.167955+0000","last_active":"2023-10-18T19:37:50.495724+0000","last_peered":"2023-10-18T19:37:50.495724+0000","last_clean":"2023-10-18T19:37:50.495724+0000","last_became_active":"2023-10-18T19:37:41.166135+0000","last_became_peered":"2023-10-18T19:37:41.166135+0000","last_unstale":"2023-10-18T19:37:50.495724+0000","last_undegraded":"2023-10-18T19:37:50.495724+0000","last_fullsized":"2023-10-18T19:37:50.495724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496342+0000","last_change":"2023-10-18T19:37:41.173581+0000","last_active":"2023-10-18T19:37:50.496342+0000","last_peered":"2023-10-18T19:37:50.496342+0000","last_clean":"2023-10-18T19:37:50.496342+0000","last_became_active":"2023-10-18T19:37:41.170243+0000","last_became_peered":"2023-10-18T19:37:41.170243+0000","last_unstale":"2023-10-18T19:37:50.496342+0000","last_undegraded":"2023-10-18T19:37:50.496342+0000","last_fullsized":"2023-10-18T19:37:50.496342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304656+0000","last_change":"2023-10-18T19:37:41.169756+0000","last_active":"2023-10-18T19:37:50.304656+0000","last_peered":"2023-10-18T19:37:50.304656+0000","last_clean":"2023-10-18T19:37:50.304656+0000","last_became_active":"2023-10-18T19:37:41.169220+0000","last_became_peered":"2023-10-18T19:37:41.169220+0000","last_unstale":"2023-10-18T19:37:50.304656+0000","last_undegraded":"2023-10-18T19:37:50.304656+0000","last_fullsized":"2023-10-18T19:37:50.304656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304497+0000","last_change":"2023-10-18T19:37:39.155004+0000","last_active":"2023-10-18T19:37:50.304497+0000","last_peered":"2023-10-18T19:37:50.304497+0000","last_clean":"2023-10-18T19:37:50.304497+0000","last_became_active":"2023-10-18T19:37:39.154322+0000","last_became_peered":"2023-10-18T19:37:39.154322+0000","last_unstale":"2023-10-18T19:37:50.304497+0000","last_undegraded":"2023-10-18T19:37:50.304497+0000","last_fullsized":"2023-10-18T19:37:50.304497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496164+0000","last_change":"2023-10-18T19:37:41.163332+0000","last_active":"2023-10-18T19:37:50.496164+0000","last_peered":"2023-10-18T19:37:50.496164+0000","last_clean":"2023-10-18T19:37:50.496164+0000","last_became_active":"2023-10-18T19:37:41.162656+0000","last_became_peered":"2023-10-18T19:37:41.162656+0000","last_unstale":"2023-10-18T19:37:50.496164+0000","last_undegraded":"2023-10-18T19:37:50.496164+0000","last_fullsized":"2023-10-18T19:37:50.496164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495755+0000","last_change":"2023-10-18T19:37:40.182220+0000","last_active":"2023-10-18T19:37:50.495755+0000","last_peered":"2023-10-18T19:37:50.495755+0000","last_clean":"2023-10-18T19:37:50.495755+0000","last_became_active":"2023-10-18T19:37:40.181852+0000","last_became_peered":"2023-10-18T19:37:40.181852+0000","last_unstale":"2023-10-18T19:37:50.495755+0000","last_undegraded":"2023-10-18T19:37:50.495755+0000","last_fullsized":"2023-10-18T19:37:50.495755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497627+0000","last_change":"2023-10-18T19:37:41.180058+0000","last_active":"2023-10-18T19:37:50.497627+0000","last_peered":"2023-10-18T19:37:50.497627+0000","last_clean":"2023-10-18T19:37:50.497627+0000","last_became_active":"2023-10-18T19:37:41.179445+0000","last_became_peered":"2023-10-18T19:37:41.179445+0000","last_unstale":"2023-10-18T19:37:50.497627+0000","last_undegraded":"2023-10-18T19:37:50.497627+0000","last_fullsized":"2023-10-18T19:37:50.497627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223279+0000","last_change":"2023-10-18T19:37:41.181600+0000","last_active":"2023-10-18T19:37:50.223279+0000","last_peered":"2023-10-18T19:37:50.223279+0000","last_clean":"2023-10-18T19:37:50.223279+0000","last_became_active":"2023-10-18T19:37:41.180925+0000","last_became_peered":"2023-10-18T19:37:41.180925+0000","last_unstale":"2023-10-18T19:37:50.223279+0000","last_undegraded":"2023-10-18T19:37:50.223279+0000","last_fullsized":"2023-10-18T19:37:50.223279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496395+0000","last_change":"2023-10-18T19:37:41.164342+0000","last_active":"2023-10-18T19:37:50.496395+0000","last_peered":"2023-10-18T19:37:50.496395+0000","last_clean":"2023-10-18T19:37:50.496395+0000","last_became_active":"2023-10-18T19:37:41.164048+0000","last_became_peered":"2023-10-18T19:37:41.164048+0000","last_unstale":"2023-10-18T19:37:50.496395+0000","last_undegraded":"2023-10-18T19:37:50.496395+0000","last_fullsized":"2023-10-18T19:37:50.496395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497818+0000","last_change":"2023-10-18T19:37:41.180100+0000","last_active":"2023-10-18T19:37:50.497818+0000","last_peered":"2023-10-18T19:37:50.497818+0000","last_clean":"2023-10-18T19:37:50.497818+0000","last_became_active":"2023-10-18T19:37:41.179653+0000","last_became_peered":"2023-10-18T19:37:41.179653+0000","last_unstale":"2023-10-18T19:37:50.497818+0000","last_undegraded":"2023-10-18T19:37:50.497818+0000","last_fullsized":"2023-10-18T19:37:50.497818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494836+0000","last_change":"2023-10-18T19:37:41.163544+0000","last_active":"2023-10-18T19:37:50.494836+0000","last_peered":"2023-10-18T19:37:50.494836+0000","last_clean":"2023-10-18T19:37:50.494836+0000","last_became_active":"2023-10-18T19:37:41.163136+0000","last_became_peered":"2023-10-18T19:37:41.163136+0000","last_unstale":"2023-10-18T19:37:50.494836+0000","last_undegraded":"2023-10-18T19:37:50.494836+0000","last_fullsized":"2023-10-18T19:37:50.494836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494929+0000","last_change":"2023-10-18T19:37:41.174321+0000","last_active":"2023-10-18T19:37:50.494929+0000","last_peered":"2023-10-18T19:37:50.494929+0000","last_clean":"2023-10-18T19:37:50.494929+0000","last_became_active":"2023-10-18T19:37:41.173008+0000","last_became_peered":"2023-10-18T19:37:41.173008+0000","last_unstale":"2023-10-18T19:37:50.494929+0000","last_undegraded":"2023-10-18T19:37:50.494929+0000","last_fullsized":"2023-10-18T19:37:50.494929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495387+0000","last_change":"2023-10-18T19:37:41.159495+0000","last_active":"2023-10-18T19:37:50.495387+0000","last_peered":"2023-10-18T19:37:50.495387+0000","last_clean":"2023-10-18T19:37:50.495387+0000","last_became_active":"2023-10-18T19:37:41.159127+0000","last_became_peered":"2023-10-18T19:37:41.159127+0000","last_unstale":"2023-10-18T19:37:50.495387+0000","last_undegraded":"2023-10-18T19:37:50.495387+0000","last_fullsized":"2023-10-18T19:37:50.495387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303765+0000","last_change":"2023-10-18T19:37:41.169563+0000","last_active":"2023-10-18T19:37:50.303765+0000","last_peered":"2023-10-18T19:37:50.303765+0000","last_clean":"2023-10-18T19:37:50.303765+0000","last_became_active":"2023-10-18T19:37:41.169031+0000","last_became_peered":"2023-10-18T19:37:41.169031+0000","last_unstale":"2023-10-18T19:37:50.303765+0000","last_undegraded":"2023-10-18T19:37:50.303765+0000","last_fullsized":"2023-10-18T19:37:50.303765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222621+0000","last_change":"2023-10-18T19:37:40.179076+0000","last_active":"2023-10-18T19:37:50.222621+0000","last_peered":"2023-10-18T19:37:50.222621+0000","last_clean":"2023-10-18T19:37:50.222621+0000","last_became_active":"2023-10-18T19:37:40.172767+0000","last_became_peered":"2023-10-18T19:37:40.172767+0000","last_unstale":"2023-10-18T19:37:50.222621+0000","last_undegraded":"2023-10-18T19:37:50.222621+0000","last_fullsized":"2023-10-18T19:37:50.222621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303714+0000","last_change":"2023-10-18T19:37:39.150062+0000","last_active":"2023-10-18T19:37:50.303714+0000","last_peered":"2023-10-18T19:37:50.303714+0000","last_clean":"2023-10-18T19:37:50.303714+0000","last_became_active":"2023-10-18T19:37:39.148976+0000","last_became_peered":"2023-10-18T19:37:39.148976+0000","last_unstale":"2023-10-18T19:37:50.303714+0000","last_undegraded":"2023-10-18T19:37:50.303714+0000","last_fullsized":"2023-10-18T19:37:50.303714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304027+0000","last_change":"2023-10-18T19:37:39.156186+0000","last_active":"2023-10-18T19:37:50.304027+0000","last_peered":"2023-10-18T19:37:50.304027+0000","last_clean":"2023-10-18T19:37:50.304027+0000","last_became_active":"2023-10-18T19:37:39.155568+0000","last_became_peered":"2023-10-18T19:37:39.155568+0000","last_unstale":"2023-10-18T19:37:50.304027+0000","last_undegraded":"2023-10-18T19:37:50.304027+0000","last_fullsized":"2023-10-18T19:37:50.304027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496805+0000","last_change":"2023-10-18T19:37:41.168831+0000","last_active":"2023-10-18T19:37:50.496805+0000","last_peered":"2023-10-18T19:37:50.496805+0000","last_clean":"2023-10-18T19:37:50.496805+0000","last_became_active":"2023-10-18T19:37:41.165471+0000","last_became_peered":"2023-10-18T19:37:41.165471+0000","last_unstale":"2023-10-18T19:37:50.496805+0000","last_undegraded":"2023-10-18T19:37:50.496805+0000","last_fullsized":"2023-10-18T19:37:50.496805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496632+0000","last_change":"2023-10-18T19:37:41.165501+0000","last_active":"2023-10-18T19:37:50.496632+0000","last_peered":"2023-10-18T19:37:50.496632+0000","last_clean":"2023-10-18T19:37:50.496632+0000","last_became_active":"2023-10-18T19:37:41.162971+0000","last_became_peered":"2023-10-18T19:37:41.162971+0000","last_unstale":"2023-10-18T19:37:50.496632+0000","last_undegraded":"2023-10-18T19:37:50.496632+0000","last_fullsized":"2023-10-18T19:37:50.496632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497019+0000","last_change":"2023-10-18T19:37:40.182170+0000","last_active":"2023-10-18T19:37:50.497019+0000","last_peered":"2023-10-18T19:37:50.497019+0000","last_clean":"2023-10-18T19:37:50.497019+0000","last_became_active":"2023-10-18T19:37:40.181862+0000","last_became_peered":"2023-10-18T19:37:40.181862+0000","last_unstale":"2023-10-18T19:37:50.497019+0000","last_undegraded":"2023-10-18T19:37:50.497019+0000","last_fullsized":"2023-10-18T19:37:50.497019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222989+0000","last_change":"2023-10-18T19:37:39.149600+0000","last_active":"2023-10-18T19:37:50.222989+0000","last_peered":"2023-10-18T19:37:50.222989+0000","last_clean":"2023-10-18T19:37:50.222989+0000","last_became_active":"2023-10-18T19:37:39.148179+0000","last_became_peered":"2023-10-18T19:37:39.148179+0000","last_unstale":"2023-10-18T19:37:50.222989+0000","last_undegraded":"2023-10-18T19:37:50.222989+0000","last_fullsized":"2023-10-18T19:37:50.222989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496945+0000","last_change":"2023-10-18T19:37:41.166036+0000","last_active":"2023-10-18T19:37:50.496945+0000","last_peered":"2023-10-18T19:37:50.496945+0000","last_clean":"2023-10-18T19:37:50.496945+0000","last_became_active":"2023-10-18T19:37:41.163393+0000","last_became_peered":"2023-10-18T19:37:41.163393+0000","last_unstale":"2023-10-18T19:37:50.496945+0000","last_undegraded":"2023-10-18T19:37:50.496945+0000","last_fullsized":"2023-10-18T19:37:50.496945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497835+0000","last_change":"2023-10-18T19:37:41.184293+0000","last_active":"2023-10-18T19:37:50.497835+0000","last_peered":"2023-10-18T19:37:50.497835+0000","last_clean":"2023-10-18T19:37:50.497835+0000","last_became_active":"2023-10-18T19:37:41.183766+0000","last_became_peered":"2023-10-18T19:37:41.183766+0000","last_unstale":"2023-10-18T19:37:50.497835+0000","last_undegraded":"2023-10-18T19:37:50.497835+0000","last_fullsized":"2023-10-18T19:37:50.497835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304388+0000","last_change":"2023-10-18T19:37:41.167186+0000","last_active":"2023-10-18T19:37:50.304388+0000","last_peered":"2023-10-18T19:37:50.304388+0000","last_clean":"2023-10-18T19:37:50.304388+0000","last_became_active":"2023-10-18T19:37:41.166566+0000","last_became_peered":"2023-10-18T19:37:41.166566+0000","last_unstale":"2023-10-18T19:37:50.304388+0000","last_undegraded":"2023-10-18T19:37:50.304388+0000","last_fullsized":"2023-10-18T19:37:50.304388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496205+0000","last_change":"2023-10-18T19:37:41.163752+0000","last_active":"2023-10-18T19:37:50.496205+0000","last_peered":"2023-10-18T19:37:50.496205+0000","last_clean":"2023-10-18T19:37:50.496205+0000","last_became_active":"2023-10-18T19:37:41.163120+0000","last_became_peered":"2023-10-18T19:37:41.163120+0000","last_unstale":"2023-10-18T19:37:50.496205+0000","last_undegraded":"2023-10-18T19:37:50.496205+0000","last_fullsized":"2023-10-18T19:37:50.496205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497087+0000","last_change":"2023-10-18T19:37:41.183832+0000","last_active":"2023-10-18T19:37:50.497087+0000","last_peered":"2023-10-18T19:37:50.497087+0000","last_clean":"2023-10-18T19:37:50.497087+0000","last_became_active":"2023-10-18T19:37:41.182965+0000","last_became_peered":"2023-10-18T19:37:41.182965+0000","last_unstale":"2023-10-18T19:37:50.497087+0000","last_undegraded":"2023-10-18T19:37:50.497087+0000","last_fullsized":"2023-10-18T19:37:50.497087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303640+0000","last_change":"2023-10-18T19:37:39.152006+0000","last_active":"2023-10-18T19:37:50.303640+0000","last_peered":"2023-10-18T19:37:50.303640+0000","last_clean":"2023-10-18T19:37:50.303640+0000","last_became_active":"2023-10-18T19:37:39.151325+0000","last_became_peered":"2023-10-18T19:37:39.151325+0000","last_unstale":"2023-10-18T19:37:50.303640+0000","last_undegraded":"2023-10-18T19:37:50.303640+0000","last_fullsized":"2023-10-18T19:37:50.303640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.221982+0000","last_change":"2023-10-18T19:37:39.146819+0000","last_active":"2023-10-18T19:37:50.221982+0000","last_peered":"2023-10-18T19:37:50.221982+0000","last_clean":"2023-10-18T19:37:50.221982+0000","last_became_active":"2023-10-18T19:37:39.146123+0000","last_became_peered":"2023-10-18T19:37:39.146123+0000","last_unstale":"2023-10-18T19:37:50.221982+0000","last_undegraded":"2023-10-18T19:37:50.221982+0000","last_fullsized":"2023-10-18T19:37:50.221982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494814+0000","last_change":"2023-10-18T19:37:41.160594+0000","last_active":"2023-10-18T19:37:50.494814+0000","last_peered":"2023-10-18T19:37:50.494814+0000","last_clean":"2023-10-18T19:37:50.494814+0000","last_became_active":"2023-10-18T19:37:41.159675+0000","last_became_peered":"2023-10-18T19:37:41.159675+0000","last_unstale":"2023-10-18T19:37:50.494814+0000","last_undegraded":"2023-10-18T19:37:50.494814+0000","last_fullsized":"2023-10-18T19:37:50.494814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222140+0000","last_change":"2023-10-18T19:37:39.143701+0000","last_active":"2023-10-18T19:37:50.222140+0000","last_peered":"2023-10-18T19:37:50.222140+0000","last_clean":"2023-10-18T19:37:50.222140+0000","last_became_active":"2023-10-18T19:37:39.143358+0000","last_became_peered":"2023-10-18T19:37:39.143358+0000","last_unstale":"2023-10-18T19:37:50.222140+0000","last_undegraded":"2023-10-18T19:37:50.222140+0000","last_fullsized":"2023-10-18T19:37:50.222140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495974+0000","last_change":"2023-10-18T19:37:41.163139+0000","last_active":"2023-10-18T19:37:50.495974+0000","last_peered":"2023-10-18T19:37:50.495974+0000","last_clean":"2023-10-18T19:37:50.495974+0000","last_became_active":"2023-10-18T19:37:41.161539+0000","last_became_peered":"2023-10-18T19:37:41.161539+0000","last_unstale":"2023-10-18T19:37:50.495974+0000","last_undegraded":"2023-10-18T19:37:50.495974+0000","last_fullsized":"2023-10-18T19:37:50.495974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495057+0000","last_change":"2023-10-18T19:37:41.165875+0000","last_active":"2023-10-18T19:37:50.495057+0000","last_peered":"2023-10-18T19:37:50.495057+0000","last_clean":"2023-10-18T19:37:50.495057+0000","last_became_active":"2023-10-18T19:37:41.165604+0000","last_became_peered":"2023-10-18T19:37:41.165604+0000","last_unstale":"2023-10-18T19:37:50.495057+0000","last_undegraded":"2023-10-18T19:37:50.495057+0000","last_fullsized":"2023-10-18T19:37:50.495057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222491+0000","last_change":"2023-10-18T19:37:39.147907+0000","last_active":"2023-10-18T19:37:50.222491+0000","last_peered":"2023-10-18T19:37:50.222491+0000","last_clean":"2023-10-18T19:37:50.222491+0000","last_became_active":"2023-10-18T19:37:39.146960+0000","last_became_peered":"2023-10-18T19:37:39.146960+0000","last_unstale":"2023-10-18T19:37:50.222491+0000","last_undegraded":"2023-10-18T19:37:50.222491+0000","last_fullsized":"2023-10-18T19:37:50.222491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304237+0000","last_change":"2023-10-18T19:37:40.160110+0000","last_active":"2023-10-18T19:37:50.304237+0000","last_peered":"2023-10-18T19:37:50.304237+0000","last_clean":"2023-10-18T19:37:50.304237+0000","last_became_active":"2023-10-18T19:37:40.157972+0000","last_became_peered":"2023-10-18T19:37:40.157972+0000","last_unstale":"2023-10-18T19:37:50.304237+0000","last_undegraded":"2023-10-18T19:37:50.304237+0000","last_fullsized":"2023-10-18T19:37:50.304237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222869+0000","last_change":"2023-10-18T19:37:41.173368+0000","last_active":"2023-10-18T19:37:50.222869+0000","last_peered":"2023-10-18T19:37:50.222869+0000","last_clean":"2023-10-18T19:37:50.222869+0000","last_became_active":"2023-10-18T19:37:41.172145+0000","last_became_peered":"2023-10-18T19:37:41.172145+0000","last_unstale":"2023-10-18T19:37:50.222869+0000","last_undegraded":"2023-10-18T19:37:50.222869+0000","last_fullsized":"2023-10-18T19:37:50.222869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.496409+0000","last_change":"2023-10-18T19:37:41.163519+0000","last_active":"2023-10-18T19:37:50.496409+0000","last_peered":"2023-10-18T19:37:50.496409+0000","last_clean":"2023-10-18T19:37:50.496409+0000","last_became_active":"2023-10-18T19:37:41.162988+0000","last_became_peered":"2023-10-18T19:37:41.162988+0000","last_unstale":"2023-10-18T19:37:50.496409+0000","last_undegraded":"2023-10-18T19:37:50.496409+0000","last_fullsized":"2023-10-18T19:37:50.496409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4020,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222891+0000","last_change":"2023-10-18T19:37:39.149688+0000","last_active":"2023-10-18T19:37:50.222891+0000","last_peered":"2023-10-18T19:37:50.222891+0000","last_clean":"2023-10-18T19:37:50.222891+0000","last_became_active":"2023-10-18T19:37:39.148924+0000","last_became_peered":"2023-10-18T19:37:39.148924+0000","last_unstale":"2023-10-18T19:37:50.222891+0000","last_undegraded":"2023-10-18T19:37:50.222891+0000","last_fullsized":"2023-10-18T19:37:50.222891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304650+0000","last_change":"2023-10-18T19:37:41.169895+0000","last_active":"2023-10-18T19:37:50.304650+0000","last_peered":"2023-10-18T19:37:50.304650+0000","last_clean":"2023-10-18T19:37:50.304650+0000","last_became_active":"2023-10-18T19:37:41.169278+0000","last_became_peered":"2023-10-18T19:37:41.169278+0000","last_unstale":"2023-10-18T19:37:50.304650+0000","last_undegraded":"2023-10-18T19:37:50.304650+0000","last_fullsized":"2023-10-18T19:37:50.304650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304574+0000","last_change":"2023-10-18T19:37:41.167675+0000","last_active":"2023-10-18T19:37:50.304574+0000","last_peered":"2023-10-18T19:37:50.304574+0000","last_clean":"2023-10-18T19:37:50.304574+0000","last_became_active":"2023-10-18T19:37:41.167180+0000","last_became_peered":"2023-10-18T19:37:41.167180+0000","last_unstale":"2023-10-18T19:37:50.304574+0000","last_undegraded":"2023-10-18T19:37:50.304574+0000","last_fullsized":"2023-10-18T19:37:50.304574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304542+0000","last_change":"2023-10-18T19:37:41.167593+0000","last_active":"2023-10-18T19:37:50.304542+0000","last_peered":"2023-10-18T19:37:50.304542+0000","last_clean":"2023-10-18T19:37:50.304542+0000","last_became_active":"2023-10-18T19:37:41.166890+0000","last_became_peered":"2023-10-18T19:37:41.166890+0000","last_unstale":"2023-10-18T19:37:50.304542+0000","last_undegraded":"2023-10-18T19:37:50.304542+0000","last_fullsized":"2023-10-18T19:37:50.304542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223193+0000","last_change":"2023-10-18T19:37:40.173415+0000","last_active":"2023-10-18T19:37:50.223193+0000","last_peered":"2023-10-18T19:37:50.223193+0000","last_clean":"2023-10-18T19:37:50.223193+0000","last_became_active":"2023-10-18T19:37:40.172948+0000","last_became_peered":"2023-10-18T19:37:40.172948+0000","last_unstale":"2023-10-18T19:37:50.223193+0000","last_undegraded":"2023-10-18T19:37:50.223193+0000","last_fullsized":"2023-10-18T19:37:50.223193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223132+0000","last_change":"2023-10-18T19:37:40.177295+0000","last_active":"2023-10-18T19:37:50.223132+0000","last_peered":"2023-10-18T19:37:50.223132+0000","last_clean":"2023-10-18T19:37:50.223132+0000","last_became_active":"2023-10-18T19:37:40.176692+0000","last_became_peered":"2023-10-18T19:37:40.176692+0000","last_unstale":"2023-10-18T19:37:50.223132+0000","last_undegraded":"2023-10-18T19:37:50.223132+0000","last_fullsized":"2023-10-18T19:37:50.223132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222047+0000","last_change":"2023-10-18T19:37:39.143430+0000","last_active":"2023-10-18T19:37:50.222047+0000","last_peered":"2023-10-18T19:37:50.222047+0000","last_clean":"2023-10-18T19:37:50.222047+0000","last_became_active":"2023-10-18T19:37:39.143020+0000","last_became_peered":"2023-10-18T19:37:39.143020+0000","last_unstale":"2023-10-18T19:37:50.222047+0000","last_undegraded":"2023-10-18T19:37:50.222047+0000","last_fullsized":"2023-10-18T19:37:50.222047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222253+0000","last_change":"2023-10-18T19:37:39.148097+0000","last_active":"2023-10-18T19:37:50.222253+0000","last_peered":"2023-10-18T19:37:50.222253+0000","last_clean":"2023-10-18T19:37:50.222253+0000","last_became_active":"2023-10-18T19:37:39.146463+0000","last_became_peered":"2023-10-18T19:37:39.146463+0000","last_unstale":"2023-10-18T19:37:50.222253+0000","last_undegraded":"2023-10-18T19:37:50.222253+0000","last_fullsized":"2023-10-18T19:37:50.222253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495042+0000","last_change":"2023-10-18T19:37:41.165027+0000","last_active":"2023-10-18T19:37:50.495042+0000","last_peered":"2023-10-18T19:37:50.495042+0000","last_clean":"2023-10-18T19:37:50.495042+0000","last_became_active":"2023-10-18T19:37:41.164753+0000","last_became_peered":"2023-10-18T19:37:41.164753+0000","last_unstale":"2023-10-18T19:37:50.495042+0000","last_undegraded":"2023-10-18T19:37:50.495042+0000","last_fullsized":"2023-10-18T19:37:50.495042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.303890+0000","last_change":"2023-10-18T19:37:40.156608+0000","last_active":"2023-10-18T19:37:50.303890+0000","last_peered":"2023-10-18T19:37:50.303890+0000","last_clean":"2023-10-18T19:37:50.303890+0000","last_became_active":"2023-10-18T19:37:40.156273+0000","last_became_peered":"2023-10-18T19:37:40.156273+0000","last_unstale":"2023-10-18T19:37:50.303890+0000","last_undegraded":"2023-10-18T19:37:50.303890+0000","last_fullsized":"2023-10-18T19:37:50.303890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222227+0000","last_change":"2023-10-18T19:37:40.176646+0000","last_active":"2023-10-18T19:37:50.222227+0000","last_peered":"2023-10-18T19:37:50.222227+0000","last_clean":"2023-10-18T19:37:50.222227+0000","last_became_active":"2023-10-18T19:37:40.172763+0000","last_became_peered":"2023-10-18T19:37:40.172763+0000","last_unstale":"2023-10-18T19:37:50.222227+0000","last_undegraded":"2023-10-18T19:37:50.222227+0000","last_fullsized":"2023-10-18T19:37:50.222227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.494952+0000","last_change":"2023-10-18T19:37:41.165840+0000","last_active":"2023-10-18T19:37:50.494952+0000","last_peered":"2023-10-18T19:37:50.494952+0000","last_clean":"2023-10-18T19:37:50.494952+0000","last_became_active":"2023-10-18T19:37:41.163803+0000","last_became_peered":"2023-10-18T19:37:41.163803+0000","last_unstale":"2023-10-18T19:37:50.494952+0000","last_undegraded":"2023-10-18T19:37:50.494952+0000","last_fullsized":"2023-10-18T19:37:50.494952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.495184+0000","last_change":"2023-10-18T19:37:40.173589+0000","last_active":"2023-10-18T19:37:50.495184+0000","last_peered":"2023-10-18T19:37:50.495184+0000","last_clean":"2023-10-18T19:37:50.495184+0000","last_became_active":"2023-10-18T19:37:40.173206+0000","last_became_peered":"2023-10-18T19:37:40.173206+0000","last_unstale":"2023-10-18T19:37:50.495184+0000","last_undegraded":"2023-10-18T19:37:50.495184+0000","last_fullsized":"2023-10-18T19:37:50.495184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222658+0000","last_change":"2023-10-18T19:37:39.149127+0000","last_active":"2023-10-18T19:37:50.222658+0000","last_peered":"2023-10-18T19:37:50.222658+0000","last_clean":"2023-10-18T19:37:50.222658+0000","last_became_active":"2023-10-18T19:37:39.147872+0000","last_became_peered":"2023-10-18T19:37:39.147872+0000","last_unstale":"2023-10-18T19:37:50.222658+0000","last_undegraded":"2023-10-18T19:37:50.222658+0000","last_fullsized":"2023-10-18T19:37:50.222658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222725+0000","last_change":"2023-10-18T19:37:40.176947+0000","last_active":"2023-10-18T19:37:50.222725+0000","last_peered":"2023-10-18T19:37:50.222725+0000","last_clean":"2023-10-18T19:37:50.222725+0000","last_became_active":"2023-10-18T19:37:40.174092+0000","last_became_peered":"2023-10-18T19:37:40.174092+0000","last_unstale":"2023-10-18T19:37:50.222725+0000","last_undegraded":"2023-10-18T19:37:50.222725+0000","last_fullsized":"2023-10-18T19:37:50.222725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.222683+0000","last_change":"2023-10-18T19:37:39.149495+0000","last_active":"2023-10-18T19:37:50.222683+0000","last_peered":"2023-10-18T19:37:50.222683+0000","last_clean":"2023-10-18T19:37:50.222683+0000","last_became_active":"2023-10-18T19:37:39.146736+0000","last_became_peered":"2023-10-18T19:37:39.146736+0000","last_unstale":"2023-10-18T19:37:50.222683+0000","last_undegraded":"2023-10-18T19:37:50.222683+0000","last_fullsized":"2023-10-18T19:37:50.222683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.497127+0000","last_change":"2023-10-18T19:37:41.164895+0000","last_active":"2023-10-18T19:37:50.497127+0000","last_peered":"2023-10-18T19:37:50.497127+0000","last_clean":"2023-10-18T19:37:50.497127+0000","last_became_active":"2023-10-18T19:37:41.164433+0000","last_became_peered":"2023-10-18T19:37:41.164433+0000","last_unstale":"2023-10-18T19:37:50.497127+0000","last_undegraded":"2023-10-18T19:37:50.497127+0000","last_fullsized":"2023-10-18T19:37:50.497127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304571+0000","last_change":"2023-10-18T19:37:39.155328+0000","last_active":"2023-10-18T19:37:50.304571+0000","last_peered":"2023-10-18T19:37:50.304571+0000","last_clean":"2023-10-18T19:37:50.304571+0000","last_became_active":"2023-10-18T19:37:39.154893+0000","last_became_peered":"2023-10-18T19:37:39.154893+0000","last_unstale":"2023-10-18T19:37:50.304571+0000","last_undegraded":"2023-10-18T19:37:50.304571+0000","last_fullsized":"2023-10-18T19:37:50.304571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223223+0000","last_change":"2023-10-18T19:37:41.176991+0000","last_active":"2023-10-18T19:37:50.223223+0000","last_peered":"2023-10-18T19:37:50.223223+0000","last_clean":"2023-10-18T19:37:50.223223+0000","last_became_active":"2023-10-18T19:37:41.176688+0000","last_became_peered":"2023-10-18T19:37:41.176688+0000","last_unstale":"2023-10-18T19:37:50.223223+0000","last_undegraded":"2023-10-18T19:37:50.223223+0000","last_fullsized":"2023-10-18T19:37:50.223223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.223013+0000","last_change":"2023-10-18T19:37:41.176028+0000","last_active":"2023-10-18T19:37:50.223013+0000","last_peered":"2023-10-18T19:37:50.223013+0000","last_clean":"2023-10-18T19:37:50.223013+0000","last_became_active":"2023-10-18T19:37:41.175640+0000","last_became_peered":"2023-10-18T19:37:41.175640+0000","last_unstale":"2023-10-18T19:37:50.223013+0000","last_undegraded":"2023-10-18T19:37:50.223013+0000","last_fullsized":"2023-10-18T19:37:50.223013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304502+0000","last_change":"2023-10-18T19:37:39.154845+0000","last_active":"2023-10-18T19:37:50.304502+0000","last_peered":"2023-10-18T19:37:50.304502+0000","last_clean":"2023-10-18T19:37:50.304502+0000","last_became_active":"2023-10-18T19:37:39.153794+0000","last_became_peered":"2023-10-18T19:37:39.153794+0000","last_unstale":"2023-10-18T19:37:50.304502+0000","last_undegraded":"2023-10-18T19:37:50.304502+0000","last_fullsized":"2023-10-18T19:37:50.304502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:20.796218+0000","last_clean_scrub_stamp":"2023-10-18T19:34:20.796218+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-18T19:37:50.304776+0000","last_change":"2023-10-18T19:37:39.154257+0000","last_active":"2023-10-18T19:37:50.304776+0000","last_peered":"2023-10-18T19:37:50.304776+0000","last_clean":"2023-10-18T19:37:50.304776+0000","last_became_active":"2023-10-18T19:37:39.153936+0000","last_became_peered":"2023-10-18T19:37:39.153936+0000","last_unstale":"2023-10-18T19:37:50.304776+0000","last_undegraded":"2023-10-18T19:37:50.304776+0000","last_fullsized":"2023-10-18T19:37:50.304776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T19:34:19.786275+0000","last_clean_scrub_stamp":"2023-10-18T19:34:19.786275+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8352,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":30,"seq":128849018885,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297516,"kb_used_data":356,"kb_used_omap":14,"kb_used_meta":297137,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":364544,"data_stored":152412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15130,"internal_metadata":304268518},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297500,"kb_used_data":340,"kb_used_omap":8,"kb_used_meta":297143,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":348160,"data_stored":145644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8264,"internal_metadata":304275384},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":0,"up_from":27,"seq":115964116997,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297504,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":297152,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":352256,"data_stored":147400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304283648},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":1,"up_from":28,"seq":120259084293,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297496,"kb_used_data":336,"kb_used_omap":13,"kb_used_meta":297138,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":344064,"data_stored":141856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13606,"internal_metadata":304270042},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T19:37:57.251 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T19:37:57.251 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T19:37:57.251 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T19:37:57.252 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:37:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.471+0000 7fa7311ff700 1 Processor -- start 2023-10-18T19:37:57.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.471+0000 7fa7311ff700 1 -- start start 2023-10-18T19:37:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c0afd50 con 0x7fa72c0af970 2023-10-18T19:37:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0a47a0 con 0x7fa72c0a1790 2023-10-18T19:37:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa7311ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0a3a10 con 0x7fa72c0a4c50 2023-10-18T19:37:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa72ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa72a59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa72b59e700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa72ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55176/0 (socket says 172.21.15.88:55176) 2023-10-18T19:37:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.472+0000 7fa72ad9d700 1 -- 172.21.15.88:0/4164575439 learned_addr learned my addr 172.21.15.88:0/4164575439 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 -- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 msgr2=0x7fa72c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 --2- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c13bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 -- 172.21.15.88:0/4164575439 >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 msgr2=0x7fa72c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 --2- 172.21.15.88:0/4164575439 >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 -- 172.21.15.88:0/4164575439 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c0a32d0 con 0x7fa72c0a1790 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72ad9d700 1 --2- 172.21.15.88:0/4164575439 >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa72a59c700 1 --2- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c136220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa720009760 tx=0x7fa720009060).ready entity=mon.1 client_cookie=3e1cd722b66ddc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa729d9b700 1 -- 172.21.15.88:0/4164575439 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72000d4a0 con 0x7fa72c0a1790 2023-10-18T19:37:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa729d9b700 1 -- 172.21.15.88:0/4164575439 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72000d600 con 0x7fa72c0a1790 2023-10-18T19:37:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.473+0000 7fa729d9b700 1 -- 172.21.15.88:0/4164575439 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72000d980 con 0x7fa72c0a1790 2023-10-18T19:37:57.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 -- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 msgr2=0x7fa72c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 --2- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c136220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa720009760 tx=0x7fa720009060).stop 2023-10-18T19:37:57.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 -- 172.21.15.88:0/4164575439 shutdown_connections 2023-10-18T19:37:57.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 --2- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c13bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 --2- 172.21.15.88:0/4164575439 >> v2:172.21.15.88:3300/0 conn(0x7fa72c0af970 0x7fa72c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 --2- 172.21.15.88:0/4164575439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c136220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 -- 172.21.15.88:0/4164575439 >> 172.21.15.88:0/4164575439 conn(0x7fa72c05eb60 msgr2=0x7fa72c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 -- 172.21.15.88:0/4164575439 shutdown_connections 2023-10-18T19:37:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.474+0000 7fa7311ff700 1 -- 172.21.15.88:0/4164575439 wait complete. 2023-10-18T19:37:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.475+0000 7fa7311ff700 1 Processor -- start 2023-10-18T19:37:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.475+0000 7fa7311ff700 1 -- start start 2023-10-18T19:37:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa72c0af970 0x7fa72c148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:37:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0a9290 con 0x7fa72c0af970 2023-10-18T19:37:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0ab0e0 con 0x7fa72c0a1790 2023-10-18T19:37:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa7311ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0ab2e0 con 0x7fa72c0a4c50 2023-10-18T19:37:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa72ad9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa72ad9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40292/0 (socket says 172.21.15.88:40292) 2023-10-18T19:37:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa72ad9d700 1 -- 172.21.15.88:0/2657285549 learned_addr learned my addr 172.21.15.88:0/2657285549 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:37:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa72b59e700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa72c0af970 0x7fa72c148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.476+0000 7fa72a59c700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:37:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 -- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 msgr2=0x7fa72c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 -- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa72c0af970 msgr2=0x7fa72c148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa72c0af970 0x7fa72c148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 -- 172.21.15.88:0/2657285549 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c009370 con 0x7fa72c0a1790 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa72ad9d700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa71c006d00 tx=0x7fa71c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00c680 con 0x7fa72c0a1790 2023-10-18T19:37:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c00c7e0 con 0x7fa72c0a1790 2023-10-18T19:37:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c00cb60 con 0x7fa72c0a1790 2023-10-18T19:37:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7200092a0 con 0x7fa72c0a1790 2023-10-18T19:37:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.477+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c0a8440 con 0x7fa72c0a1790 2023-10-18T19:37:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.478+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fa71c01b400 con 0x7fa72c0a1790 2023-10-18T19:37:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.478+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c05f270 con 0x7fa72c0a1790 2023-10-18T19:37:57.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.479+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fa71c055d20 con 0x7fa72c0a1790 2023-10-18T19:37:57.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.482+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa71c036100 con 0x7fa72c0a1790 2023-10-18T19:37:57.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.651+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa72c0a3010 con 0x7fa72c0a1790 2023-10-18T19:37:57.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.652+0000 7fa712ffd700 1 -- 172.21.15.88:0/2657285549 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa71c016080 con 0x7fa72c0a1790 2023-10-18T19:37:57.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:37:57.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 >> v1:172.21.15.88:6800/113625 conn(0x7fa718041ce0 legacy=0x7fa7180441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 msgr2=0x7fa72c0a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:37:57.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa71c006d00 tx=0x7fa71c0090f0).stop 2023-10-18T19:37:57.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 shutdown_connections 2023-10-18T19:37:57.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa72c0af970 0x7fa72c148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa72c0a1790 0x7fa72c0a9d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 --2- 172.21.15.88:0/2657285549 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa72c0a4c50 0x7fa72c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:37:57.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 >> 172.21.15.88:0/2657285549 conn(0x7fa72c05eb60 msgr2=0x7fa72c137170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:37:57.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 shutdown_connections 2023-10-18T19:37:57.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:37:57.654+0000 7fa7311ff700 1 -- 172.21.15.88:0/2657285549 wait complete. 2023-10-18T19:37:57.673 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:00.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:00.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.868+0000 7fc7fcbff700 1 Processor -- start 2023-10-18T19:38:00.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 -- start start 2023-10-18T19:38:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 0x7fc7f80a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7f81361c0 0x7fc7f8138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80a3a70 con 0x7fc7f81361c0 2023-10-18T19:38:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f805ed40 con 0x7fc7f805e960 2023-10-18T19:38:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.869+0000 7fc7fcbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8136640 con 0x7fc7f80a4a20 2023-10-18T19:38:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f6d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7f81361c0 0x7fc7f8138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f659c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 0x7fc7f80a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47846/0 (socket says 172.21.15.88:47846) 2023-10-18T19:38:00.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 -- 172.21.15.88:0/3242606049 learned_addr learned my addr 172.21.15.88:0/3242606049 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 -- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 msgr2=0x7fc7f80a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 0x7fc7f80a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 -- 172.21.15.88:0/3242606049 >> v2:172.21.15.88:3300/0 conn(0x7fc7f81361c0 msgr2=0x7fc7f8138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 --2- 172.21.15.88:0/3242606049 >> v2:172.21.15.88:3300/0 conn(0x7fc7f81361c0 0x7fc7f8138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 -- 172.21.15.88:0/3242606049 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80a2ac0 con 0x7fc7f80a4a20 2023-10-18T19:38:00.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f659c700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 0x7fc7f80a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:00.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.870+0000 7fc7f5d9b700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc7ec009830 tx=0x7fc7ec0090f0).ready entity=mon.2 client_cookie=800f811cf38f36a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:00.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7f559a700 1 -- 172.21.15.88:0/3242606049 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00f510 con 0x7fc7f80a4a20 2023-10-18T19:38:00.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7f559a700 1 -- 172.21.15.88:0/3242606049 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00f670 con 0x7fc7f80a4a20 2023-10-18T19:38:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7f559a700 1 -- 172.21.15.88:0/3242606049 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00f9f0 con 0x7fc7f80a4a20 2023-10-18T19:38:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 -- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 msgr2=0x7fc7f8135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc7ec009830 tx=0x7fc7ec0090f0).stop 2023-10-18T19:38:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 -- 172.21.15.88:0/3242606049 shutdown_connections 2023-10-18T19:38:00.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/3242606049 >> v2:172.21.15.88:3300/0 conn(0x7fc7f81361c0 0x7fc7f8138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f805e960 0x7fc7f80a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/3242606049 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f80a4a20 0x7fc7f8135cd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 -- 172.21.15.88:0/3242606049 >> 172.21.15.88:0/3242606049 conn(0x7fc7f8064bb0 msgr2=0x7fc7f805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 -- 172.21.15.88:0/3242606049 shutdown_connections 2023-10-18T19:38:00.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.871+0000 7fc7fcbff700 1 -- 172.21.15.88:0/3242606049 wait complete. 2023-10-18T19:38:00.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.872+0000 7fc7fcbff700 1 Processor -- start 2023-10-18T19:38:00.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 -- start start 2023-10-18T19:38:00.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 0x7fc7f80a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7f81361c0 0x7fc7f80a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:00.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8138050 con 0x7fc7f81361c0 2023-10-18T19:38:00.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80a8210 con 0x7fc7f80a4a20 2023-10-18T19:38:00.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.873+0000 7fc7fcbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80a8e70 con 0x7fc7f805e960 2023-10-18T19:38:00.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f5d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 0x7fc7f80a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47856/0 (socket says 172.21.15.88:47856) 2023-10-18T19:38:00.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 -- 172.21.15.88:0/2302379220 learned_addr learned my addr 172.21.15.88:0/2302379220 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:00.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f6d9d700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7f81361c0 0x7fc7f80a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:00.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 -- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 msgr2=0x7fc7f80a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:00.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 0x7fc7f80a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 -- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7f81361c0 msgr2=0x7fc7f80a65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:00.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7f81361c0 0x7fc7f80a65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:00.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 -- 172.21.15.88:0/2302379220 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e80092a0 con 0x7fc7f805e960 2023-10-18T19:38:00.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f5d9b700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 0x7fc7f80a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:00.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7f659c700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc7e800ea50 tx=0x7fc7e8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:00.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800ee90 con 0x7fc7f805e960 2023-10-18T19:38:00.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.874+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800c8e0 con 0x7fc7f805e960 2023-10-18T19:38:00.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.875+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec009370 con 0x7fc7f805e960 2023-10-18T19:38:00.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.875+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800cc60 con 0x7fc7f805e960 2023-10-18T19:38:00.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.875+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f80a55e0 con 0x7fc7f805e960 2023-10-18T19:38:00.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.876+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f80a9030 con 0x7fc7f805e960 2023-10-18T19:38:00.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.876+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fc7e801b400 con 0x7fc7f805e960 2023-10-18T19:38:00.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.877+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fc7e8055d70 con 0x7fc7f805e960 2023-10-18T19:38:00.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:00.880+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fc7e8036150 con 0x7fc7f805e960 2023-10-18T19:38:01.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.048+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc7f805f270 con 0x7fc7f805e960 2023-10-18T19:38:01.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.048+0000 7fc7e67fc700 1 -- 172.21.15.88:0/2302379220 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc7e8039940 con 0x7fc7f805e960 2023-10-18T19:38:01.052 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:01.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 >> v1:172.21.15.88:6800/113625 conn(0x7fc7d8041ce0 legacy=0x7fc7d80441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:01.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 msgr2=0x7fc7f80a7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:01.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc7e800ea50 tx=0x7fc7e8009060).stop 2023-10-18T19:38:01.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 shutdown_connections 2023-10-18T19:38:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7f81361c0 0x7fc7f80a65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc7f805e960 0x7fc7f80a7880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 --2- 172.21.15.88:0/2302379220 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc7f80a4a20 0x7fc7f80a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:01.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 >> 172.21.15.88:0/2302379220 conn(0x7fc7f8064bb0 msgr2=0x7fc7f813e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 shutdown_connections 2023-10-18T19:38:01.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:01.050+0000 7fc7fcbff700 1 -- 172.21.15.88:0/2302379220 wait complete. 2023-10-18T19:38:01.070 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:04.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:04.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.267+0000 7facbfbff700 1 Processor -- start 2023-10-18T19:38:04.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.267+0000 7facbfbff700 1 -- start start 2023-10-18T19:38:04.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb805e960 0x7facb80a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:04.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbfbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:04.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbfbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb805ed40 con 0x7facb81361c0 2023-10-18T19:38:04.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbfbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80a3a70 con 0x7facb80a4a20 2023-10-18T19:38:04.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb8136640 con 0x7facb805e960 2023-10-18T19:38:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbd19a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbd19a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40336/0 (socket says 172.21.15.88:40336) 2023-10-18T19:38:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbd19a700 1 -- 172.21.15.88:0/1297513946 learned_addr learned my addr 172.21.15.88:0/1297513946 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbe19c700 1 --1- 172.21.15.88:0/1297513946 >> v1:172.21.15.88:6789/0 conn(0x7facb81361c0 0x7facb8138ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33400/0 (socket says 172.21.15.88:33400) 2023-10-18T19:38:04.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.268+0000 7facbd99b700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb805e960 0x7facb80a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:04.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbd19a700 1 -- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb805e960 msgr2=0x7facb80a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:04.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbd19a700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb805e960 0x7facb80a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbc999700 1 -- 172.21.15.88:0/1297513946 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174798014 0 0) 0x7facb805ed40 con 0x7facb81361c0 2023-10-18T19:38:04.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbd19a700 1 -- 172.21.15.88:0/1297513946 >> v1:172.21.15.88:6789/0 conn(0x7facb81361c0 legacy=0x7facb8138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbd19a700 1 -- 172.21.15.88:0/1297513946 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80a2ac0 con 0x7facb80a4a20 2023-10-18T19:38:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbd19a700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7faca8009830 tx=0x7faca80090f0).ready entity=mon.1 client_cookie=d619cf2a187bcc3e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbc999700 1 -- 172.21.15.88:0/1297513946 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800b610 con 0x7facb80a4a20 2023-10-18T19:38:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbc999700 1 -- 172.21.15.88:0/1297513946 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800b770 con 0x7facb80a4a20 2023-10-18T19:38:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbc999700 1 -- 172.21.15.88:0/1297513946 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800bb40 con 0x7facb80a4a20 2023-10-18T19:38:04.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.269+0000 7facbfbff700 1 -- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 msgr2=0x7facb8135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7faca8009830 tx=0x7faca80090f0).stop 2023-10-18T19:38:04.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 -- 172.21.15.88:0/1297513946 shutdown_connections 2023-10-18T19:38:04.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb805e960 0x7facb80a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 --2- 172.21.15.88:0/1297513946 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb80a4a20 0x7facb8135cd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 -- 172.21.15.88:0/1297513946 >> 172.21.15.88:0/1297513946 conn(0x7facb8064bb0 msgr2=0x7facb805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:04.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 -- 172.21.15.88:0/1297513946 shutdown_connections 2023-10-18T19:38:04.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.270+0000 7facbfbff700 1 -- 172.21.15.88:0/1297513946 wait complete. 2023-10-18T19:38:04.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.271+0000 7facbfbff700 1 Processor -- start 2023-10-18T19:38:04.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.271+0000 7facbfbff700 1 -- start start 2023-10-18T19:38:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb80a4a20 0x7facb80a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facb81361c0 0x7facb81391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80a7830 con 0x7facb81361c0 2023-10-18T19:38:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80a7d60 con 0x7facb805e960 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb81489e0 con 0x7facb80a4a20 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbe19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facb81361c0 0x7facb81391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd19a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb80a4a20 0x7facb80a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40344/0 (socket says 172.21.15.88:40344) 2023-10-18T19:38:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 -- 172.21.15.88:0/3144503668 learned_addr learned my addr 172.21.15.88:0/3144503668 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:04.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 -- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb80a4a20 msgr2=0x7facb80a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb80a4a20 0x7facb80a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 -- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facb81361c0 msgr2=0x7facb81391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facb81361c0 0x7facb81391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.272+0000 7facbd99b700 1 -- 172.21.15.88:0/3144503668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009370 con 0x7facb805e960 2023-10-18T19:38:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facbd99b700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7facb400e960 tx=0x7facb4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400c680 con 0x7facb805e960 2023-10-18T19:38:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb400c7e0 con 0x7facb805e960 2023-10-18T19:38:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb8148ca0 con 0x7facb805e960 2023-10-18T19:38:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400cb60 con 0x7facb805e960 2023-10-18T19:38:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.273+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80a6010 con 0x7facb805e960 2023-10-18T19:38:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.274+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80a7680 con 0x7facb805e960 2023-10-18T19:38:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.274+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7facb401b400 con 0x7facb805e960 2023-10-18T19:38:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.275+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7facb4055d00 con 0x7facb805e960 2023-10-18T19:38:04.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.278+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7facb4059030 con 0x7facb805e960 2023-10-18T19:38:04.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.450+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7facb805f270 con 0x7facb805e960 2023-10-18T19:38:04.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.450+0000 7facadffb700 1 -- 172.21.15.88:0/3144503668 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7facb40360e0 con 0x7facb805e960 2023-10-18T19:38:04.453 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 >> v1:172.21.15.88:6800/113625 conn(0x7fac9c041ce0 legacy=0x7fac9c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 msgr2=0x7facb80a6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7facb400e960 tx=0x7facb4009060).stop 2023-10-18T19:38:04.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 shutdown_connections 2023-10-18T19:38:04.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facb81361c0 0x7facb81391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facb805e960 0x7facb80a6fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 --2- 172.21.15.88:0/3144503668 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facb80a4a20 0x7facb80a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:04.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 >> 172.21.15.88:0/3144503668 conn(0x7facb8064bb0 msgr2=0x7facb809f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:04.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 shutdown_connections 2023-10-18T19:38:04.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:04.452+0000 7facbfbff700 1 -- 172.21.15.88:0/3144503668 wait complete. 2023-10-18T19:38:04.472 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:07.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:07.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.667+0000 7fe0bb9ff700 1 Processor -- start 2023-10-18T19:38:07.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.668+0000 7fe0bb9ff700 1 -- start start 2023-10-18T19:38:07.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.668+0000 7fe0bb9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.668+0000 7fe0bb9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 0x7fe0b4069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0bb9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0b406a0f0 0x7fe0b40636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0bb9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b409d700 con 0x7fe0b406a0f0 2023-10-18T19:38:07.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0bb9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4063280 con 0x7fe0b4062ea0 2023-10-18T19:38:07.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0bb9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40aa620 con 0x7fe0b40aa190 2023-10-18T19:38:07.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b979b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b979b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42670/0 (socket says 172.21.15.88:42670) 2023-10-18T19:38:07.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b8f9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 0x7fe0b4069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b979b700 1 -- 172.21.15.88:0/1257174031 learned_addr learned my addr 172.21.15.88:0/1257174031 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:07.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 --2- 172.21.15.88:0/1257174031 >> v2:172.21.15.88:3300/0 conn(0x7fe0b406a0f0 0x7fe0b40636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 -- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 msgr2=0x7fe0b4069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:07.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 0x7fe0b4069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 -- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 msgr2=0x7fe0b409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 -- 172.21.15.88:0/1257174031 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40aa8c0 con 0x7fe0b406a0f0 2023-10-18T19:38:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b979b700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:07.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b8f9a700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 0x7fe0b4069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:07.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.669+0000 7fe0b9f9c700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b406a0f0 0x7fe0b40636e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe0ac009e60 tx=0x7fe0ac009780).ready entity=mon.0 client_cookie=33694ea1bfae58dd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:07.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0abfff700 1 -- 172.21.15.88:0/1257174031 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00e070 con 0x7fe0b406a0f0 2023-10-18T19:38:07.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0abfff700 1 -- 172.21.15.88:0/1257174031 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00bb40 con 0x7fe0b406a0f0 2023-10-18T19:38:07.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0abfff700 1 -- 172.21.15.88:0/1257174031 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac012410 con 0x7fe0b406a0f0 2023-10-18T19:38:07.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b406a0f0 msgr2=0x7fe0b40636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b406a0f0 0x7fe0b40636e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe0ac009e60 tx=0x7fe0ac009780).stop 2023-10-18T19:38:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/1257174031 shutdown_connections 2023-10-18T19:38:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b406a0f0 0x7fe0b40636e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4062ea0 0x7fe0b409db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/1257174031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b40aa190 0x7fe0b4069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/1257174031 >> 172.21.15.88:0/1257174031 conn(0x7fe0b4067ef0 msgr2=0x7fe0b40625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/1257174031 shutdown_connections 2023-10-18T19:38:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.670+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/1257174031 wait complete. 2023-10-18T19:38:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.672+0000 7fe0bb9ff700 1 Processor -- start 2023-10-18T19:38:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.672+0000 7fe0bb9ff700 1 -- start start 2023-10-18T19:38:07.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4092f30 0x7fe0b4097c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b4093ab0 0x7fe0b4093f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4098790 con 0x7fe0b4093ab0 2023-10-18T19:38:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4097440 con 0x7fe0b4092f30 2023-10-18T19:38:07.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0bb9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40933c0 con 0x7fe0b4062ea0 2023-10-18T19:38:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35506/0 (socket says 172.21.15.88:35506) 2023-10-18T19:38:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 -- 172.21.15.88:0/2609948030 learned_addr learned my addr 172.21.15.88:0/2609948030 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b8f9a700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4092f30 0x7fe0b4097c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b9f9c700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b4093ab0 0x7fe0b4093f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:07.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 -- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4092f30 msgr2=0x7fe0b4097c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:07.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4092f30 0x7fe0b4097c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 -- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b4093ab0 msgr2=0x7fe0b4093f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:07.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b4093ab0 0x7fe0b4093f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 -- 172.21.15.88:0/2609948030 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009370 con 0x7fe0b4062ea0 2023-10-18T19:38:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.673+0000 7fe0b979b700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe0b000ea20 tx=0x7fe0b00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.674+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000ee60 con 0x7fe0b4062ea0 2023-10-18T19:38:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.674+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000c850 con 0x7fe0b4062ea0 2023-10-18T19:38:07.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.674+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40092a0 con 0x7fe0b4062ea0 2023-10-18T19:38:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.674+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000cbd0 con 0x7fe0b4062ea0 2023-10-18T19:38:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.674+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac009a20 con 0x7fe0b4062ea0 2023-10-18T19:38:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.675+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b405f270 con 0x7fe0b4062ea0 2023-10-18T19:38:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.675+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fe0b001b400 con 0x7fe0b4062ea0 2023-10-18T19:38:07.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.676+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fe0b0055d90 con 0x7fe0b4062ea0 2023-10-18T19:38:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.679+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe0b0036170 con 0x7fe0b4062ea0 2023-10-18T19:38:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.847+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe0b4063bd0 con 0x7fe0b4062ea0 2023-10-18T19:38:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.847+0000 7fe0a97fa700 1 -- 172.21.15.88:0/2609948030 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe0b0016020 con 0x7fe0b4062ea0 2023-10-18T19:38:07.851 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 >> v1:172.21.15.88:6800/113625 conn(0x7fe098041d10 legacy=0x7fe0980441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 msgr2=0x7fe0b4096bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe0b000ea20 tx=0x7fe0b00090f0).stop 2023-10-18T19:38:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 shutdown_connections 2023-10-18T19:38:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0b4093ab0 0x7fe0b4093f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0b4062ea0 0x7fe0b4096bc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 --2- 172.21.15.88:0/2609948030 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0b4092f30 0x7fe0b4097c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 >> 172.21.15.88:0/2609948030 conn(0x7fe0b4067ef0 msgr2=0x7fe0b40ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 shutdown_connections 2023-10-18T19:38:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:07.849+0000 7fe0bb9ff700 1 -- 172.21.15.88:0/2609948030 wait complete. 2023-10-18T19:38:07.869 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:10.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:11.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.063+0000 7faf03bff700 1 Processor -- start 2023-10-18T19:38:11.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 -- start start 2023-10-18T19:38:11.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0a1790 0x7faefc1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:11.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:11.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0afd50 con 0x7faefc0af970 2023-10-18T19:38:11.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc0a47a0 con 0x7faefc0a1790 2023-10-18T19:38:11.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.064+0000 7faf03bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0a3a10 con 0x7faefc0a4c50 2023-10-18T19:38:11.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0a1790 0x7faefc1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:11.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0219c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:11.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0a1790 0x7faefc1412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45518/0 (socket says 172.21.15.88:45518) 2023-10-18T19:38:11.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 -- 172.21.15.88:0/1908212260 learned_addr learned my addr 172.21.15.88:0/1908212260 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:11.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 -- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 msgr2=0x7faefc1437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:11.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc1437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 -- 172.21.15.88:0/1908212260 >> v1:172.21.15.88:6789/0 conn(0x7faefc0af970 legacy=0x7faefc135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 -- 172.21.15.88:0/1908212260 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0a32d0 con 0x7faefc0a1790 2023-10-18T19:38:11.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0219c700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc1437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:11.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf0119a700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc1412e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7faeec006fd0 tx=0x7faeec0090f0).ready entity=mon.0 client_cookie=253fdcfcf28c01a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.065+0000 7faf00999700 1 -- 172.21.15.88:0/1908212260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00b580 con 0x7faefc0a1790 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf00999700 1 -- 172.21.15.88:0/1908212260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec00b6e0 con 0x7faefc0a1790 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf00999700 1 -- 172.21.15.88:0/1908212260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00ba60 con 0x7faefc0a1790 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 -- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 msgr2=0x7faefc1412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc1412e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7faeec006fd0 tx=0x7faeec0090f0).stop 2023-10-18T19:38:11.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 -- 172.21.15.88:0/1908212260 shutdown_connections 2023-10-18T19:38:11.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc1437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 --2- 172.21.15.88:0/1908212260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc1412e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 -- 172.21.15.88:0/1908212260 >> 172.21.15.88:0/1908212260 conn(0x7faefc05eb60 msgr2=0x7faefc0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:11.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 -- 172.21.15.88:0/1908212260 shutdown_connections 2023-10-18T19:38:11.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.066+0000 7faf03bff700 1 -- 172.21.15.88:0/1908212260 wait complete. 2023-10-18T19:38:11.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.067+0000 7faf03bff700 1 Processor -- start 2023-10-18T19:38:11.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 -- start start 2023-10-18T19:38:11.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc0a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:11.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:11.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7faefc0af970 0x7faefc0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:11.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0a74f0 con 0x7faefc0a1790 2023-10-18T19:38:11.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0a7790 con 0x7faefc0a4c50 2023-10-18T19:38:11.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf03bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0a6820 con 0x7faefc0af970 2023-10-18T19:38:11.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.068+0000 7faf0119a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:11.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0219c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7faefc0af970 0x7faefc0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:11.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:42706/0 (socket says 172.21.15.88:42706) 2023-10-18T19:38:11.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 -- 172.21.15.88:0/2624555673 learned_addr learned my addr 172.21.15.88:0/2624555673 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:11.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0199b700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc0a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:11.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 -- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7faefc0af970 msgr2=0x7faefc0a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7faefc0af970 0x7faefc0a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 -- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 msgr2=0x7faefc0a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc0a8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 -- 172.21.15.88:0/2624555673 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009a20 con 0x7faefc0a4c50 2023-10-18T19:38:11.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf0119a700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faeec009fd0 tx=0x7faeec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:11.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec000bc0 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec00b850 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec009370 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.069+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec000d20 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.070+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc0a7f10 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.071+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc13cb80 con 0x7faefc0a4c50 2023-10-18T19:38:11.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.071+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7faeec01cad0 con 0x7faefc0a4c50 2023-10-18T19:38:11.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.072+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7faeec0577e0 con 0x7faefc0a4c50 2023-10-18T19:38:11.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.075+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7faeec03b2d0 con 0x7faefc0a4c50 2023-10-18T19:38:11.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.250+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faefc0a8100 con 0x7faefc0a4c50 2023-10-18T19:38:11.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.252+0000 7faef1ffb700 1 -- 172.21.15.88:0/2624555673 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7faeec020020 con 0x7faefc0a4c50 2023-10-18T19:38:11.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:11.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.253+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 >> v1:172.21.15.88:6800/113625 conn(0x7faee0041d10 legacy=0x7faee00441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.253+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 msgr2=0x7faefc0a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:11.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.253+0000 7faf03bff700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faeec009fd0 tx=0x7faeec017000).stop 2023-10-18T19:38:11.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 shutdown_connections 2023-10-18T19:38:11.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7faefc0af970 0x7faefc0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0a1790 0x7faefc0a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 --2- 172.21.15.88:0/2624555673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faefc0a4c50 0x7faefc0a9c30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:11.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 >> 172.21.15.88:0/2624555673 conn(0x7faefc05eb60 msgr2=0x7faefc138330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:11.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 shutdown_connections 2023-10-18T19:38:11.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:11.254+0000 7faf03bff700 1 -- 172.21.15.88:0/2624555673 wait complete. 2023-10-18T19:38:11.274 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:14.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:14.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.473+0000 7fea26dff700 1 Processor -- start 2023-10-18T19:38:14.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.473+0000 7fea26dff700 1 -- start start 2023-10-18T19:38:14.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.473+0000 7fea26dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea26dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 0x7fea200a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea26dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea20136130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea26dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200a0fc0 con 0x7fea200a13d0 2023-10-18T19:38:14.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea26dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200af5c0 con 0x7fea20135cb0 2023-10-18T19:38:14.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea26dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea20136620 con 0x7fea200af1e0 2023-10-18T19:38:14.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35516/0 (socket says 172.21.15.88:35516) 2023-10-18T19:38:14.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 -- 172.21.15.88:0/52142805 learned_addr learned my addr 172.21.15.88:0/52142805 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:14.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea2539c700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea20136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea1ffff700 1 --2- 172.21.15.88:0/52142805 >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 0x7fea200a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 -- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 msgr2=0x7fea20136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:14.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea20136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 -- 172.21.15.88:0/52142805 >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 msgr2=0x7fea200a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 --2- 172.21.15.88:0/52142805 >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 0x7fea200a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea24b9b700 1 -- 172.21.15.88:0/52142805 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200a4980 con 0x7fea200af1e0 2023-10-18T19:38:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea2539c700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea20136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.474+0000 7fea1ffff700 1 --2- 172.21.15.88:0/52142805 >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 0x7fea200a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea24b9b700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fea14009830 tx=0x7fea140090f0).ready entity=mon.2 client_cookie=d6e92c58711b8804 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea1f7fe700 1 -- 172.21.15.88:0/52142805 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400b530 con 0x7fea200af1e0 2023-10-18T19:38:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea1f7fe700 1 -- 172.21.15.88:0/52142805 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400b690 con 0x7fea200af1e0 2023-10-18T19:38:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea1f7fe700 1 -- 172.21.15.88:0/52142805 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ba10 con 0x7fea200af1e0 2023-10-18T19:38:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 -- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 msgr2=0x7fea200ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fea14009830 tx=0x7fea140090f0).stop 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 -- 172.21.15.88:0/52142805 shutdown_connections 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200ac830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 --2- 172.21.15.88:0/52142805 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea20136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 --2- 172.21.15.88:0/52142805 >> v2:172.21.15.88:3300/0 conn(0x7fea200a13d0 0x7fea200a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 -- 172.21.15.88:0/52142805 >> 172.21.15.88:0/52142805 conn(0x7fea20064d50 msgr2=0x7fea20062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:14.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.475+0000 7fea26dff700 1 -- 172.21.15.88:0/52142805 shutdown_connections 2023-10-18T19:38:14.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.476+0000 7fea26dff700 1 -- 172.21.15.88:0/52142805 wait complete. 2023-10-18T19:38:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.477+0000 7fea26dff700 1 Processor -- start 2023-10-18T19:38:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.477+0000 7fea26dff700 1 -- start start 2023-10-18T19:38:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea2014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200a9c70 con 0x7fea200a13d0 2023-10-18T19:38:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200ab750 con 0x7fea20135cb0 2023-10-18T19:38:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea26dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea2014b940 con 0x7fea200af1e0 2023-10-18T19:38:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45542/0 (socket says 172.21.15.88:45542) 2023-10-18T19:38:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 -- 172.21.15.88:0/845471358 learned_addr learned my addr 172.21.15.88:0/845471358 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea1ffff700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea2539c700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea2014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 -- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 msgr2=0x7fea200aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 -- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 msgr2=0x7fea2014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea2014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea24b9b700 1 -- 172.21.15.88:0/845471358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0092a0 con 0x7fea200a13d0 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.478+0000 7fea2539c700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea2014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:14.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea24b9b700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fea14009130 tx=0x7fea14015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400bed0 con 0x7fea200a13d0 2023-10-18T19:38:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400b800 con 0x7fea200a13d0 2023-10-18T19:38:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18009a20 con 0x7fea200a13d0 2023-10-18T19:38:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1401c670 con 0x7fea200a13d0 2023-10-18T19:38:14.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.479+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14009370 con 0x7fea200a13d0 2023-10-18T19:38:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.480+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2005f270 con 0x7fea200a13d0 2023-10-18T19:38:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.480+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fea1401ca20 con 0x7fea200a13d0 2023-10-18T19:38:14.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.481+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fea140573c0 con 0x7fea200a13d0 2023-10-18T19:38:14.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.484+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fea1400b970 con 0x7fea200a13d0 2023-10-18T19:38:14.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.655+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fea200afef0 con 0x7fea200a13d0 2023-10-18T19:38:14.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.655+0000 7fea1cff9700 1 -- 172.21.15.88:0/845471358 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fea1400b970 con 0x7fea200a13d0 2023-10-18T19:38:14.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:14.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 >> v1:172.21.15.88:6800/113625 conn(0x7fea04041cb0 legacy=0x7fea04044170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:14.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 msgr2=0x7fea20091c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:14.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fea14009130 tx=0x7fea14015000).stop 2023-10-18T19:38:14.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 shutdown_connections 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea20135cb0 0x7fea2014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea200a13d0 0x7fea20091c10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 --2- 172.21.15.88:0/845471358 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fea200af1e0 0x7fea200aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 >> 172.21.15.88:0/845471358 conn(0x7fea20064d50 msgr2=0x7fea200ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 shutdown_connections 2023-10-18T19:38:14.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:14.657+0000 7fea26dff700 1 -- 172.21.15.88:0/845471358 wait complete. 2023-10-18T19:38:14.677 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:16.260 INFO:tasks.ceph.mds.a.smithi088.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T19:38:16.261 INFO:tasks.ceph.mds.a.smithi088.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T19:38:16.261 INFO:tasks.ceph.mds.a.smithi088.stderr:*** Caught signal (Aborted) ** 2023-10-18T19:38:16.261 INFO:tasks.ceph.mds.a.smithi088.stderr: in thread 7f6685ff6700 thread_name:ms_dispatch 2023-10-18T19:38:16.262 INFO:tasks.ceph.mds.a.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:16.262 INFO:tasks.ceph.mds.a.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f668f812cf0] 2023-10-18T19:38:16.262 INFO:tasks.ceph.mds.a.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:16.262 INFO:tasks.ceph.mds.a.smithi088.stderr: 3: abort() 2023-10-18T19:38:16.262 INFO:tasks.ceph.mds.a.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f668e49009b] 2023-10-18T19:38:16.263 INFO:tasks.ceph.mds.a.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f668e49653c] 2023-10-18T19:38:16.263 INFO:tasks.ceph.mds.a.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f668e496597] 2023-10-18T19:38:16.263 INFO:tasks.ceph.mds.a.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f668e4967f8] 2023-10-18T19:38:16.263 INFO:tasks.ceph.mds.a.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x55666e012b43] 2023-10-18T19:38:16.264 INFO:tasks.ceph.mds.a.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x55666e08789c] 2023-10-18T19:38:16.264 INFO:tasks.ceph.mds.a.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x55666e2cf6a2] 2023-10-18T19:38:16.264 INFO:tasks.ceph.mds.a.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x55666dfec724] 2023-10-18T19:38:16.264 INFO:tasks.ceph.mds.a.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x55666dfee181] 2023-10-18T19:38:16.264 INFO:tasks.ceph.mds.a.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x55666dfbe348] 2023-10-18T19:38:16.265 INFO:tasks.ceph.mds.a.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x55666dfc144d] 2023-10-18T19:38:16.265 INFO:tasks.ceph.mds.a.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55666dfc1fa3] 2023-10-18T19:38:16.265 INFO:tasks.ceph.mds.a.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f66912c14ea] 2023-10-18T19:38:16.265 INFO:tasks.ceph.mds.a.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6691375d51] 2023-10-18T19:38:16.265 INFO:tasks.ceph.mds.a.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f668f8081ca] 2023-10-18T19:38:16.266 INFO:tasks.ceph.mds.a.smithi088.stderr: 19: clone() 2023-10-18T19:38:16.266 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-10-18T19:38:16.260+0000 7f6685ff6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:16.266 INFO:tasks.ceph.mds.a.smithi088.stderr: in thread 7f6685ff6700 thread_name:ms_dispatch 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f668f812cf0] 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: 3: abort() 2023-10-18T19:38:16.267 INFO:tasks.ceph.mds.a.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f668e49009b] 2023-10-18T19:38:16.268 INFO:tasks.ceph.mds.a.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f668e49653c] 2023-10-18T19:38:16.268 INFO:tasks.ceph.mds.a.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f668e496597] 2023-10-18T19:38:16.268 INFO:tasks.ceph.mds.a.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f668e4967f8] 2023-10-18T19:38:16.268 INFO:tasks.ceph.mds.a.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x55666e012b43] 2023-10-18T19:38:16.268 INFO:tasks.ceph.mds.a.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x55666e08789c] 2023-10-18T19:38:16.269 INFO:tasks.ceph.mds.a.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x55666e2cf6a2] 2023-10-18T19:38:16.269 INFO:tasks.ceph.mds.a.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x55666dfec724] 2023-10-18T19:38:16.269 INFO:tasks.ceph.mds.a.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x55666dfee181] 2023-10-18T19:38:16.269 INFO:tasks.ceph.mds.a.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x55666dfbe348] 2023-10-18T19:38:16.269 INFO:tasks.ceph.mds.a.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x55666dfc144d] 2023-10-18T19:38:16.270 INFO:tasks.ceph.mds.a.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55666dfc1fa3] 2023-10-18T19:38:16.271 INFO:tasks.ceph.mds.a.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f66912c14ea] 2023-10-18T19:38:16.271 INFO:tasks.ceph.mds.a.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6691375d51] 2023-10-18T19:38:16.271 INFO:tasks.ceph.mds.a.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f668f8081ca] 2023-10-18T19:38:16.272 INFO:tasks.ceph.mds.a.smithi088.stderr: 19: clone() 2023-10-18T19:38:16.272 INFO:tasks.ceph.mds.a.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:16.272 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.273 INFO:tasks.ceph.mds.a.smithi088.stderr: 0> 2023-10-18T19:38:16.260+0000 7f6685ff6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:16.273 INFO:tasks.ceph.mds.a.smithi088.stderr: in thread 7f6685ff6700 thread_name:ms_dispatch 2023-10-18T19:38:16.273 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.273 INFO:tasks.ceph.mds.a.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:16.274 INFO:tasks.ceph.mds.a.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f668f812cf0] 2023-10-18T19:38:16.274 INFO:tasks.ceph.mds.a.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:16.274 INFO:tasks.ceph.mds.a.smithi088.stderr: 3: abort() 2023-10-18T19:38:16.274 INFO:tasks.ceph.mds.a.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f668e49009b] 2023-10-18T19:38:16.275 INFO:tasks.ceph.mds.a.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f668e49653c] 2023-10-18T19:38:16.275 INFO:tasks.ceph.mds.a.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f668e496597] 2023-10-18T19:38:16.275 INFO:tasks.ceph.mds.a.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f668e4967f8] 2023-10-18T19:38:16.275 INFO:tasks.ceph.mds.a.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x55666e012b43] 2023-10-18T19:38:16.275 INFO:tasks.ceph.mds.a.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x55666e08789c] 2023-10-18T19:38:16.276 INFO:tasks.ceph.mds.a.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x55666e2cf6a2] 2023-10-18T19:38:16.276 INFO:tasks.ceph.mds.a.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x55666dfec724] 2023-10-18T19:38:16.276 INFO:tasks.ceph.mds.a.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x55666dfee181] 2023-10-18T19:38:16.276 INFO:tasks.ceph.mds.a.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x55666dfbe348] 2023-10-18T19:38:16.276 INFO:tasks.ceph.mds.a.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x55666dfc144d] 2023-10-18T19:38:16.277 INFO:tasks.ceph.mds.a.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55666dfc1fa3] 2023-10-18T19:38:16.277 INFO:tasks.ceph.mds.a.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f66912c14ea] 2023-10-18T19:38:16.277 INFO:tasks.ceph.mds.a.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6691375d51] 2023-10-18T19:38:16.277 INFO:tasks.ceph.mds.a.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f668f8081ca] 2023-10-18T19:38:16.277 INFO:tasks.ceph.mds.a.smithi088.stderr: 19: clone() 2023-10-18T19:38:16.278 INFO:tasks.ceph.mds.a.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:16.278 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.278 INFO:tasks.ceph.mds.a.smithi088.stderr: 0> 2023-10-18T19:38:16.260+0000 7f6685ff6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:16.278 INFO:tasks.ceph.mds.a.smithi088.stderr: in thread 7f6685ff6700 thread_name:ms_dispatch 2023-10-18T19:38:16.278 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.279 INFO:tasks.ceph.mds.a.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:16.279 INFO:tasks.ceph.mds.a.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f668f812cf0] 2023-10-18T19:38:16.279 INFO:tasks.ceph.mds.a.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:16.279 INFO:tasks.ceph.mds.a.smithi088.stderr: 3: abort() 2023-10-18T19:38:16.279 INFO:tasks.ceph.mds.a.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f668e49009b] 2023-10-18T19:38:16.280 INFO:tasks.ceph.mds.a.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f668e49653c] 2023-10-18T19:38:16.280 INFO:tasks.ceph.mds.a.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f668e496597] 2023-10-18T19:38:16.280 INFO:tasks.ceph.mds.a.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f668e4967f8] 2023-10-18T19:38:16.280 INFO:tasks.ceph.mds.a.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x55666e012b43] 2023-10-18T19:38:16.280 INFO:tasks.ceph.mds.a.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x55666e08789c] 2023-10-18T19:38:16.281 INFO:tasks.ceph.mds.a.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x55666e2cf6a2] 2023-10-18T19:38:16.281 INFO:tasks.ceph.mds.a.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x55666dfec724] 2023-10-18T19:38:16.281 INFO:tasks.ceph.mds.a.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x55666dfee181] 2023-10-18T19:38:16.281 INFO:tasks.ceph.mds.a.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x55666dfbe348] 2023-10-18T19:38:16.281 INFO:tasks.ceph.mds.a.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x55666dfc144d] 2023-10-18T19:38:16.282 INFO:tasks.ceph.mds.a.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x55666dfc1fa3] 2023-10-18T19:38:16.282 INFO:tasks.ceph.mds.a.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f66912c14ea] 2023-10-18T19:38:16.282 INFO:tasks.ceph.mds.a.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6691375d51] 2023-10-18T19:38:16.282 INFO:tasks.ceph.mds.a.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f668f8081ca] 2023-10-18T19:38:16.283 INFO:tasks.ceph.mds.a.smithi088.stderr: 19: clone() 2023-10-18T19:38:16.283 INFO:tasks.ceph.mds.a.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:16.283 INFO:tasks.ceph.mds.a.smithi088.stderr: 2023-10-18T19:38:16.421 INFO:tasks.ceph.mds.a.smithi088.stderr:daemon-helper: command crashed with signal 6 2023-10-18T19:38:17.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:17.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.872+0000 7f3ebb5ff700 1 Processor -- start 2023-10-18T19:38:17.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.873+0000 7f3ebb5ff700 1 -- start start 2023-10-18T19:38:17.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb40a4a20 0x7f3eb4135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb41361c0 0x7f3eb4138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40a3a70 con 0x7f3eb40a4a20 2023-10-18T19:38:17.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb405ed40 con 0x7f3eb405e960 2023-10-18T19:38:17.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3ebb5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4136670 con 0x7f3eb41361c0 2023-10-18T19:38:17.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb8b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb40a4a20 0x7f3eb4135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb939b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb939b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59602/0 (socket says 172.21.15.88:59602) 2023-10-18T19:38:17.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb939b700 1 -- 172.21.15.88:0/4125884318 learned_addr learned my addr 172.21.15.88:0/4125884318 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:17.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb8b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eb40a4a20 0x7f3eb4135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34922/0 (socket says 172.21.15.88:34922) 2023-10-18T19:38:17.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.874+0000 7f3eb9b9c700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb41361c0 0x7f3eb4138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 -- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb41361c0 msgr2=0x7f3eb4138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:17.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb41361c0 0x7f3eb4138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 -- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 msgr2=0x7f3eb40a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:17.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 -- 172.21.15.88:0/4125884318 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40a2ac0 con 0x7f3eb40a4a20 2023-10-18T19:38:17.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb939b700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:17.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eb8b9a700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb40a4a20 0x7f3eb4135cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3ea4009790 tx=0x7f3ea4009060).ready entity=mon.0 client_cookie=42bf18bb94e663c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:17.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eabfff700 1 -- 172.21.15.88:0/4125884318 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400d4a0 con 0x7f3eb40a4a20 2023-10-18T19:38:17.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eabfff700 1 -- 172.21.15.88:0/4125884318 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400d600 con 0x7f3eb40a4a20 2023-10-18T19:38:17.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.875+0000 7f3eabfff700 1 -- 172.21.15.88:0/4125884318 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400d980 con 0x7f3eb40a4a20 2023-10-18T19:38:17.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb40a4a20 msgr2=0x7f3eb4135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:17.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb40a4a20 0x7f3eb4135cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f3ea4009790 tx=0x7f3ea4009060).stop 2023-10-18T19:38:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/4125884318 shutdown_connections 2023-10-18T19:38:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb41361c0 0x7f3eb4138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb405e960 0x7f3eb40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/4125884318 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb40a4a20 0x7f3eb4135cd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/4125884318 >> 172.21.15.88:0/4125884318 conn(0x7f3eb4064bb0 msgr2=0x7f3eb405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:17.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/4125884318 shutdown_connections 2023-10-18T19:38:17.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.876+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/4125884318 wait complete. 2023-10-18T19:38:17.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.877+0000 7f3ebb5ff700 1 Processor -- start 2023-10-18T19:38:17.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.877+0000 7f3ebb5ff700 1 -- start start 2023-10-18T19:38:17.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb40a4a20 0x7f3eb40a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41361c0 0x7f3eb4134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:17.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41392b0 con 0x7f3eb41361c0 2023-10-18T19:38:17.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40a8140 con 0x7f3eb40a4a20 2023-10-18T19:38:17.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3ebb5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41381b0 con 0x7f3eb405e960 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3eb939b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3eb939b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:51160/0 (socket says 172.21.15.88:51160) 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3eb8b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb40a4a20 0x7f3eb40a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3eb939b700 1 -- 172.21.15.88:0/231380842 learned_addr learned my addr 172.21.15.88:0/231380842 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.878+0000 7f3eb9b9c700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41361c0 0x7f3eb4134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:17.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 -- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb40a4a20 msgr2=0x7f3eb40a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:17.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb40a4a20 0x7f3eb40a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 -- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41361c0 msgr2=0x7f3eb4134800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:17.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41361c0 0x7f3eb4134800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:17.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 -- 172.21.15.88:0/231380842 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0009370 con 0x7f3eb405e960 2023-10-18T19:38:17.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3eb939b700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3eb000ea20 tx=0x7f3eb00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:17.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000ee60 con 0x7f3eb405e960 2023-10-18T19:38:17.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000c850 con 0x7f3eb405e960 2023-10-18T19:38:17.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000cbd0 con 0x7f3eb405e960 2023-10-18T19:38:17.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea40092a0 con 0x7f3eb405e960 2023-10-18T19:38:17.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.879+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40a8e10 con 0x7f3eb405e960 2023-10-18T19:38:17.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.880+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb405f270 con 0x7f3eb405e960 2023-10-18T19:38:17.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.881+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f3eb001b400 con 0x7f3eb405e960 2023-10-18T19:38:17.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.881+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4126+0+0 (secure 0 0 0) 0x7f3eb0055dd0 con 0x7f3eb405e960 2023-10-18T19:38:17.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:17.885+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3eb0036070 con 0x7f3eb405e960 2023-10-18T19:38:18.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.055+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3eb413a920 con 0x7f3eb405e960 2023-10-18T19:38:18.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.056+0000 7f3ea97fa700 1 -- 172.21.15.88:0/231380842 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3eb0016080 con 0x7f3eb405e960 2023-10-18T19:38:18.059 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.057+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 >> v1:172.21.15.88:6800/113625 conn(0x7f3e98041d10 legacy=0x7f3e980441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.057+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 msgr2=0x7f3eb4137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.057+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3eb000ea20 tx=0x7f3eb00090f0).stop 2023-10-18T19:38:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 shutdown_connections 2023-10-18T19:38:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eb41361c0 0x7f3eb4134800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3eb405e960 0x7f3eb4137c00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 --2- 172.21.15.88:0/231380842 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3eb40a4a20 0x7f3eb40a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 >> 172.21.15.88:0/231380842 conn(0x7f3eb4064bb0 msgr2=0x7f3eb413ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 shutdown_connections 2023-10-18T19:38:18.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:18.058+0000 7f3ebb5ff700 1 -- 172.21.15.88:0/231380842 wait complete. 2023-10-18T19:38:18.077 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:21.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.277+0000 7f6e159ff700 1 Processor -- start 2023-10-18T19:38:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.277+0000 7f6e159ff700 1 -- start start 2023-10-18T19:38:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e100af970 0x7f6e10135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a4c50 0x7f6e1013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100afd50 con 0x7f6e100af970 2023-10-18T19:38:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a47a0 con 0x7f6e100a1790 2023-10-18T19:38:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e159ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a3a10 con 0x7f6e100a4c50 2023-10-18T19:38:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59630/0 (socket says 172.21.15.88:59630) 2023-10-18T19:38:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a4c50 0x7f6e1013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 -- 172.21.15.88:0/407810891 learned_addr learned my addr 172.21.15.88:0/407810891 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0effd700 1 --2- 172.21.15.88:0/407810891 >> v2:172.21.15.88:3300/0 conn(0x7f6e100af970 0x7f6e10135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 -- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a4c50 msgr2=0x7f6e1013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 --2- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a4c50 0x7f6e1013bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 -- 172.21.15.88:0/407810891 >> v2:172.21.15.88:3300/0 conn(0x7f6e100af970 msgr2=0x7f6e10135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 --2- 172.21.15.88:0/407810891 >> v2:172.21.15.88:3300/0 conn(0x7f6e100af970 0x7f6e10135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.278+0000 7f6e0e7fc700 1 -- 172.21.15.88:0/407810891 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100a32d0 con 0x7f6e100a1790 2023-10-18T19:38:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e0e7fc700 1 --2- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6e04006fd0 tx=0x7f6e040090f0).ready entity=mon.1 client_cookie=8e050b7ba257e16b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e0dffb700 1 -- 172.21.15.88:0/407810891 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400f510 con 0x7f6e100a1790 2023-10-18T19:38:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e0dffb700 1 -- 172.21.15.88:0/407810891 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400f670 con 0x7f6e100a1790 2023-10-18T19:38:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e0dffb700 1 -- 172.21.15.88:0/407810891 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400f9f0 con 0x7f6e100a1790 2023-10-18T19:38:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e159ff700 1 -- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 msgr2=0x7f6e10136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e159ff700 1 --2- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6e04006fd0 tx=0x7f6e040090f0).stop 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.279+0000 7f6e159ff700 1 -- 172.21.15.88:0/407810891 shutdown_connections 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 --2- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a4c50 0x7f6e1013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 --2- 172.21.15.88:0/407810891 >> v2:172.21.15.88:3300/0 conn(0x7f6e100af970 0x7f6e10135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 --2- 172.21.15.88:0/407810891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100a1790 0x7f6e10136220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 -- 172.21.15.88:0/407810891 >> 172.21.15.88:0/407810891 conn(0x7f6e1005eb60 msgr2=0x7f6e100af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 -- 172.21.15.88:0/407810891 shutdown_connections 2023-10-18T19:38:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.280+0000 7f6e159ff700 1 -- 172.21.15.88:0/407810891 wait complete. 2023-10-18T19:38:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.281+0000 7f6e159ff700 1 Processor -- start 2023-10-18T19:38:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.281+0000 7f6e159ff700 1 -- start start 2023-10-18T19:38:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 0x7f6e10149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 0x7f6e10148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a7220 con 0x7f6e100a4c50 2023-10-18T19:38:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100a7de0 con 0x7f6e100af970 2023-10-18T19:38:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e159ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1013c640 con 0x7f6e100a1790 2023-10-18T19:38:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 0x7f6e10149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:51180/0 (socket says 172.21.15.88:51180) 2023-10-18T19:38:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 0x7f6e10149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34942/0 (socket says 172.21.15.88:34942) 2023-10-18T19:38:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0e7fc700 1 -- 172.21.15.88:0/4103136812 learned_addr learned my addr 172.21.15.88:0/4103136812 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0f7fe700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 0x7f6e10148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 -- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 msgr2=0x7f6e10148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 0x7f6e10148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 -- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 msgr2=0x7f6e10149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 0x7f6e10149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0effd700 1 -- 172.21.15.88:0/4103136812 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04009370 con 0x7f6e100a1790 2023-10-18T19:38:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.282+0000 7f6e0f7fe700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 0x7f6e10148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6e0effd700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6e0000e6f0 tx=0x7f6e00009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00012600 con 0x7f6e100a1790 2023-10-18T19:38:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00012760 con 0x7f6e100a1790 2023-10-18T19:38:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e10149730 con 0x7f6e100a1790 2023-10-18T19:38:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00012ae0 con 0x7f6e100a1790 2023-10-18T19:38:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.283+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e10148db0 con 0x7f6e100a1790 2023-10-18T19:38:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.284+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1005f270 con 0x7f6e100a1790 2023-10-18T19:38:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.284+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f6e0001b400 con 0x7f6e100a1790 2023-10-18T19:38:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.285+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4126+0+0 (secure 0 0 0) 0x7f6e00055c10 con 0x7f6e100a1790 2023-10-18T19:38:21.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.288+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6e00035f80 con 0x7f6e100a1790 2023-10-18T19:38:21.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.459+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6e1013cdf0 con 0x7f6e100a1790 2023-10-18T19:38:21.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.459+0000 7f6df6ffd700 1 -- 172.21.15.88:0/4103136812 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6e000395a0 con 0x7f6e100a1790 2023-10-18T19:38:21.462 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 >> v1:172.21.15.88:6800/113625 conn(0x7f6dfc041ce0 legacy=0x7f6dfc0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 msgr2=0x7f6e1013c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f6e0000e6f0 tx=0x7f6e00009060).stop 2023-10-18T19:38:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 shutdown_connections 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e100af970 0x7f6e10148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e100a1790 0x7f6e1013c150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 --2- 172.21.15.88:0/4103136812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e100a4c50 0x7f6e10149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 >> 172.21.15.88:0/4103136812 conn(0x7f6e1005eb60 msgr2=0x7f6e101381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 shutdown_connections 2023-10-18T19:38:21.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:21.461+0000 7f6e159ff700 1 -- 172.21.15.88:0/4103136812 wait complete. 2023-10-18T19:38:21.481 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:24.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:24.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.676+0000 7fa54e3ff700 1 Processor -- start 2023-10-18T19:38:24.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.676+0000 7fa54e3ff700 1 -- start start 2023-10-18T19:38:24.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54e3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 0x7fa5481412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:24.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54e3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 0x7fa5481437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:24.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54e3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5480afd50 con 0x7fa5480af970 2023-10-18T19:38:24.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54e3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480a47a0 con 0x7fa5480a4c50 2023-10-18T19:38:24.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54e3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480a3a10 con 0x7fa5480a1790 2023-10-18T19:38:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa54c99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 0x7fa5481437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa5477fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 0x7fa5481412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa547fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5480af970 0x7fa548135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44156/0 (socket says 172.21.15.88:44156) 2023-10-18T19:38:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.677+0000 7fa547fff700 1 -- 172.21.15.88:0/606444661 learned_addr learned my addr 172.21.15.88:0/606444661 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:38:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa54c99c700 1 -- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 msgr2=0x7fa5481412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:24.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa54c99c700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 0x7fa5481412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa546ffd700 1 -- 172.21.15.88:0/606444661 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504035926 0 0) 0x7fa5480afd50 con 0x7fa5480af970 2023-10-18T19:38:24.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa54c99c700 1 -- 172.21.15.88:0/606444661 >> v1:172.21.15.88:6789/0 conn(0x7fa5480af970 legacy=0x7fa548135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa54c99c700 1 -- 172.21.15.88:0/606444661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480a32d0 con 0x7fa5480a4c50 2023-10-18T19:38:24.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa5477fe700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 0x7fa5481412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:24.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa54c99c700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 0x7fa5481437e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa540009e90 tx=0x7fa540009780).ready entity=mon.1 client_cookie=ad3b7e0304b0b4c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:24.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa546ffd700 1 -- 172.21.15.88:0/606444661 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000e070 con 0x7fa5480a4c50 2023-10-18T19:38:24.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa546ffd700 1 -- 172.21.15.88:0/606444661 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54000bb60 con 0x7fa5480a4c50 2023-10-18T19:38:24.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.678+0000 7fa546ffd700 1 -- 172.21.15.88:0/606444661 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540012410 con 0x7fa5480a4c50 2023-10-18T19:38:24.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 -- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 msgr2=0x7fa5481437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 0x7fa5481437e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa540009e90 tx=0x7fa540009780).stop 2023-10-18T19:38:24.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 -- 172.21.15.88:0/606444661 shutdown_connections 2023-10-18T19:38:24.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a4c50 0x7fa5481437e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/606444661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480a1790 0x7fa5481412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 -- 172.21.15.88:0/606444661 >> 172.21.15.88:0/606444661 conn(0x7fa54805eb60 msgr2=0x7fa5480af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:24.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 -- 172.21.15.88:0/606444661 shutdown_connections 2023-10-18T19:38:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.679+0000 7fa54e3ff700 1 -- 172.21.15.88:0/606444661 wait complete. 2023-10-18T19:38:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.680+0000 7fa54e3ff700 1 Processor -- start 2023-10-18T19:38:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.680+0000 7fa54e3ff700 1 -- start start 2023-10-18T19:38:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a1790 0x7fa5480ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 0x7fa5481492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480abab0 con 0x7fa5480a4c50 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa548148b20 con 0x7fa5480a1790 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54e3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5480a8b50 con 0x7fa5480af970 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa5477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:24.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa547fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a1790 0x7fa5480ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa5477fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34950/0 (socket says 172.21.15.88:34950) 2023-10-18T19:38:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa5477fe700 1 -- 172.21.15.88:0/2007319052 learned_addr learned my addr 172.21.15.88:0/2007319052 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.681+0000 7fa54c99c700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 0x7fa5481492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 -- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 msgr2=0x7fa5481492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 0x7fa5481492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 -- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a1790 msgr2=0x7fa5480ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a1790 0x7fa5480ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 -- 172.21.15.88:0/2007319052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0092a0 con 0x7fa5480a4c50 2023-10-18T19:38:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa54c99c700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 0x7fa5481492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa5477fe700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa53c00ea50 tx=0x7fa53c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00c640 con 0x7fa5480a4c50 2023-10-18T19:38:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00c7a0 con 0x7fa5480a4c50 2023-10-18T19:38:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00cb20 con 0x7fa5480a4c50 2023-10-18T19:38:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540009a20 con 0x7fa5480a4c50 2023-10-18T19:38:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.682+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa548148700 con 0x7fa5480a4c50 2023-10-18T19:38:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.683+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54805f270 con 0x7fa5480a4c50 2023-10-18T19:38:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.683+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fa53c0123f0 con 0x7fa5480a4c50 2023-10-18T19:38:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.684+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4126+0+0 (secure 0 0 0) 0x7fa53c0558d0 con 0x7fa5480a4c50 2023-10-18T19:38:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.688+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa53c035c40 con 0x7fa5480a4c50 2023-10-18T19:38:24.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.858+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa54813cdf0 con 0x7fa5480a4c50 2023-10-18T19:38:24.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.859+0000 7fa52ffff700 1 -- 172.21.15.88:0/2007319052 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa53c039260 con 0x7fa5480a4c50 2023-10-18T19:38:24.862 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:24.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.860+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 >> v1:172.21.15.88:6800/113625 conn(0x7fa534041ce0 legacy=0x7fa5340441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.860+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 msgr2=0x7fa548148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.860+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa53c00ea50 tx=0x7fa53c009060).stop 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 shutdown_connections 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa5480af970 0x7fa5481492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5480a1790 0x7fa5480ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 --2- 172.21.15.88:0/2007319052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5480a4c50 0x7fa548148dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:24.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 >> 172.21.15.88:0/2007319052 conn(0x7fa54805eb60 msgr2=0x7fa548137e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:24.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 shutdown_connections 2023-10-18T19:38:24.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:24.861+0000 7fa54e3ff700 1 -- 172.21.15.88:0/2007319052 wait complete. 2023-10-18T19:38:24.880 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:27.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:28.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.077+0000 7fef293ff700 1 Processor -- start 2023-10-18T19:38:28.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.077+0000 7fef293ff700 1 -- start start 2023-10-18T19:38:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef241361c0 0x7fef24138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240a3a70 con 0x7fef241361c0 2023-10-18T19:38:28.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2405ed40 con 0x7fef240a4a20 2023-10-18T19:38:28.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef293ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef24136640 con 0x7fef2405e960 2023-10-18T19:38:28.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef227fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef241361c0 0x7fef24138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38586/0 (socket says 172.21.15.88:38586) 2023-10-18T19:38:28.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef241361c0 0x7fef24138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34436/0 (socket says 172.21.15.88:34436) 2023-10-18T19:38:28.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 -- 172.21.15.88:0/2940482279 learned_addr learned my addr 172.21.15.88:0/2940482279 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:28.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef227fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:55402/0 (socket says 172.21.15.88:55402) 2023-10-18T19:38:28.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 -- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 msgr2=0x7fef240a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:28.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 -- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 msgr2=0x7fef24135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:28.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef237fe700 1 -- 172.21.15.88:0/2940482279 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240a2ac0 con 0x7fef241361c0 2023-10-18T19:38:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.078+0000 7fef227fc700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef237fe700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef24138ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fef1c009f50 tx=0x7fef1c009840).ready entity=mon.0 client_cookie=70bd1bd15be7faf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef21ffb700 1 -- 172.21.15.88:0/2940482279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00e070 con 0x7fef241361c0 2023-10-18T19:38:28.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef21ffb700 1 -- 172.21.15.88:0/2940482279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00b940 con 0x7fef241361c0 2023-10-18T19:38:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef21ffb700 1 -- 172.21.15.88:0/2940482279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00bcc0 con 0x7fef241361c0 2023-10-18T19:38:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 -- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 msgr2=0x7fef24138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef24138ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fef1c009f50 tx=0x7fef1c009840).stop 2023-10-18T19:38:28.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 -- 172.21.15.88:0/2940482279 shutdown_connections 2023-10-18T19:38:28.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef24138ac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 --2- 172.21.15.88:0/2940482279 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.079+0000 7fef293ff700 1 -- 172.21.15.88:0/2940482279 >> 172.21.15.88:0/2940482279 conn(0x7fef24064bb0 msgr2=0x7fef2405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:28.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.080+0000 7fef293ff700 1 -- 172.21.15.88:0/2940482279 shutdown_connections 2023-10-18T19:38:28.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.080+0000 7fef293ff700 1 -- 172.21.15.88:0/2940482279 wait complete. 2023-10-18T19:38:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.081+0000 7fef293ff700 1 Processor -- start 2023-10-18T19:38:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.081+0000 7fef293ff700 1 -- start start 2023-10-18T19:38:28.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef240a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240a7dd0 con 0x7fef241361c0 2023-10-18T19:38:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414b9c0 con 0x7fef240a4a20 2023-10-18T19:38:28.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef293ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414b5a0 con 0x7fef2405e960 2023-10-18T19:38:28.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38588/0 (socket says 172.21.15.88:38588) 2023-10-18T19:38:28.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 -- 172.21.15.88:0/1643505156 learned_addr learned my addr 172.21.15.88:0/1643505156 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:28.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef227fc700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef237fe700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef240a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:28.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 -- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 msgr2=0x7fef24138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:28.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 -- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 msgr2=0x7fef240a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:28.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef240a6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef22ffd700 1 -- 172.21.15.88:0/1643505156 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180092a0 con 0x7fef2405e960 2023-10-18T19:38:28.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.082+0000 7fef227fc700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:28.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef22ffd700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fef1400e930 tx=0x7fef14009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:28.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14012600 con 0x7fef2405e960 2023-10-18T19:38:28.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14012760 con 0x7fef2405e960 2023-10-18T19:38:28.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c009ae0 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14012ae0 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.083+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef240a5fc0 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.084+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2405f270 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.084+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fef1401b400 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.085+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4126+0+0 (secure 0 0 0) 0x7fef14055e70 con 0x7fef2405e960 2023-10-18T19:38:28.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.088+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fef14036010 con 0x7fef2405e960 2023-10-18T19:38:28.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.259+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef240a1100 con 0x7fef2405e960 2023-10-18T19:38:28.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.260+0000 7fef0affd700 1 -- 172.21.15.88:0/1643505156 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fef14039800 con 0x7fef2405e960 2023-10-18T19:38:28.262 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:28.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 >> v1:172.21.15.88:6800/113625 conn(0x7fef10041ce0 legacy=0x7fef100441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:28.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 msgr2=0x7fef240a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:28.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fef1400e930 tx=0x7fef14009060).stop 2023-10-18T19:38:28.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 shutdown_connections 2023-10-18T19:38:28.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef241361c0 0x7fef240a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fef2405e960 0x7fef240a7440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 --2- 172.21.15.88:0/1643505156 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fef240a4a20 0x7fef24138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:28.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 >> 172.21.15.88:0/1643505156 conn(0x7fef24064bb0 msgr2=0x7fef24139d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:28.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 shutdown_connections 2023-10-18T19:38:28.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:28.262+0000 7fef293ff700 1 -- 172.21.15.88:0/1643505156 wait complete. 2023-10-18T19:38:28.280 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:31.264 INFO:tasks.ceph.mds.b.smithi088.stderr:terminate called after throwing an instance of 'boost::wrapexcept' 2023-10-18T19:38:31.264 INFO:tasks.ceph.mds.b.smithi088.stderr: what(): boost::bad_get: failed value get using boost::get 2023-10-18T19:38:31.265 INFO:tasks.ceph.mds.b.smithi088.stderr:*** Caught signal (Aborted) ** 2023-10-18T19:38:31.265 INFO:tasks.ceph.mds.b.smithi088.stderr: in thread 7f9b7e1f6700 thread_name:ms_dispatch 2023-10-18T19:38:31.265 INFO:tasks.ceph.mds.b.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:31.266 INFO:tasks.ceph.mds.b.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f9b87a12cf0] 2023-10-18T19:38:31.266 INFO:tasks.ceph.mds.b.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:31.266 INFO:tasks.ceph.mds.b.smithi088.stderr: 3: abort() 2023-10-18T19:38:31.266 INFO:tasks.ceph.mds.b.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f9b8669009b] 2023-10-18T19:38:31.266 INFO:tasks.ceph.mds.b.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f9b8669653c] 2023-10-18T19:38:31.267 INFO:tasks.ceph.mds.b.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f9b86696597] 2023-10-18T19:38:31.267 INFO:tasks.ceph.mds.b.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f9b866967f8] 2023-10-18T19:38:31.267 INFO:tasks.ceph.mds.b.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x561fdb012b43] 2023-10-18T19:38:31.267 INFO:tasks.ceph.mds.b.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x561fdb08789c] 2023-10-18T19:38:31.267 INFO:tasks.ceph.mds.b.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x561fdb2cf6a2] 2023-10-18T19:38:31.268 INFO:tasks.ceph.mds.b.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x561fdafec724] 2023-10-18T19:38:31.268 INFO:tasks.ceph.mds.b.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x561fdafee181] 2023-10-18T19:38:31.268 INFO:tasks.ceph.mds.b.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x561fdafbe348] 2023-10-18T19:38:31.268 INFO:tasks.ceph.mds.b.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x561fdafc144d] 2023-10-18T19:38:31.268 INFO:tasks.ceph.mds.b.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x561fdafc1fa3] 2023-10-18T19:38:31.269 INFO:tasks.ceph.mds.b.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f9b894c14ea] 2023-10-18T19:38:31.269 INFO:tasks.ceph.mds.b.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9b89575d51] 2023-10-18T19:38:31.269 INFO:tasks.ceph.mds.b.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9b87a081ca] 2023-10-18T19:38:31.269 INFO:tasks.ceph.mds.b.smithi088.stderr: 19: clone() 2023-10-18T19:38:31.270 INFO:tasks.ceph.mds.b.smithi088.stderr:2023-10-18T19:38:31.264+0000 7f9b7e1f6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:31.270 INFO:tasks.ceph.mds.b.smithi088.stderr: in thread 7f9b7e1f6700 thread_name:ms_dispatch 2023-10-18T19:38:31.270 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.271 INFO:tasks.ceph.mds.b.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:31.271 INFO:tasks.ceph.mds.b.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f9b87a12cf0] 2023-10-18T19:38:31.271 INFO:tasks.ceph.mds.b.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:31.271 INFO:tasks.ceph.mds.b.smithi088.stderr: 3: abort() 2023-10-18T19:38:31.271 INFO:tasks.ceph.mds.b.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f9b8669009b] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f9b8669653c] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f9b86696597] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f9b866967f8] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x561fdb012b43] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x561fdb08789c] 2023-10-18T19:38:31.272 INFO:tasks.ceph.mds.b.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x561fdb2cf6a2] 2023-10-18T19:38:31.273 INFO:tasks.ceph.mds.b.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x561fdafec724] 2023-10-18T19:38:31.273 INFO:tasks.ceph.mds.b.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x561fdafee181] 2023-10-18T19:38:31.273 INFO:tasks.ceph.mds.b.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x561fdafbe348] 2023-10-18T19:38:31.273 INFO:tasks.ceph.mds.b.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x561fdafc144d] 2023-10-18T19:38:31.273 INFO:tasks.ceph.mds.b.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x561fdafc1fa3] 2023-10-18T19:38:31.274 INFO:tasks.ceph.mds.b.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f9b894c14ea] 2023-10-18T19:38:31.274 INFO:tasks.ceph.mds.b.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9b89575d51] 2023-10-18T19:38:31.274 INFO:tasks.ceph.mds.b.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9b87a081ca] 2023-10-18T19:38:31.274 INFO:tasks.ceph.mds.b.smithi088.stderr: 19: clone() 2023-10-18T19:38:31.274 INFO:tasks.ceph.mds.b.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:31.275 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.275 INFO:tasks.ceph.mds.b.smithi088.stderr: 0> 2023-10-18T19:38:31.264+0000 7f9b7e1f6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:31.275 INFO:tasks.ceph.mds.b.smithi088.stderr: in thread 7f9b7e1f6700 thread_name:ms_dispatch 2023-10-18T19:38:31.275 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.275 INFO:tasks.ceph.mds.b.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:31.276 INFO:tasks.ceph.mds.b.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f9b87a12cf0] 2023-10-18T19:38:31.276 INFO:tasks.ceph.mds.b.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:31.276 INFO:tasks.ceph.mds.b.smithi088.stderr: 3: abort() 2023-10-18T19:38:31.276 INFO:tasks.ceph.mds.b.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f9b8669009b] 2023-10-18T19:38:31.276 INFO:tasks.ceph.mds.b.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f9b8669653c] 2023-10-18T19:38:31.277 INFO:tasks.ceph.mds.b.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f9b86696597] 2023-10-18T19:38:31.277 INFO:tasks.ceph.mds.b.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f9b866967f8] 2023-10-18T19:38:31.277 INFO:tasks.ceph.mds.b.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x561fdb012b43] 2023-10-18T19:38:31.277 INFO:tasks.ceph.mds.b.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x561fdb08789c] 2023-10-18T19:38:31.277 INFO:tasks.ceph.mds.b.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x561fdb2cf6a2] 2023-10-18T19:38:31.278 INFO:tasks.ceph.mds.b.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x561fdafec724] 2023-10-18T19:38:31.278 INFO:tasks.ceph.mds.b.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x561fdafee181] 2023-10-18T19:38:31.278 INFO:tasks.ceph.mds.b.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x561fdafbe348] 2023-10-18T19:38:31.278 INFO:tasks.ceph.mds.b.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x561fdafc144d] 2023-10-18T19:38:31.278 INFO:tasks.ceph.mds.b.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x561fdafc1fa3] 2023-10-18T19:38:31.279 INFO:tasks.ceph.mds.b.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f9b894c14ea] 2023-10-18T19:38:31.279 INFO:tasks.ceph.mds.b.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9b89575d51] 2023-10-18T19:38:31.279 INFO:tasks.ceph.mds.b.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9b87a081ca] 2023-10-18T19:38:31.279 INFO:tasks.ceph.mds.b.smithi088.stderr: 19: clone() 2023-10-18T19:38:31.279 INFO:tasks.ceph.mds.b.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:31.280 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.280 INFO:tasks.ceph.mds.b.smithi088.stderr: 0> 2023-10-18T19:38:31.264+0000 7f9b7e1f6700 -1 *** Caught signal (Aborted) ** 2023-10-18T19:38:31.280 INFO:tasks.ceph.mds.b.smithi088.stderr: in thread 7f9b7e1f6700 thread_name:ms_dispatch 2023-10-18T19:38:31.280 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.280 INFO:tasks.ceph.mds.b.smithi088.stderr: ceph version 16.2.14-100-gb4ddd52c (b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5) pacific (stable) 2023-10-18T19:38:31.281 INFO:tasks.ceph.mds.b.smithi088.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f9b87a12cf0] 2023-10-18T19:38:31.281 INFO:tasks.ceph.mds.b.smithi088.stderr: 2: gsignal() 2023-10-18T19:38:31.281 INFO:tasks.ceph.mds.b.smithi088.stderr: 3: abort() 2023-10-18T19:38:31.281 INFO:tasks.ceph.mds.b.smithi088.stderr: 4: /lib64/libstdc++.so.6(+0x9009b) [0x7f9b8669009b] 2023-10-18T19:38:31.282 INFO:tasks.ceph.mds.b.smithi088.stderr: 5: /lib64/libstdc++.so.6(+0x9653c) [0x7f9b8669653c] 2023-10-18T19:38:31.282 INFO:tasks.ceph.mds.b.smithi088.stderr: 6: /lib64/libstdc++.so.6(+0x96597) [0x7f9b86696597] 2023-10-18T19:38:31.282 INFO:tasks.ceph.mds.b.smithi088.stderr: 7: /lib64/libstdc++.so.6(+0x967f8) [0x7f9b866967f8] 2023-10-18T19:38:31.282 INFO:tasks.ceph.mds.b.smithi088.stderr: 8: ceph-mds(+0x212b43) [0x561fdb012b43] 2023-10-18T19:38:31.282 INFO:tasks.ceph.mds.b.smithi088.stderr: 9: (Option::size_t const md_config_t::get_val(ConfigValues const&, std::basic_string_view >) const+0x5c) [0x561fdb08789c] 2023-10-18T19:38:31.283 INFO:tasks.ceph.mds.b.smithi088.stderr: 10: (SessionMap::SessionMap(MDSRank*)+0x2c2) [0x561fdb2cf6a2] 2023-10-18T19:38:31.283 INFO:tasks.ceph.mds.b.smithi088.stderr: 11: (MDSRank::MDSRank(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x214) [0x561fdafec724] 2023-10-18T19:38:31.283 INFO:tasks.ceph.mds.b.smithi088.stderr: 12: (MDSRankDispatcher::MDSRankDispatcher(int, std::__cxx11::basic_string, std::allocator >, ceph::fair_mutex&, std::shared_ptr&, CommonSafeTimer&, Beacon&, std::unique_ptr >&, Messenger*, MonClient*, MgrClient*, Context*, Context*, boost::asio::io_context&)+0x101) [0x561fdafee181] 2023-10-18T19:38:31.283 INFO:tasks.ceph.mds.b.smithi088.stderr: 13: (MDSDaemon::handle_mds_map(boost::intrusive_ptr const&)+0x1608) [0x561fdafbe348] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 14: (MDSDaemon::handle_core_message(boost::intrusive_ptr const&)+0xcd) [0x561fdafc144d] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 15: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0xc3) [0x561fdafc1fa3] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 16: (DispatchQueue::entry()+0x126a) [0x7f9b894c14ea] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 17: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9b89575d51] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7f9b87a081ca] 2023-10-18T19:38:31.284 INFO:tasks.ceph.mds.b.smithi088.stderr: 19: clone() 2023-10-18T19:38:31.285 INFO:tasks.ceph.mds.b.smithi088.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-18T19:38:31.285 INFO:tasks.ceph.mds.b.smithi088.stderr: 2023-10-18T19:38:31.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:31.445 INFO:tasks.ceph.mds.b.smithi088.stderr:daemon-helper: command crashed with signal 6 2023-10-18T19:38:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.479+0000 7f9328fff700 1 Processor -- start 2023-10-18T19:38:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.479+0000 7f9328fff700 1 -- start start 2023-10-18T19:38:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9328fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 0x7f93240a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:31.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9328fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93240a38c0 0x7f93241362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9328fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932405ed40 con 0x7f93240a34a0 2023-10-18T19:38:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9328fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93240a2fb0 con 0x7f93240a38c0 2023-10-18T19:38:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9328fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240a49d0 con 0x7f932405e960 2023-10-18T19:38:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9321d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f93240a34a0 0x7f9324135be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39646/0 (socket says 172.21.15.88:39646) 2023-10-18T19:38:31.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f932259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 0x7f93240a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:31.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9321d9b700 1 -- 172.21.15.88:0/4044751921 learned_addr learned my addr 172.21.15.88:0/4044751921 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:38:31.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.480+0000 7f9322d9d700 1 --2- 172.21.15.88:0/4044751921 >> v2:172.21.15.88:3300/0 conn(0x7f93240a38c0 0x7f93241362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:31.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f9322d9d700 1 -- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 msgr2=0x7f93240a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:31.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f9322d9d700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 0x7f93240a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f9322d9d700 1 -- 172.21.15.88:0/4044751921 >> v1:172.21.15.88:6789/0 conn(0x7f93240a34a0 legacy=0x7f9324135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f9322d9d700 1 -- 172.21.15.88:0/4044751921 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240a4c70 con 0x7f93240a38c0 2023-10-18T19:38:31.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f932159a700 1 -- 172.21.15.88:0/4044751921 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191501857 0 0) 0x7f932405ed40 con 0x7f93240a34a0 2023-10-18T19:38:31.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f932259c700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 0x7f93240a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f9322d9d700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a38c0 0x7f93241362f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f931c009e60 tx=0x7f931c009780).ready entity=mon.0 client_cookie=aa8c95d7bd5352ec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f932159a700 1 -- 172.21.15.88:0/4044751921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00e070 con 0x7f93240a38c0 2023-10-18T19:38:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f932159a700 1 -- 172.21.15.88:0/4044751921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c00bb60 con 0x7f93240a38c0 2023-10-18T19:38:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.481+0000 7f932159a700 1 -- 172.21.15.88:0/4044751921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c012410 con 0x7f93240a38c0 2023-10-18T19:38:31.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 -- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a38c0 msgr2=0x7f93241362f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a38c0 0x7f93241362f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f931c009e60 tx=0x7f931c009780).stop 2023-10-18T19:38:31.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 -- 172.21.15.88:0/4044751921 shutdown_connections 2023-10-18T19:38:31.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a38c0 0x7f93241362f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 --2- 172.21.15.88:0/4044751921 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f932405e960 0x7f93240a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 -- 172.21.15.88:0/4044751921 >> 172.21.15.88:0/4044751921 conn(0x7f9324064bb0 msgr2=0x7f932405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:31.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 -- 172.21.15.88:0/4044751921 shutdown_connections 2023-10-18T19:38:31.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.482+0000 7f9328fff700 1 -- 172.21.15.88:0/4044751921 wait complete. 2023-10-18T19:38:31.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.483+0000 7f9328fff700 1 Processor -- start 2023-10-18T19:38:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.483+0000 7f9328fff700 1 -- start start 2023-10-18T19:38:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:31.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324137a30 con 0x7f93240a34a0 2023-10-18T19:38:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9324137cd0 con 0x7f93240a38c0 2023-10-18T19:38:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9328fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932409eb40 con 0x7f932405e960 2023-10-18T19:38:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f932259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9321d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9322d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:31.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f932259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38592/0 (socket says 172.21.15.88:38592) 2023-10-18T19:38:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9321d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34466/0 (socket says 172.21.15.88:34466) 2023-10-18T19:38:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f932259c700 1 -- 172.21.15.88:0/283692790 learned_addr learned my addr 172.21.15.88:0/283692790 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:31.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.484+0000 7f9322d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:55438/0 (socket says 172.21.15.88:55438) 2023-10-18T19:38:31.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 -- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 msgr2=0x7f932414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 -- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 msgr2=0x7f93241345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 -- 172.21.15.88:0/283692790 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93140092a0 con 0x7f932405e960 2023-10-18T19:38:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f9321d9b700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f9322d9d700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:31.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f932259c700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f931400ea20 tx=0x7f9314009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:31.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400ee60 con 0x7f932405e960 2023-10-18T19:38:31.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400c8e0 con 0x7f932405e960 2023-10-18T19:38:31.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c009a20 con 0x7f932405e960 2023-10-18T19:38:31.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400cc60 con 0x7f932405e960 2023-10-18T19:38:31.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.485+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9324135160 con 0x7f932405e960 2023-10-18T19:38:31.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.486+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932413a580 con 0x7f932405e960 2023-10-18T19:38:31.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.486+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f931401b400 con 0x7f932405e960 2023-10-18T19:38:31.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.487+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f9314055fb0 con 0x7f932405e960 2023-10-18T19:38:31.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.491+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9314036120 con 0x7f932405e960 2023-10-18T19:38:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.661+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f932405f270 con 0x7f932405e960 2023-10-18T19:38:31.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.662+0000 7f93127fc700 1 -- 172.21.15.88:0/283692790 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9314039910 con 0x7f932405e960 2023-10-18T19:38:31.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:31.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 >> v1:172.21.15.88:6800/113625 conn(0x7f9304041d10 legacy=0x7f93040441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 msgr2=0x7f9324137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:31.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f931400ea20 tx=0x7f9314009060).stop 2023-10-18T19:38:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 shutdown_connections 2023-10-18T19:38:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93240a38c0 0x7f932414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f932405e960 0x7f9324137450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 --2- 172.21.15.88:0/283692790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93240a34a0 0x7f93241345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:31.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 >> 172.21.15.88:0/283692790 conn(0x7f9324064bb0 msgr2=0x7f932409f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 shutdown_connections 2023-10-18T19:38:31.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:31.663+0000 7f9328fff700 1 -- 172.21.15.88:0/283692790 wait complete. 2023-10-18T19:38:31.682 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:34.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:34.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.878+0000 7fb2f3fff700 1 Processor -- start 2023-10-18T19:38:34.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.878+0000 7fb2f3fff700 1 -- start start 2023-10-18T19:38:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.878+0000 7fb2f3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2ec05e960 0x7fb2ec0a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f3fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a3a70 con 0x7fb2ec05e960 2023-10-18T19:38:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f3fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec05ed40 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f3fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec136670 con 0x7fb2ec1361c0 2023-10-18T19:38:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2ec05e960 0x7fb2ec0a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f159a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb2ec05e960 0x7fb2ec0a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34482/0 (socket says 172.21.15.88:34482) 2023-10-18T19:38:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 -- 172.21.15.88:0/3402682128 learned_addr learned my addr 172.21.15.88:0/3402682128 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f259c700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 -- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 msgr2=0x7fb2ec138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:34.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 -- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 msgr2=0x7fb2ec135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:34.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 -- 172.21.15.88:0/3402682128 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0a2ac0 con 0x7fb2ec05e960 2023-10-18T19:38:34.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f159a700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:34.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f259c700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:34.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.879+0000 7fb2f1d9b700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a3580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb2e8009830 tx=0x7fb2e80090f0).ready entity=mon.0 client_cookie=20f3f253db856bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:34.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f0d99700 1 -- 172.21.15.88:0/3402682128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800f510 con 0x7fb2ec05e960 2023-10-18T19:38:34.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f0d99700 1 -- 172.21.15.88:0/3402682128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e800f670 con 0x7fb2ec05e960 2023-10-18T19:38:34.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f0d99700 1 -- 172.21.15.88:0/3402682128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800f9f0 con 0x7fb2ec05e960 2023-10-18T19:38:34.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 msgr2=0x7fb2ec0a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:34.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a3580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb2e8009830 tx=0x7fb2e80090f0).stop 2023-10-18T19:38:34.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3402682128 shutdown_connections 2023-10-18T19:38:34.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a3580 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3402682128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3402682128 >> 172.21.15.88:0/3402682128 conn(0x7fb2ec064bb0 msgr2=0x7fb2ec05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:34.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3402682128 shutdown_connections 2023-10-18T19:38:34.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.880+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3402682128 wait complete. 2023-10-18T19:38:34.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.882+0000 7fb2f3fff700 1 Processor -- start 2023-10-18T19:38:34.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.882+0000 7fb2f3fff700 1 -- start start 2023-10-18T19:38:34.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.882+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.882+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.882+0000 7fb2f3fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:34.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f3fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a8430 con 0x7fb2ec05e960 2023-10-18T19:38:34.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f3fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a8e20 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f3fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0a5540 con 0x7fb2ec1361c0 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:55454/0 (socket says 172.21.15.88:55454) 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 -- 172.21.15.88:0/3183298004 learned_addr learned my addr 172.21.15.88:0/3183298004 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f259c700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 -- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 msgr2=0x7fb2ec14bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec14bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 -- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 msgr2=0x7fb2ec0a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 -- 172.21.15.88:0/3183298004 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0092a0 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.883+0000 7fb2f159a700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb2dc00e9d0 tx=0x7fb2dc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:34.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.884+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00eec0 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.884+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00c8e0 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.884+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00cc60 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.884+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4009a20 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.884+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e8009370 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.885+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec05f270 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.885+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb2dc01b400 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.886+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7fb2dc055ff0 con 0x7fb2ec0a4a20 2023-10-18T19:38:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:34.889+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb2dc07d000 con 0x7fb2ec0a4a20 2023-10-18T19:38:35.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.056+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2ec13cb90 con 0x7fb2ec0a4a20 2023-10-18T19:38:35.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.056+0000 7fb2e1ffb700 1 -- 172.21.15.88:0/3183298004 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb2dc0160b0 con 0x7fb2ec0a4a20 2023-10-18T19:38:35.058 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:35.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 >> v1:172.21.15.88:6800/113625 conn(0x7fb2d0041d10 legacy=0x7fb2d00441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:35.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 msgr2=0x7fb2ec14ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:35.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb2dc00e9d0 tx=0x7fb2dc009060).stop 2023-10-18T19:38:35.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 shutdown_connections 2023-10-18T19:38:35.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb2ec1361c0 0x7fb2ec14bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2ec05e960 0x7fb2ec0a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 --2- 172.21.15.88:0/3183298004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb2ec0a4a20 0x7fb2ec14ba90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 >> 172.21.15.88:0/3183298004 conn(0x7fb2ec064bb0 msgr2=0x7fb2ec0a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 shutdown_connections 2023-10-18T19:38:35.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:35.058+0000 7fb2f3fff700 1 -- 172.21.15.88:0/3183298004 wait complete. 2023-10-18T19:38:35.077 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:38.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.272+0000 7feae31ff700 1 Processor -- start 2023-10-18T19:38:38.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.272+0000 7feae31ff700 1 -- start start 2023-10-18T19:38:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae31ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feadc06a310 0x7feadc136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae31ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae31ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0ab970 con 0x7feadc0ab590 2023-10-18T19:38:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae31ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc135a50 con 0x7feadc06a310 2023-10-18T19:38:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae31ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feadc135cf0 con 0x7feadc06aa30 2023-10-18T19:38:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feadc06a310 0x7feadc136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feadc06a310 0x7feadc136210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54264/0 (socket says 172.21.15.88:54264) 2023-10-18T19:38:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feae179c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 -- 172.21.15.88:0/1551887921 learned_addr learned my addr 172.21.15.88:0/1551887921 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 -- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 msgr2=0x7feadc136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 --2- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 -- 172.21.15.88:0/1551887921 >> v1:172.21.15.88:6789/0 conn(0x7feadc0ab590 legacy=0x7feadc139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.273+0000 7feadbfff700 1 -- 172.21.15.88:0/1551887921 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc139d40 con 0x7feadc06a310 2023-10-18T19:38:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feadbfff700 1 --2- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc06a310 0x7feadc136210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7feac8006fd0 tx=0x7feac80090f0).ready entity=mon.0 client_cookie=172156cd3f0e9948 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feadb7fe700 1 -- 172.21.15.88:0/1551887921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800b580 con 0x7feadc06a310 2023-10-18T19:38:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feadb7fe700 1 -- 172.21.15.88:0/1551887921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800b6e0 con 0x7feadc06a310 2023-10-18T19:38:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feadb7fe700 1 -- 172.21.15.88:0/1551887921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac800ba60 con 0x7feadc06a310 2023-10-18T19:38:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 -- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc06a310 msgr2=0x7feadc136210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 --2- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc06a310 0x7feadc136210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7feac8006fd0 tx=0x7feac80090f0).stop 2023-10-18T19:38:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 -- 172.21.15.88:0/1551887921 shutdown_connections 2023-10-18T19:38:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 --2- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 --2- 172.21.15.88:0/1551887921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc06a310 0x7feadc136210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 -- 172.21.15.88:0/1551887921 >> 172.21.15.88:0/1551887921 conn(0x7feadc05eb30 msgr2=0x7feadc0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.274+0000 7feae31ff700 1 -- 172.21.15.88:0/1551887921 shutdown_connections 2023-10-18T19:38:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.275+0000 7feae31ff700 1 -- 172.21.15.88:0/1551887921 wait complete. 2023-10-18T19:38:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.276+0000 7feae31ff700 1 Processor -- start 2023-10-18T19:38:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.276+0000 7feae31ff700 1 -- start start 2023-10-18T19:38:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feadc06a310 0x7feadc138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 0x7feadc096e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc09a580 con 0x7feadc0ab590 2023-10-18T19:38:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc09a230 con 0x7feadc06a310 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae31ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0989f0 con 0x7feadc06aa30 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae0f9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feadc06a310 0x7feadc138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae179c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 0x7feadc096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:50834/0 (socket says 172.21.15.88:50834) 2023-10-18T19:38:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 -- 172.21.15.88:0/1535695730 learned_addr learned my addr 172.21.15.88:0/1535695730 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 -- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feadc06a310 msgr2=0x7feadc138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feadc06a310 0x7feadc138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 -- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 msgr2=0x7feadc096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 0x7feadc096e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feadbfff700 1 -- 172.21.15.88:0/1535695730 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8009370 con 0x7feadc06aa30 2023-10-18T19:38:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.277+0000 7feae179c700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 0x7feadc096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7feadbfff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7feac8009130 tx=0x7feac8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8000bc0 con 0x7feadc06aa30 2023-10-18T19:38:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800b850 con 0x7feadc06aa30 2023-10-18T19:38:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc09a760 con 0x7feadc06aa30 2023-10-18T19:38:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8000d20 con 0x7feadc06aa30 2023-10-18T19:38:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.278+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc138c00 con 0x7feadc06aa30 2023-10-18T19:38:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.279+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc135730 con 0x7feadc06aa30 2023-10-18T19:38:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.279+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7feac801caf0 con 0x7feadc06aa30 2023-10-18T19:38:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.280+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7feac80578f0 con 0x7feadc06aa30 2023-10-18T19:38:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.283+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7feac80262d0 con 0x7feadc06aa30 2023-10-18T19:38:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.449+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feadc0a9a00 con 0x7feadc06aa30 2023-10-18T19:38:38.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.449+0000 7fead8ff9700 1 -- 172.21.15.88:0/1535695730 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7feac8020030 con 0x7feadc06aa30 2023-10-18T19:38:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 >> v1:172.21.15.88:6800/113625 conn(0x7feac0041ce0 legacy=0x7feac00441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 msgr2=0x7feadc09e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7feac8009130 tx=0x7feac8017000).stop 2023-10-18T19:38:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 shutdown_connections 2023-10-18T19:38:38.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feadc0ab590 0x7feadc096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feadc06a310 0x7feadc138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 --2- 172.21.15.88:0/1535695730 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7feadc06aa30 0x7feadc09e9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 >> 172.21.15.88:0/1535695730 conn(0x7feadc05eb30 msgr2=0x7feadc135e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 shutdown_connections 2023-10-18T19:38:38.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:38.451+0000 7feae31ff700 1 -- 172.21.15.88:0/1535695730 wait complete. 2023-10-18T19:38:38.470 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:41.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:41.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.667+0000 7f5d307ff700 1 Processor -- start 2023-10-18T19:38:41.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.667+0000 7f5d307ff700 1 -- start start 2023-10-18T19:38:41.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d307ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d280ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:41.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d307ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 0x7f5d28136130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:41.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d307ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d280a0fc0 con 0x7f5d280af1e0 2023-10-18T19:38:41.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d307ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280af5c0 con 0x7f5d28135cb0 2023-10-18T19:38:41.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d307ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28136620 con 0x7f5d280a13d0 2023-10-18T19:38:41.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2dd9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d280ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:41.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2e59b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5d280af1e0 0x7f5d280a3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49694/0 (socket says 172.21.15.88:49694) 2023-10-18T19:38:41.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2e59b700 1 -- 172.21.15.88:0/4129377650 learned_addr learned my addr 172.21.15.88:0/4129377650 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:38:41.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2ed9c700 1 --2- 172.21.15.88:0/4129377650 >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 0x7f5d28136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:41.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/4129377650 >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 msgr2=0x7f5d28136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:41.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2dd9a700 1 --2- 172.21.15.88:0/4129377650 >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 0x7f5d28136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/4129377650 >> v1:172.21.15.88:6789/0 conn(0x7f5d280af1e0 legacy=0x7f5d280a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.668+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/4129377650 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280a4980 con 0x7f5d280a13d0 2023-10-18T19:38:41.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d2ed9c700 1 --2- 172.21.15.88:0/4129377650 >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 0x7f5d28136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:41.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d2dd9a700 1 --2- 172.21.15.88:0/4129377650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d280ac830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5d18009760 tx=0x7f5d18009060).ready entity=mon.1 client_cookie=249c412c8a854537 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:41.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d2d599700 1 -- 172.21.15.88:0/4129377650 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800b590 con 0x7f5d280a13d0 2023-10-18T19:38:41.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d2d599700 1 -- 172.21.15.88:0/4129377650 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800b6f0 con 0x7f5d280a13d0 2023-10-18T19:38:41.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d2d599700 1 -- 172.21.15.88:0/4129377650 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800ba70 con 0x7f5d280a13d0 2023-10-18T19:38:41.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 -- 172.21.15.88:0/4129377650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 msgr2=0x7f5d280ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 --2- 172.21.15.88:0/4129377650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d280ac830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5d18009760 tx=0x7f5d18009060).stop 2023-10-18T19:38:41.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 -- 172.21.15.88:0/4129377650 shutdown_connections 2023-10-18T19:38:41.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 --2- 172.21.15.88:0/4129377650 >> v2:172.21.15.88:3300/0 conn(0x7f5d28135cb0 0x7f5d28136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 --2- 172.21.15.88:0/4129377650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d280ac830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.669+0000 7f5d307ff700 1 -- 172.21.15.88:0/4129377650 >> 172.21.15.88:0/4129377650 conn(0x7f5d28064d50 msgr2=0x7f5d28062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:41.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.670+0000 7f5d307ff700 1 -- 172.21.15.88:0/4129377650 shutdown_connections 2023-10-18T19:38:41.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.670+0000 7f5d307ff700 1 -- 172.21.15.88:0/4129377650 wait complete. 2023-10-18T19:38:41.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.671+0000 7f5d307ff700 1 Processor -- start 2023-10-18T19:38:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.671+0000 7f5d307ff700 1 -- start start 2023-10-18T19:38:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d281391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:41.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5d28135cb0 0x7f5d281332d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28135430 con 0x7f5d280af1e0 2023-10-18T19:38:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814c960 con 0x7f5d280a13d0 2023-10-18T19:38:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d307ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2813cc50 con 0x7f5d28135cb0 2023-10-18T19:38:41.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:41.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2ed9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5d28135cb0 0x7f5d281332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:41.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54298/0 (socket says 172.21.15.88:54298) 2023-10-18T19:38:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/3015028172 learned_addr learned my addr 172.21.15.88:0/3015028172 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2e59b700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d281391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:41.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5d28135cb0 msgr2=0x7f5d281332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5d28135cb0 0x7f5d281332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 msgr2=0x7f5d281391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d281391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2dd9a700 1 -- 172.21.15.88:0/3015028172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009a20 con 0x7f5d280af1e0 2023-10-18T19:38:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.672+0000 7f5d2e59b700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d281391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d2dd9a700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5d28136760 tx=0x7f5d18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800b860 con 0x7f5d280af1e0 2023-10-18T19:38:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800b9c0 con 0x7f5d280af1e0 2023-10-18T19:38:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d180092a0 con 0x7f5d280af1e0 2023-10-18T19:38:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1801b660 con 0x7f5d280af1e0 2023-10-18T19:38:41.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.673+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28134650 con 0x7f5d280af1e0 2023-10-18T19:38:41.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.674+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2805f270 con 0x7f5d280af1e0 2023-10-18T19:38:41.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.674+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f5d1801ba50 con 0x7f5d280af1e0 2023-10-18T19:38:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.675+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f5d18057100 con 0x7f5d280af1e0 2023-10-18T19:38:41.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.678+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5d1803afd0 con 0x7f5d280af1e0 2023-10-18T19:38:41.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.848+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5d280afef0 con 0x7f5d280af1e0 2023-10-18T19:38:41.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.849+0000 7f5d1e7fc700 1 -- 172.21.15.88:0/3015028172 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5d1803abc0 con 0x7f5d280af1e0 2023-10-18T19:38:41.852 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 >> v1:172.21.15.88:6800/113625 conn(0x7f5d0c041d10 legacy=0x7f5d0c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 msgr2=0x7f5d2814bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f5d28136760 tx=0x7f5d18017000).stop 2023-10-18T19:38:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 shutdown_connections 2023-10-18T19:38:41.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5d28135cb0 0x7f5d281332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5d280a13d0 0x7f5d281391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 --2- 172.21.15.88:0/3015028172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d280af1e0 0x7f5d2814bf90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:41.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.850+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 >> 172.21.15.88:0/3015028172 conn(0x7f5d28064d50 msgr2=0x7f5d281428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:41.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.851+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 shutdown_connections 2023-10-18T19:38:41.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:41.851+0000 7f5d307ff700 1 -- 172.21.15.88:0/3015028172 wait complete. 2023-10-18T19:38:41.871 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:44.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:45.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.066+0000 7fb9303ff700 1 Processor -- start 2023-10-18T19:38:45.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.066+0000 7fb9303ff700 1 -- start start 2023-10-18T19:38:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb9303ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb928135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:45.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb9303ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9280a1790 0x7fb928136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb9303ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9280afd50 con 0x7fb9280a4c50 2023-10-18T19:38:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb9303ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280a47a0 con 0x7fb9280a1790 2023-10-18T19:38:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb9303ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280a3a10 con 0x7fb9280af970 2023-10-18T19:38:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb92d99a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9280a1790 0x7fb928136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:45.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb92e19b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb928135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb92d99a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9280a1790 0x7fb928136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54306/0 (socket says 172.21.15.88:54306) 2023-10-18T19:38:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb92e19b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb928135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:48924/0 (socket says 172.21.15.88:48924) 2023-10-18T19:38:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.067+0000 7fb92d99a700 1 -- 172.21.15.88:0/4009912451 learned_addr learned my addr 172.21.15.88:0/4009912451 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d99a700 1 -- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 msgr2=0x7fb928135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d99a700 1 --2- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb928135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d99a700 1 -- 172.21.15.88:0/4009912451 >> v1:172.21.15.88:6789/0 conn(0x7fb9280a4c50 legacy=0x7fb92813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d99a700 1 -- 172.21.15.88:0/4009912451 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280a32d0 con 0x7fb9280a1790 2023-10-18T19:38:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d99a700 1 --2- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb928136220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb918006fd0 tx=0x7fb9180090f0).ready entity=mon.0 client_cookie=a4218e931dab250a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d199700 1 -- 172.21.15.88:0/4009912451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800b580 con 0x7fb9280a1790 2023-10-18T19:38:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d199700 1 -- 172.21.15.88:0/4009912451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800b6e0 con 0x7fb9280a1790 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb92d199700 1 -- 172.21.15.88:0/4009912451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800ba60 con 0x7fb9280a1790 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.068+0000 7fb9303ff700 1 -- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 msgr2=0x7fb928136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 --2- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb928136220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb918006fd0 tx=0x7fb9180090f0).stop 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 -- 172.21.15.88:0/4009912451 shutdown_connections 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 --2- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb928135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 --2- 172.21.15.88:0/4009912451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb928136220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 -- 172.21.15.88:0/4009912451 >> 172.21.15.88:0/4009912451 conn(0x7fb92805eb60 msgr2=0x7fb9280af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 -- 172.21.15.88:0/4009912451 shutdown_connections 2023-10-18T19:38:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.069+0000 7fb9303ff700 1 -- 172.21.15.88:0/4009912451 wait complete. 2023-10-18T19:38:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.070+0000 7fb9303ff700 1 Processor -- start 2023-10-18T19:38:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.070+0000 7fb9303ff700 1 -- start start 2023-10-18T19:38:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb9280a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb9280a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb928148fc0 con 0x7fb9280a1790 2023-10-18T19:38:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280a6560 con 0x7fb9280af970 2023-10-18T19:38:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb9303ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280a7a90 con 0x7fb9280a4c50 2023-10-18T19:38:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb92d99a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb92d99a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:50848/0 (socket says 172.21.15.88:50848) 2023-10-18T19:38:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb92e19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb9280a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb92d99a700 1 -- 172.21.15.88:0/954484597 learned_addr learned my addr 172.21.15.88:0/954484597 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.071+0000 7fb92e99c700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb9280a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 -- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 msgr2=0x7fb9280a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb9280a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 -- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 msgr2=0x7fb9280a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb9280a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 -- 172.21.15.88:0/954484597 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009370 con 0x7fb9280a4c50 2023-10-18T19:38:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92e19b700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb9280a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb92d99a700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb918011000 tx=0x7fb918017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918000bc0 con 0x7fb9280a4c50 2023-10-18T19:38:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800b850 con 0x7fb9280a4c50 2023-10-18T19:38:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9280a6790 con 0x7fb9280a4c50 2023-10-18T19:38:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918000d20 con 0x7fb9280a4c50 2023-10-18T19:38:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.072+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9281498e0 con 0x7fb9280a4c50 2023-10-18T19:38:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.073+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92805f270 con 0x7fb9280a4c50 2023-10-18T19:38:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.073+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fb91801c900 con 0x7fb9280a4c50 2023-10-18T19:38:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.074+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7fb9180574e0 con 0x7fb9280a4c50 2023-10-18T19:38:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.077+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb918006a40 con 0x7fb9280a4c50 2023-10-18T19:38:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.251+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb92809eb40 con 0x7fb9280a4c50 2023-10-18T19:38:45.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.251+0000 7fb91e7fc700 1 -- 172.21.15.88:0/954484597 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb918020080 con 0x7fb9280a4c50 2023-10-18T19:38:45.254 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 >> v1:172.21.15.88:6800/113625 conn(0x7fb90c041ce0 legacy=0x7fb90c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 msgr2=0x7fb9281493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb918011000 tx=0x7fb918017000).stop 2023-10-18T19:38:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 shutdown_connections 2023-10-18T19:38:45.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb9280af970 0x7fb9280a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9280a1790 0x7fb9280a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 --2- 172.21.15.88:0/954484597 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb9280a4c50 0x7fb9281493f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 >> 172.21.15.88:0/954484597 conn(0x7fb92805eb60 msgr2=0x7fb9280ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 shutdown_connections 2023-10-18T19:38:45.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:45.253+0000 7fb9303ff700 1 -- 172.21.15.88:0/954484597 wait complete. 2023-10-18T19:38:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:48.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:48.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.467+0000 7f0db2fff700 1 Processor -- start 2023-10-18T19:38:48.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.467+0000 7f0db2fff700 1 -- start start 2023-10-18T19:38:48.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db2fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:48.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db2fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:48.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db2fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac091b30 con 0x7f0dac09a860 2023-10-18T19:38:48.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db2fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac134610 con 0x7f0dac136b60 2023-10-18T19:38:48.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db2fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac06aa40 con 0x7f0dac0ab3d0 2023-10-18T19:38:48.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:48.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db0d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:48.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db159c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0dac09a860 0x7f0dac13a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46306/0 (socket says 172.21.15.88:46306) 2023-10-18T19:38:48.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db159c700 1 -- 172.21.15.88:0/2703227313 learned_addr learned my addr 172.21.15.88:0/2703227313 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:38:48.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db0d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49126/0 (socket says 172.21.15.88:49126) 2023-10-18T19:38:48.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59274/0 (socket says 172.21.15.88:59274) 2023-10-18T19:38:48.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 -- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 msgr2=0x7f0dac091f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:48.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 -- 172.21.15.88:0/2703227313 >> v1:172.21.15.88:6789/0 conn(0x7f0dac09a860 legacy=0x7f0dac13a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dabfff700 1 -- 172.21.15.88:0/2703227313 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac137090 con 0x7f0dac136b60 2023-10-18T19:38:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0dab7fe700 1 -- 172.21.15.88:0/2703227313 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552730425 0 0) 0x7f0dac091b30 con 0x7f0dac09a860 2023-10-18T19:38:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.468+0000 7f0db0d9b700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0dabfff700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0d980097c0 tx=0x7f0d98009060).ready entity=mon.1 client_cookie=6c52502d6ed42d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0dab7fe700 1 -- 172.21.15.88:0/2703227313 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800f510 con 0x7f0dac136b60 2023-10-18T19:38:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0dab7fe700 1 -- 172.21.15.88:0/2703227313 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800f670 con 0x7f0dac136b60 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0dab7fe700 1 -- 172.21.15.88:0/2703227313 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800f9f0 con 0x7f0dac136b60 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 -- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 msgr2=0x7f0dac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0d980097c0 tx=0x7f0d98009060).stop 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 -- 172.21.15.88:0/2703227313 shutdown_connections 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac091f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 --2- 172.21.15.88:0/2703227313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac069420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 -- 172.21.15.88:0/2703227313 >> 172.21.15.88:0/2703227313 conn(0x7f0dac05eb30 msgr2=0x7f0dac0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.469+0000 7f0db2fff700 1 -- 172.21.15.88:0/2703227313 shutdown_connections 2023-10-18T19:38:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.470+0000 7f0db2fff700 1 -- 172.21.15.88:0/2703227313 wait complete. 2023-10-18T19:38:48.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.471+0000 7f0db2fff700 1 Processor -- start 2023-10-18T19:38:48.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.471+0000 7f0db2fff700 1 -- start start 2023-10-18T19:38:48.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:48.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac098f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:48.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:48.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac099bb0 con 0x7f0dac09a860 2023-10-18T19:38:48.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac09ee70 con 0x7f0dac136b60 2023-10-18T19:38:48.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db2fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac09fa70 con 0x7f0dac0ab3d0 2023-10-18T19:38:48.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:48.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0dabfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac098f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:48.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db159c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41060/0 (socket says 172.21.15.88:41060) 2023-10-18T19:38:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 -- 172.21.15.88:0/1682247745 learned_addr learned my addr 172.21.15.88:0/1682247745 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 -- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 msgr2=0x7f0dac098f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac098f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 -- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 msgr2=0x7f0dac096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 -- 172.21.15.88:0/1682247745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00092a0 con 0x7f0dac09a860 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.472+0000 7f0db0d9b700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0da000ea20 tx=0x7f0da0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.473+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000ee60 con 0x7f0dac09a860 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.473+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000c8e0 con 0x7f0dac09a860 2023-10-18T19:38:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.473+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000cc60 con 0x7f0dac09a860 2023-10-18T19:38:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.473+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d980092a0 con 0x7f0dac09a860 2023-10-18T19:38:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.473+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac098440 con 0x7f0dac09a860 2023-10-18T19:38:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.474+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac05f270 con 0x7f0dac09a860 2023-10-18T19:38:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.474+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f0da001b400 con 0x7f0dac09a860 2023-10-18T19:38:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.475+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f0da0055fe0 con 0x7f0dac09a860 2023-10-18T19:38:48.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.478+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0da007d000 con 0x7f0dac09a860 2023-10-18T19:38:48.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.650+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0dac06a4a0 con 0x7f0dac09a860 2023-10-18T19:38:48.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.651+0000 7f0da8ff9700 1 -- 172.21.15.88:0/1682247745 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0da0036170 con 0x7f0dac09a860 2023-10-18T19:38:48.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:48.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 >> v1:172.21.15.88:6800/113625 conn(0x7f0d90041ce0 legacy=0x7f0d900441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 msgr2=0x7f0dac135df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:48.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0da000ea20 tx=0x7f0da0009060).stop 2023-10-18T19:38:48.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 shutdown_connections 2023-10-18T19:38:48.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dac136b60 0x7f0dac096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dac09a860 0x7f0dac135df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 --2- 172.21.15.88:0/1682247745 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0dac0ab3d0 0x7f0dac098f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:48.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 >> 172.21.15.88:0/1682247745 conn(0x7f0dac05eb30 msgr2=0x7f0dac09a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:48.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 shutdown_connections 2023-10-18T19:38:48.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:48.653+0000 7f0db2fff700 1 -- 172.21.15.88:0/1682247745 wait complete. 2023-10-18T19:38:48.672 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:51.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:51.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.868+0000 7f195abff700 1 Processor -- start 2023-10-18T19:38:51.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.868+0000 7f195abff700 1 -- start start 2023-10-18T19:38:51.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.869+0000 7f195abff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f195409db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:51.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.869+0000 7f195abff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19541406f0 0x7f1954142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:51.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.869+0000 7f195abff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195409d700 con 0x7f19540aa190 2023-10-18T19:38:51.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.869+0000 7f195abff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195406a310 con 0x7f19541406f0 2023-10-18T19:38:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.869+0000 7f195abff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1954063280 con 0x7f1954062ea0 2023-10-18T19:38:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f1953fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f19540aa190 0x7f1954069c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46312/0 (socket says 172.21.15.88:46312) 2023-10-18T19:38:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195899b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f195409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f1953fff700 1 -- 172.21.15.88:0/837102290 learned_addr learned my addr 172.21.15.88:0/837102290 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:38:51.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 --2- 172.21.15.88:0/837102290 >> v2:172.21.15.88:3300/0 conn(0x7f19541406f0 0x7f1954142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 -- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 msgr2=0x7f195409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f195409db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 -- 172.21.15.88:0/837102290 >> v1:172.21.15.88:6789/0 conn(0x7f19540aa190 legacy=0x7f1954069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 -- 172.21.15.88:0/837102290 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540aa620 con 0x7f19541406f0 2023-10-18T19:38:51.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f19537fe700 1 -- 172.21.15.88:0/837102290 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020084242 0 0) 0x7f195409d700 con 0x7f19540aa190 2023-10-18T19:38:51.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195899b700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f195409db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:51.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f195919c700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19541406f0 0x7f1954142ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f194c009e60 tx=0x7f194c009780).ready entity=mon.0 client_cookie=4adcef5f325c21d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:51.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.870+0000 7f19537fe700 1 -- 172.21.15.88:0/837102290 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c00e070 con 0x7f19541406f0 2023-10-18T19:38:51.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f19537fe700 1 -- 172.21.15.88:0/837102290 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00bbf0 con 0x7f19541406f0 2023-10-18T19:38:51.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f19537fe700 1 -- 172.21.15.88:0/837102290 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c012410 con 0x7f19541406f0 2023-10-18T19:38:51.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 -- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19541406f0 msgr2=0x7f1954142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:51.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19541406f0 0x7f1954142ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f194c009e60 tx=0x7f194c009780).stop 2023-10-18T19:38:51.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 -- 172.21.15.88:0/837102290 shutdown_connections 2023-10-18T19:38:51.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19541406f0 0x7f1954142ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:51.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 --2- 172.21.15.88:0/837102290 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f195409db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:51.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 -- 172.21.15.88:0/837102290 >> 172.21.15.88:0/837102290 conn(0x7f1954067ef0 msgr2=0x7f19540625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:51.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 -- 172.21.15.88:0/837102290 shutdown_connections 2023-10-18T19:38:51.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.871+0000 7f195abff700 1 -- 172.21.15.88:0/837102290 wait complete. 2023-10-18T19:38:51.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.872+0000 7f195abff700 1 Processor -- start 2023-10-18T19:38:51.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 -- start start 2023-10-18T19:38:51.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:51.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19541406f0 0x7f19540a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19540a5c30 0x7f19541489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a68a0 con 0x7f19540a5c30 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a6110 con 0x7f19541406f0 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.873+0000 7f195abff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a7060 con 0x7f1954062ea0 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:51.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49156/0 (socket says 172.21.15.88:49156) 2023-10-18T19:38:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 -- 172.21.15.88:0/502493142 learned_addr learned my addr 172.21.15.88:0/502493142 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195919c700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19540a5c30 0x7f19541489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f1953fff700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19541406f0 0x7f19540a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 -- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19541406f0 msgr2=0x7f19540a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:51.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19541406f0 0x7f19540a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 -- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19540a5c30 msgr2=0x7f19541489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19540a5c30 0x7f19541489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 -- 172.21.15.88:0/502493142 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480092a0 con 0x7f1954062ea0 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195899b700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f194800ea50 tx=0x7f1948009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800ee90 con 0x7f1954062ea0 2023-10-18T19:38:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194800c850 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c009a20 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.874+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800cbd0 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.875+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540a6d80 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.875+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19540a5590 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.876+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f194801b400 con 0x7f1954062ea0 2023-10-18T19:38:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.876+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f1948055ff0 con 0x7f1954062ea0 2023-10-18T19:38:51.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:51.880+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f194807d000 con 0x7f1954062ea0 2023-10-18T19:38:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.051+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f195409e0f0 con 0x7f1954062ea0 2023-10-18T19:38:52.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.052+0000 7f1950ff9700 1 -- 172.21.15.88:0/502493142 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1948036180 con 0x7f1954062ea0 2023-10-18T19:38:52.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:52.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 >> v1:172.21.15.88:6800/113625 conn(0x7f1938041ce0 legacy=0x7f19380441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:52.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 msgr2=0x7f19540a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:52.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f194800ea50 tx=0x7f1948009060).stop 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 shutdown_connections 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19540a5c30 0x7f19541489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1954062ea0 0x7f19540a7740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 --2- 172.21.15.88:0/502493142 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19541406f0 0x7f19540a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.053+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 >> 172.21.15.88:0/502493142 conn(0x7f1954067ef0 msgr2=0x7f1954069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:52.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.054+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 shutdown_connections 2023-10-18T19:38:52.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:52.054+0000 7f195abff700 1 -- 172.21.15.88:0/502493142 wait complete. 2023-10-18T19:38:52.073 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:55.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:55.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.268+0000 7f26eadff700 1 Processor -- start 2023-10-18T19:38:55.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.268+0000 7f26eadff700 1 -- start start 2023-10-18T19:38:55.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.269+0000 7f26eadff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 0x7f26e41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:55.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.269+0000 7f26eadff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:55.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.269+0000 7f26eadff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e40afd50 con 0x7f26e40af970 2023-10-18T19:38:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.269+0000 7f26eadff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40a47a0 con 0x7f26e40a1790 2023-10-18T19:38:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.269+0000 7f26eadff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40a3a10 con 0x7f26e40a4c50 2023-10-18T19:38:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 0x7f26e41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49166/0 (socket says 172.21.15.88:49166) 2023-10-18T19:38:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 -- 172.21.15.88:0/687666038 learned_addr learned my addr 172.21.15.88:0/687666038 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 -- 172.21.15.88:0/687666038 >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 msgr2=0x7f26e41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 --2- 172.21.15.88:0/687666038 >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 0x7f26e41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 -- 172.21.15.88:0/687666038 >> v1:172.21.15.88:6789/0 conn(0x7f26e40af970 legacy=0x7f26e4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 -- 172.21.15.88:0/687666038 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e40a32d0 con 0x7f26e40a4c50 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e3fff700 1 --2- 172.21.15.88:0/687666038 >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 0x7f26e41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e939c700 1 --2- 172.21.15.88:0/687666038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f26dc009f20 tx=0x7f26dc009840).ready entity=mon.2 client_cookie=b23534233d1200c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e37fe700 1 -- 172.21.15.88:0/687666038 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00e070 con 0x7f26e40a4c50 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e37fe700 1 -- 172.21.15.88:0/687666038 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc00b9d0 con 0x7f26e40a4c50 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.270+0000 7f26e37fe700 1 -- 172.21.15.88:0/687666038 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00bd50 con 0x7f26e40a4c50 2023-10-18T19:38:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 -- 172.21.15.88:0/687666038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 msgr2=0x7f26e41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 --2- 172.21.15.88:0/687666038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f26dc009f20 tx=0x7f26dc009840).stop 2023-10-18T19:38:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 -- 172.21.15.88:0/687666038 shutdown_connections 2023-10-18T19:38:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 --2- 172.21.15.88:0/687666038 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a4c50 0x7f26e41437e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 --2- 172.21.15.88:0/687666038 >> v2:172.21.15.88:3300/0 conn(0x7f26e40a1790 0x7f26e41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 -- 172.21.15.88:0/687666038 >> 172.21.15.88:0/687666038 conn(0x7f26e405eb60 msgr2=0x7f26e40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 -- 172.21.15.88:0/687666038 shutdown_connections 2023-10-18T19:38:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.271+0000 7f26eadff700 1 -- 172.21.15.88:0/687666038 wait complete. 2023-10-18T19:38:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.272+0000 7f26eadff700 1 Processor -- start 2023-10-18T19:38:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 -- start start 2023-10-18T19:38:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e40a4c50 0x7f26e414bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26e40af970 0x7f26e40aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40abb30 con 0x7f26e40a4c50 2023-10-18T19:38:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40aa900 con 0x7f26e40af970 2023-10-18T19:38:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26eadff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40a9e50 con 0x7f26e40a1790 2023-10-18T19:38:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.273+0000 7f26e8b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49178/0 (socket says 172.21.15.88:49178) 2023-10-18T19:38:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 -- 172.21.15.88:0/1346681529 learned_addr learned my addr 172.21.15.88:0/1346681529 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:55.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e939c700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26e40af970 0x7f26e40aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e3fff700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e40a4c50 0x7f26e414bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 -- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26e40af970 msgr2=0x7f26e40aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26e40af970 0x7f26e40aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 -- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e40a4c50 msgr2=0x7f26e414bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e40a4c50 0x7f26e414bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 -- 172.21.15.88:0/1346681529 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00092a0 con 0x7f26e40a1790 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e8b9b700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f26d800c440 tx=0x7f26d8007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8007020 con 0x7f26e40a1790 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8007180 con 0x7f26e40a1790 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8007520 con 0x7f26e40a1790 2023-10-18T19:38:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.274+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc009ae0 con 0x7f26e40a1790 2023-10-18T19:38:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.275+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e414c240 con 0x7f26e40a1790 2023-10-18T19:38:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.275+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e414c6b0 con 0x7f26e40a1790 2023-10-18T19:38:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.276+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f26d80068b0 con 0x7f26e40a1790 2023-10-18T19:38:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.276+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f26d8054d50 con 0x7f26e40a1790 2023-10-18T19:38:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.280+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f26d8034f20 con 0x7f26e40a1790 2023-10-18T19:38:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.453+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26e405f270 con 0x7f26e40a1790 2023-10-18T19:38:55.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.453+0000 7f26e0ff9700 1 -- 172.21.15.88:0/1346681529 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f26d8038710 con 0x7f26e40a1790 2023-10-18T19:38:55.457 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:55.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 >> v1:172.21.15.88:6800/113625 conn(0x7f26c8041ce0 legacy=0x7f26c80441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 msgr2=0x7f26e414c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f26d800c440 tx=0x7f26d8007e00).stop 2023-10-18T19:38:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 shutdown_connections 2023-10-18T19:38:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26e40af970 0x7f26e40aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26e40a1790 0x7f26e414c860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 --2- 172.21.15.88:0/1346681529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26e40a4c50 0x7f26e414bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 >> 172.21.15.88:0/1346681529 conn(0x7f26e405eb60 msgr2=0x7f26e40ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.455+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 shutdown_connections 2023-10-18T19:38:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:55.456+0000 7f26eadff700 1 -- 172.21.15.88:0/1346681529 wait complete. 2023-10-18T19:38:55.475 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:38:58.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:38:58.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.670+0000 7f71457ff700 1 Processor -- start 2023-10-18T19:38:58.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.670+0000 7f71457ff700 1 -- start start 2023-10-18T19:38:58.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 0x7f7140135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400a3a70 con 0x7f71400a4a20 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714005ed40 con 0x7f714005e960 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f71457ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7140136670 con 0x7f71401361c0 2023-10-18T19:38:58.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f713f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f713effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f713e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 0x7f7140135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f713f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:33274/0 (socket says 172.21.15.88:33274) 2023-10-18T19:38:58.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.671+0000 7f713f7fe700 1 -- 172.21.15.88:0/2692416207 learned_addr learned my addr 172.21.15.88:0/2692416207 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:58.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 -- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 msgr2=0x7f71400a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:58.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 --2- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 -- 172.21.15.88:0/2692416207 >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 msgr2=0x7f7140135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:38:58.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 --2- 172.21.15.88:0/2692416207 >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 0x7f7140135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 -- 172.21.15.88:0/2692416207 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400a2ac0 con 0x7f71401361c0 2023-10-18T19:38:58.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713e7fc700 1 --2- 172.21.15.88:0/2692416207 >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 0x7f7140135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:58.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713f7fe700 1 --2- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7138009f80 tx=0x7f7138009840).ready entity=mon.2 client_cookie=d888691c653b6656 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:58.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713dffb700 1 -- 172.21.15.88:0/2692416207 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800e070 con 0x7f71401361c0 2023-10-18T19:38:58.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713dffb700 1 -- 172.21.15.88:0/2692416207 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713800b980 con 0x7f71401361c0 2023-10-18T19:38:58.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f713dffb700 1 -- 172.21.15.88:0/2692416207 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800bd00 con 0x7f71401361c0 2023-10-18T19:38:58.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f71457ff700 1 -- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 msgr2=0x7f7140138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:58.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.672+0000 7f71457ff700 1 --2- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7138009f80 tx=0x7f7138009840).stop 2023-10-18T19:38:58.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 -- 172.21.15.88:0/2692416207 shutdown_connections 2023-10-18T19:38:58.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 --2- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140138ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 --2- 172.21.15.88:0/2692416207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 --2- 172.21.15.88:0/2692416207 >> v2:172.21.15.88:3300/0 conn(0x7f71400a4a20 0x7f7140135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 -- 172.21.15.88:0/2692416207 >> 172.21.15.88:0/2692416207 conn(0x7f7140064bb0 msgr2=0x7f714005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:58.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 -- 172.21.15.88:0/2692416207 shutdown_connections 2023-10-18T19:38:58.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.673+0000 7f71457ff700 1 -- 172.21.15.88:0/2692416207 wait complete. 2023-10-18T19:38:58.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.674+0000 7f71457ff700 1 Processor -- start 2023-10-18T19:38:58.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.674+0000 7f71457ff700 1 -- start start 2023-10-18T19:38:58.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 0x7f71400a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:38:58.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71400a80c0 con 0x7f71400a4a20 2023-10-18T19:38:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400a6c80 con 0x7f714005e960 2023-10-18T19:38:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f71457ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7140137d20 con 0x7f71401361c0 2023-10-18T19:38:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 0x7f71400a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:38:58.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44806/0 (socket says 172.21.15.88:44806) 2023-10-18T19:38:58.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713effd700 1 -- 172.21.15.88:0/2184658867 learned_addr learned my addr 172.21.15.88:0/2184658867 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:38:58.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 -- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 msgr2=0x7f7140134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:58.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140134b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 -- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 msgr2=0x7f71400a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.675+0000 7f713e7fc700 1 -- 172.21.15.88:0/2184658867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71340092a0 con 0x7f71400a4a20 2023-10-18T19:38:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f713effd700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f713f7fe700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:38:58.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f713e7fc700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 0x7f71400a62b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f713400e950 tx=0x7f7134009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134009580 con 0x7f71400a4a20 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134012600 con 0x7f71400a4a20 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7138009ae0 con 0x7f71400a4a20 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340129a0 con 0x7f71400a4a20 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.676+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71400a5750 con 0x7f71400a4a20 2023-10-18T19:38:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.677+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f7134012d10 con 0x7f71400a4a20 2023-10-18T19:38:58.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.677+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714005f270 con 0x7f71400a4a20 2023-10-18T19:38:58.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.678+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f7134055e00 con 0x7f71400a4a20 2023-10-18T19:38:58.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.681+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f7134035fd0 con 0x7f71400a4a20 2023-10-18T19:38:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.850+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f71400a1100 con 0x7f71400a4a20 2023-10-18T19:38:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.851+0000 7f7126ffd700 1 -- 172.21.15.88:0/2184658867 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f71340397c0 con 0x7f71400a4a20 2023-10-18T19:38:58.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:38:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 >> v1:172.21.15.88:6800/113625 conn(0x7f712c041d10 legacy=0x7f712c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 msgr2=0x7f71400a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:38:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 0x7f71400a62b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f713400e950 tx=0x7f7134009060).stop 2023-10-18T19:38:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 shutdown_connections 2023-10-18T19:38:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f71401361c0 0x7f7140134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714005e960 0x7f71400a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 --2- 172.21.15.88:0/2184658867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71400a4a20 0x7f71400a62b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:38:58.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.852+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 >> 172.21.15.88:0/2184658867 conn(0x7f7140064bb0 msgr2=0x7f7140139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:38:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.853+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 shutdown_connections 2023-10-18T19:38:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:38:58.853+0000 7f71457ff700 1 -- 172.21.15.88:0/2184658867 wait complete. 2023-10-18T19:38:58.872 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:01.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:02.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.068+0000 7fad353ff700 1 Processor -- start 2023-10-18T19:39:02.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.068+0000 7fad353ff700 1 -- start start 2023-10-18T19:39:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 0x7fad3013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad300afd50 con 0x7fad300a4c50 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300a47a0 con 0x7fad300a1790 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad353ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad300a3a10 con 0x7fad300af970 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 0x7fad3013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:33282/0 (socket says 172.21.15.88:33282) 2023-10-18T19:39:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2effd700 1 -- 172.21.15.88:0/3332920237 learned_addr learned my addr 172.21.15.88:0/3332920237 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44814/0 (socket says 172.21.15.88:44814) 2023-10-18T19:39:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 -- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 msgr2=0x7fad30135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:02.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 --2- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 -- 172.21.15.88:0/3332920237 >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 msgr2=0x7fad3013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 --2- 172.21.15.88:0/3332920237 >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 0x7fad3013bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2e7fc700 1 -- 172.21.15.88:0/3332920237 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300a32d0 con 0x7fad300a1790 2023-10-18T19:39:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.069+0000 7fad2f7fe700 1 --2- 172.21.15.88:0/3332920237 >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 0x7fad3013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad2e7fc700 1 --2- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fad24009760 tx=0x7fad24009060).ready entity=mon.1 client_cookie=16c164d68a81427f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:02.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad2dffb700 1 -- 172.21.15.88:0/3332920237 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400d4a0 con 0x7fad300a1790 2023-10-18T19:39:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad2dffb700 1 -- 172.21.15.88:0/3332920237 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400d600 con 0x7fad300a1790 2023-10-18T19:39:02.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad2dffb700 1 -- 172.21.15.88:0/3332920237 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400d980 con 0x7fad300a1790 2023-10-18T19:39:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 -- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 msgr2=0x7fad30136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 --2- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fad24009760 tx=0x7fad24009060).stop 2023-10-18T19:39:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 -- 172.21.15.88:0/3332920237 shutdown_connections 2023-10-18T19:39:02.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 --2- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 --2- 172.21.15.88:0/3332920237 >> v2:172.21.15.88:3300/0 conn(0x7fad300a4c50 0x7fad3013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 --2- 172.21.15.88:0/3332920237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad30136220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.070+0000 7fad353ff700 1 -- 172.21.15.88:0/3332920237 >> 172.21.15.88:0/3332920237 conn(0x7fad3005eb60 msgr2=0x7fad300af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:02.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.071+0000 7fad353ff700 1 -- 172.21.15.88:0/3332920237 shutdown_connections 2023-10-18T19:39:02.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.071+0000 7fad353ff700 1 -- 172.21.15.88:0/3332920237 wait complete. 2023-10-18T19:39:02.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.072+0000 7fad353ff700 1 Processor -- start 2023-10-18T19:39:02.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.072+0000 7fad353ff700 1 -- start start 2023-10-18T19:39:02.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad300a4c50 0x7fad300ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:02.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300aaa40 con 0x7fad300a4c50 2023-10-18T19:39:02.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300ab200 con 0x7fad300a1790 2023-10-18T19:39:02.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad353ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad300a99d0 con 0x7fad300af970 2023-10-18T19:39:02.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44816/0 (socket says 172.21.15.88:44816) 2023-10-18T19:39:02.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 -- 172.21.15.88:0/3090328508 learned_addr learned my addr 172.21.15.88:0/3090328508 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:02.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2e7fc700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad300a4c50 0x7fad300ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:02.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 -- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 msgr2=0x7fad30133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:02.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30133aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 -- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad300a4c50 msgr2=0x7fad300ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:02.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad300a4c50 0x7fad300ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2effd700 1 -- 172.21.15.88:0/3090328508 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009a20 con 0x7fad300a1790 2023-10-18T19:39:02.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.073+0000 7fad2f7fe700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad2effd700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad2000e900 tx=0x7fad200090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20012600 con 0x7fad300a1790 2023-10-18T19:39:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20012760 con 0x7fad300a1790 2023-10-18T19:39:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240092a0 con 0x7fad300a1790 2023-10-18T19:39:02.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20012ae0 con 0x7fad300a1790 2023-10-18T19:39:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.074+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3013cc70 con 0x7fad300a1790 2023-10-18T19:39:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.075+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad300a91d0 con 0x7fad300a1790 2023-10-18T19:39:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.075+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7fad2001b400 con 0x7fad300a1790 2023-10-18T19:39:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.076+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7fad20055ec0 con 0x7fad300a1790 2023-10-18T19:39:02.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.079+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fad20036240 con 0x7fad300a1790 2023-10-18T19:39:02.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.247+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad3005f270 con 0x7fad300a1790 2023-10-18T19:39:02.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.247+0000 7fad16ffd700 1 -- 172.21.15.88:0/3090328508 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fad20016070 con 0x7fad300a1790 2023-10-18T19:39:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:02.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.248+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 >> v1:172.21.15.88:6800/113625 conn(0x7fad1c041d10 legacy=0x7fad1c0441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:02.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 msgr2=0x7fad3013c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:02.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad2000e900 tx=0x7fad200090f0).stop 2023-10-18T19:39:02.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 shutdown_connections 2023-10-18T19:39:02.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fad300af970 0x7fad30133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fad300a1790 0x7fad3013c4e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 --2- 172.21.15.88:0/3090328508 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad300a4c50 0x7fad300ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:02.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 >> 172.21.15.88:0/3090328508 conn(0x7fad3005eb60 msgr2=0x7fad300ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:02.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 shutdown_connections 2023-10-18T19:39:02.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:02.249+0000 7fad353ff700 1 -- 172.21.15.88:0/3090328508 wait complete. 2023-10-18T19:39:02.269 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:05.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.466+0000 7f0a6d7ff700 1 Processor -- start 2023-10-18T19:39:05.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.466+0000 7f0a6d7ff700 1 -- start start 2023-10-18T19:39:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 0x7f0a68136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a680a4c50 0x7f0a6813bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680afd50 con 0x7f0a680a4c50 2023-10-18T19:39:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a47a0 con 0x7f0a680a1790 2023-10-18T19:39:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.467+0000 7f0a6d7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a3a10 con 0x7f0a680af970 2023-10-18T19:39:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a667fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 0x7f0a68136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a677fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0a680a4c50 0x7f0a6813bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:33310/0 (socket says 172.21.15.88:33310) 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a667fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 0x7f0a68136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:44824/0 (socket says 172.21.15.88:44824) 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 -- 172.21.15.88:0/4014602884 learned_addr learned my addr 172.21.15.88:0/4014602884 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 -- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 msgr2=0x7f0a68136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:05.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 0x7f0a68136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 -- 172.21.15.88:0/4014602884 >> v2:172.21.15.88:3300/0 conn(0x7f0a680a4c50 msgr2=0x7f0a6813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:05.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/4014602884 >> v2:172.21.15.88:3300/0 conn(0x7f0a680a4c50 0x7f0a6813bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 -- 172.21.15.88:0/4014602884 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680a32d0 con 0x7f0a680af970 2023-10-18T19:39:05.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0a58009830 tx=0x7f0a580090f0).ready entity=mon.2 client_cookie=d7b1572b18e1a12a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:05.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a65ffb700 1 -- 172.21.15.88:0/4014602884 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800f510 con 0x7f0a680af970 2023-10-18T19:39:05.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a65ffb700 1 -- 172.21.15.88:0/4014602884 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800f670 con 0x7f0a680af970 2023-10-18T19:39:05.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.468+0000 7f0a65ffb700 1 -- 172.21.15.88:0/4014602884 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800f9f0 con 0x7f0a680af970 2023-10-18T19:39:05.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 msgr2=0x7f0a68135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:05.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0a58009830 tx=0x7f0a580090f0).stop 2023-10-18T19:39:05.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/4014602884 shutdown_connections 2023-10-18T19:39:05.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680af970 0x7f0a68135d30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/4014602884 >> v2:172.21.15.88:3300/0 conn(0x7f0a680a4c50 0x7f0a6813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/4014602884 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a1790 0x7f0a68136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/4014602884 >> 172.21.15.88:0/4014602884 conn(0x7f0a6805eb60 msgr2=0x7f0a680af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:05.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/4014602884 shutdown_connections 2023-10-18T19:39:05.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.469+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/4014602884 wait complete. 2023-10-18T19:39:05.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.470+0000 7f0a6d7ff700 1 Processor -- start 2023-10-18T19:39:05.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 -- start start 2023-10-18T19:39:05.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a4c50 0x7f0a680aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 0x7f0a68148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:05.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680a8ce0 con 0x7f0a680af970 2023-10-18T19:39:05.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68148830 con 0x7f0a680a4c50 2023-10-18T19:39:05.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.471+0000 7f0a6d7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680ab1c0 con 0x7f0a680a1790 2023-10-18T19:39:05.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 0x7f0a68148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a667fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a4c50 0x7f0a680aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:33312/0 (socket says 172.21.15.88:33312) 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 -- 172.21.15.88:0/3446898149 learned_addr learned my addr 172.21.15.88:0/3446898149 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 -- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a4c50 msgr2=0x7f0a680aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a4c50 0x7f0a680aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 -- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 msgr2=0x7f0a68148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:05.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 0x7f0a68148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 -- 172.21.15.88:0/3446898149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009370 con 0x7f0a680a1790 2023-10-18T19:39:05.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a677fe700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 0x7f0a68148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:05.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a66ffd700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0a680a3ba0 tx=0x7f0a58015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:05.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800f7e0 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800f940 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a680a94c0 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.472+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5801b660 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.473+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a680ac560 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.474+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6805f270 con 0x7f0a680a1790 2023-10-18T19:39:05.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.474+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f0a5801b9d0 con 0x7f0a680a1790 2023-10-18T19:39:05.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.474+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f0a58057070 con 0x7f0a680a1790 2023-10-18T19:39:05.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.478+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0a5803af40 con 0x7f0a680a1790 2023-10-18T19:39:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.649+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0a680a3010 con 0x7f0a680a1790 2023-10-18T19:39:05.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.650+0000 7f0a4effd700 1 -- 172.21.15.88:0/3446898149 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0a5803ab30 con 0x7f0a680a1790 2023-10-18T19:39:05.653 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 >> v1:172.21.15.88:6800/113625 conn(0x7f0a54041ce0 legacy=0x7f0a540441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 msgr2=0x7f0a680abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:05.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0a680a3ba0 tx=0x7f0a58015000).stop 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 shutdown_connections 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a680af970 0x7f0a68148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0a680a1790 0x7f0a680abb80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 --2- 172.21.15.88:0/3446898149 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0a680a4c50 0x7f0a680aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 >> 172.21.15.88:0/3446898149 conn(0x7f0a6805eb60 msgr2=0x7f0a681370d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:05.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 shutdown_connections 2023-10-18T19:39:05.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:05.651+0000 7f0a6d7ff700 1 -- 172.21.15.88:0/3446898149 wait complete. 2023-10-18T19:39:05.671 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:08.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:08.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.866+0000 7f3b423ff700 1 Processor -- start 2023-10-18T19:39:08.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.866+0000 7f3b423ff700 1 -- start start 2023-10-18T19:39:08.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b423ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 0x7f3b3c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:08.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b423ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:08.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b423ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c0afd50 con 0x7f3b3c0a4c50 2023-10-18T19:39:08.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b423ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a47a0 con 0x7f3b3c0af970 2023-10-18T19:39:08.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b423ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a3a10 con 0x7f3b3c0a1790 2023-10-18T19:39:08.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:08.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 0x7f3b3c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:08.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:35582/0 (socket says 172.21.15.88:35582) 2023-10-18T19:39:08.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 -- 172.21.15.88:0/1060918981 learned_addr learned my addr 172.21.15.88:0/1060918981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:08.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 -- 172.21.15.88:0/1060918981 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 msgr2=0x7f3b3c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:08.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 --2- 172.21.15.88:0/1060918981 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 0x7f3b3c135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:08.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 -- 172.21.15.88:0/1060918981 >> v1:172.21.15.88:6789/0 conn(0x7f3b3c0a4c50 legacy=0x7f3b3c13bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3b7fe700 1 -- 172.21.15.88:0/1060918981 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0a32d0 con 0x7f3b3c0a1790 2023-10-18T19:39:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.867+0000 7f3b3bfff700 1 --2- 172.21.15.88:0/1060918981 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 0x7f3b3c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b3b7fe700 1 --2- 172.21.15.88:0/1060918981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3b30006fd0 tx=0x7f3b300090f0).ready entity=mon.1 client_cookie=40c87b445108b6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b3affd700 1 -- 172.21.15.88:0/1060918981 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000b580 con 0x7f3b3c0a1790 2023-10-18T19:39:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b3affd700 1 -- 172.21.15.88:0/1060918981 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3000b6e0 con 0x7f3b3c0a1790 2023-10-18T19:39:08.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b3affd700 1 -- 172.21.15.88:0/1060918981 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000ba60 con 0x7f3b3c0a1790 2023-10-18T19:39:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 -- 172.21.15.88:0/1060918981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 msgr2=0x7f3b3c136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 --2- 172.21.15.88:0/1060918981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3b30006fd0 tx=0x7f3b300090f0).stop 2023-10-18T19:39:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 -- 172.21.15.88:0/1060918981 shutdown_connections 2023-10-18T19:39:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 --2- 172.21.15.88:0/1060918981 >> v2:172.21.15.88:3300/0 conn(0x7f3b3c0af970 0x7f3b3c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 --2- 172.21.15.88:0/1060918981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a1790 0x7f3b3c136220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 -- 172.21.15.88:0/1060918981 >> 172.21.15.88:0/1060918981 conn(0x7f3b3c05eb60 msgr2=0x7f3b3c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.868+0000 7f3b423ff700 1 -- 172.21.15.88:0/1060918981 shutdown_connections 2023-10-18T19:39:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.869+0000 7f3b423ff700 1 -- 172.21.15.88:0/1060918981 wait complete. 2023-10-18T19:39:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 Processor -- start 2023-10-18T19:39:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 -- start start 2023-10-18T19:39:08.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 0x7f3b3c0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b3c0af970 0x7f3b3c0a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.870+0000 7f3b423ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0ab300 con 0x7f3b3c0a1790 2023-10-18T19:39:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b423ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0aacf0 con 0x7f3b3c0a4c50 2023-10-18T19:39:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b423ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a99d0 con 0x7f3b3c0af970 2023-10-18T19:39:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 0x7f3b3c0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36212/0 (socket says 172.21.15.88:36212) 2023-10-18T19:39:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 -- 172.21.15.88:0/2468903528 learned_addr learned my addr 172.21.15.88:0/2468903528 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b4099c700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b3c0af970 0x7f3b3c0a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 -- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b3c0af970 msgr2=0x7f3b3c0a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b3c0af970 0x7f3b3c0a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 -- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 msgr2=0x7f3b3c0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 0x7f3b3c0ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 -- 172.21.15.88:0/2468903528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0092a0 con 0x7f3b3c0a1790 2023-10-18T19:39:08.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3b7fe700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 0x7f3b3c0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:08.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b3bfff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3b2c00e980 tx=0x7f3b2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:08.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.871+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c009560 con 0x7f3b3c0a1790 2023-10-18T19:39:08.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.872+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c012600 con 0x7f3b3c0a1790 2023-10-18T19:39:08.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.872+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c012980 con 0x7f3b3c0a1790 2023-10-18T19:39:08.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.872+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30009370 con 0x7f3b3c0a1790 2023-10-18T19:39:08.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.872+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c134c10 con 0x7f3b3c0a1790 2023-10-18T19:39:08.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.873+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c05f270 con 0x7f3b3c0a1790 2023-10-18T19:39:08.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.873+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f3b2c012cf0 con 0x7f3b3c0a1790 2023-10-18T19:39:08.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.873+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f3b2c055d10 con 0x7f3b3c0a1790 2023-10-18T19:39:08.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:08.877+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3b2c036020 con 0x7f3b3c0a1790 2023-10-18T19:39:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.046+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3b3c0a3010 con 0x7f3b3c0a1790 2023-10-18T19:39:09.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.046+0000 7f3b23fff700 1 -- 172.21.15.88:0/2468903528 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3b2c016080 con 0x7f3b3c0a1790 2023-10-18T19:39:09.049 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:09.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 >> v1:172.21.15.88:6800/113625 conn(0x7f3b28041d10 legacy=0x7f3b280441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:09.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 msgr2=0x7f3b3c09e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:09.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3b2c00e980 tx=0x7f3b2c009060).stop 2023-10-18T19:39:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 shutdown_connections 2023-10-18T19:39:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b3c0af970 0x7f3b3c0a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b3c0a1790 0x7f3b3c09e6c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 --2- 172.21.15.88:0/2468903528 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b3c0a4c50 0x7f3b3c0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:09.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 >> 172.21.15.88:0/2468903528 conn(0x7f3b3c05eb60 msgr2=0x7f3b3c138230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:09.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 shutdown_connections 2023-10-18T19:39:09.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:09.048+0000 7f3b423ff700 1 -- 172.21.15.88:0/2468903528 wait complete. 2023-10-18T19:39:09.067 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:12.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.262+0000 7efca39ff700 1 Processor -- start 2023-10-18T19:39:12.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.262+0000 7efca39ff700 1 -- start start 2023-10-18T19:39:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.263+0000 7efca39ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc9c0ab590 0x7efc9c139630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.263+0000 7efca39ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c06aa30 0x7efc9c1403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.263+0000 7efca39ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0ab970 con 0x7efc9c06a310 2023-10-18T19:39:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.263+0000 7efca39ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c135a50 con 0x7efc9c0ab590 2023-10-18T19:39:12.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.263+0000 7efca39ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c135cf0 con 0x7efc9c06aa30 2023-10-18T19:39:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc9c0ab590 0x7efc9c139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc9c0ab590 0x7efc9c139630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36226/0 (socket says 172.21.15.88:36226) 2023-10-18T19:39:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 -- 172.21.15.88:0/3373251584 learned_addr learned my addr 172.21.15.88:0/3373251584 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca1f9c700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c06aa30 0x7efc9c1403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:12.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 -- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c06aa30 msgr2=0x7efc9c1403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:12.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c06aa30 0x7efc9c1403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 -- 172.21.15.88:0/3373251584 >> v1:172.21.15.88:6789/0 conn(0x7efc9c06a310 legacy=0x7efc9c136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.264+0000 7efca179b700 1 -- 172.21.15.88:0/3373251584 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c136920 con 0x7efc9c0ab590 2023-10-18T19:39:12.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.265+0000 7efca179b700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c0ab590 0x7efc9c139630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7efc98006fd0 tx=0x7efc980090f0).ready entity=mon.0 client_cookie=30ca3b9816f4b748 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.265+0000 7efc93fff700 1 -- 172.21.15.88:0/3373251584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800b580 con 0x7efc9c0ab590 2023-10-18T19:39:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.265+0000 7efc93fff700 1 -- 172.21.15.88:0/3373251584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800b6e0 con 0x7efc9c0ab590 2023-10-18T19:39:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.265+0000 7efc93fff700 1 -- 172.21.15.88:0/3373251584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800ba60 con 0x7efc9c0ab590 2023-10-18T19:39:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 -- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c0ab590 msgr2=0x7efc9c139630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c0ab590 0x7efc9c139630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7efc98006fd0 tx=0x7efc980090f0).stop 2023-10-18T19:39:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 -- 172.21.15.88:0/3373251584 shutdown_connections 2023-10-18T19:39:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c06aa30 0x7efc9c1403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 --2- 172.21.15.88:0/3373251584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c0ab590 0x7efc9c139630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 -- 172.21.15.88:0/3373251584 >> 172.21.15.88:0/3373251584 conn(0x7efc9c05eb30 msgr2=0x7efc9c0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:12.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 -- 172.21.15.88:0/3373251584 shutdown_connections 2023-10-18T19:39:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.266+0000 7efca39ff700 1 -- 172.21.15.88:0/3373251584 wait complete. 2023-10-18T19:39:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.267+0000 7efca39ff700 1 Processor -- start 2023-10-18T19:39:12.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 -- start start 2023-10-18T19:39:12.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:12.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 0x7efc9c1310f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c0ab590 0x7efc9c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c132440 con 0x7efc9c06aa30 2023-10-18T19:39:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c131890 con 0x7efc9c06a310 2023-10-18T19:39:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.268+0000 7efca39ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c1315e0 con 0x7efc9c0ab590 2023-10-18T19:39:12.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca179b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca179b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:35594/0 (socket says 172.21.15.88:35594) 2023-10-18T19:39:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca179b700 1 -- 172.21.15.88:0/3810781080 learned_addr learned my addr 172.21.15.88:0/3810781080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 0x7efc9c1310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca1f9c700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c0ab590 0x7efc9c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:12.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 -- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c0ab590 msgr2=0x7efc9c14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c0ab590 0x7efc9c14c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 -- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 msgr2=0x7efc9c131f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca0f9a700 1 -- 172.21.15.88:0/3810781080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009370 con 0x7efc9c06aa30 2023-10-18T19:39:12.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.269+0000 7efca179b700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efca0f9a700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 0x7efc9c1310f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efc8c00c440 tx=0x7efc8c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007020 con 0x7efc9c06aa30 2023-10-18T19:39:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c007180 con 0x7efc9c06aa30 2023-10-18T19:39:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c12e030 con 0x7efc9c06aa30 2023-10-18T19:39:12.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007520 con 0x7efc9c06aa30 2023-10-18T19:39:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.270+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c1309e0 con 0x7efc9c06aa30 2023-10-18T19:39:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.272+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7efc8c0068b0 con 0x7efc9c06aa30 2023-10-18T19:39:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.272+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c1434d0 con 0x7efc9c06aa30 2023-10-18T19:39:12.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.273+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7efc8c055320 con 0x7efc9c06aa30 2023-10-18T19:39:12.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.276+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7efc8c035570 con 0x7efc9c06aa30 2023-10-18T19:39:12.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.444+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efc9c05f270 con 0x7efc9c06aa30 2023-10-18T19:39:12.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.444+0000 7efc917fa700 1 -- 172.21.15.88:0/3810781080 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7efc8c038d60 con 0x7efc9c06aa30 2023-10-18T19:39:12.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 >> v1:172.21.15.88:6800/113625 conn(0x7efc80041d30 legacy=0x7efc800441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 msgr2=0x7efc9c1310f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 0x7efc9c1310f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efc8c00c440 tx=0x7efc8c007d40).stop 2023-10-18T19:39:12.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 shutdown_connections 2023-10-18T19:39:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efc9c0ab590 0x7efc9c14c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efc9c06a310 0x7efc9c131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 --2- 172.21.15.88:0/3810781080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc9c06aa30 0x7efc9c1310f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 >> 172.21.15.88:0/3810781080 conn(0x7efc9c05eb30 msgr2=0x7efc9c0669c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:12.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 shutdown_connections 2023-10-18T19:39:12.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:12.446+0000 7efca39ff700 1 -- 172.21.15.88:0/3810781080 wait complete. 2023-10-18T19:39:12.468 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:15.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:15.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.658+0000 7f5e761ff700 1 Processor -- start 2023-10-18T19:39:15.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.658+0000 7f5e761ff700 1 -- start start 2023-10-18T19:39:15.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e761ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:15.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e761ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e701437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:15.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e761ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7005e630 con 0x7f5e700a6aa0 2023-10-18T19:39:15.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e761ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700a7260 con 0x7f5e7005e250 2023-10-18T19:39:15.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e761ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700a1a70 con 0x7f5e701413e0 2023-10-18T19:39:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:35602/0 (socket says 172.21.15.88:35602) 2023-10-18T19:39:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/2638719674 learned_addr learned my addr 172.21.15.88:0/2638719674 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e6effd700 1 --1- 172.21.15.88:0/2638719674 >> v1:172.21.15.88:6789/0 conn(0x7f5e700a6aa0 0x7f5e700a8680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41182/0 (socket says 172.21.15.88:41182) 2023-10-18T19:39:15.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.659+0000 7f5e6ffff700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e701437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:15.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 msgr2=0x7f5e701437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:15.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6f7fe700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e701437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/2638719674 >> v1:172.21.15.88:6789/0 conn(0x7f5e700a6aa0 legacy=0x7f5e700a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/2638719674 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700a8d90 con 0x7f5e7005e250 2023-10-18T19:39:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6e7fc700 1 -- 172.21.15.88:0/2638719674 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152023122 0 0) 0x7f5e7005e630 con 0x7f5e700a6aa0 2023-10-18T19:39:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6f7fe700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5e60009830 tx=0x7f5e600090f0).ready entity=mon.1 client_cookie=623fc7590973d7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6e7fc700 1 -- 172.21.15.88:0/2638719674 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000b580 con 0x7f5e7005e250 2023-10-18T19:39:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6e7fc700 1 -- 172.21.15.88:0/2638719674 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000b6e0 con 0x7f5e7005e250 2023-10-18T19:39:15.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.660+0000 7f5e6e7fc700 1 -- 172.21.15.88:0/2638719674 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000bab0 con 0x7f5e7005e250 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 -- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 msgr2=0x7f5e700a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5e60009830 tx=0x7f5e600090f0).stop 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 -- 172.21.15.88:0/2638719674 shutdown_connections 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e701437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 --2- 172.21.15.88:0/2638719674 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a1580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 -- 172.21.15.88:0/2638719674 >> 172.21.15.88:0/2638719674 conn(0x7f5e700665a0 msgr2=0x7f5e700625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 -- 172.21.15.88:0/2638719674 shutdown_connections 2023-10-18T19:39:15.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.661+0000 7f5e761ff700 1 -- 172.21.15.88:0/2638719674 wait complete. 2023-10-18T19:39:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.662+0000 7f5e761ff700 1 Processor -- start 2023-10-18T19:39:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.662+0000 7f5e761ff700 1 -- start start 2023-10-18T19:39:15.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:15.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e700a6aa0 0x7f5e700a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:15.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e7013b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:15.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700a2de0 con 0x7f5e700a6aa0 2023-10-18T19:39:15.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700a30a0 con 0x7f5e7005e250 2023-10-18T19:39:15.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e761ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700a4e70 con 0x7f5e701413e0 2023-10-18T19:39:15.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e6effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e700a6aa0 0x7f5e700a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:15.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:15.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e6f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:35610/0 (socket says 172.21.15.88:35610) 2023-10-18T19:39:15.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/3357329661 learned_addr learned my addr 172.21.15.88:0/3357329661 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:15.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.663+0000 7f5e6ffff700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e7013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 msgr2=0x7f5e7013b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e7013b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e700a6aa0 msgr2=0x7f5e700a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e700a6aa0 0x7f5e700a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 -- 172.21.15.88:0/3357329661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009370 con 0x7f5e7005e250 2023-10-18T19:39:15.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e6f7fe700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5e60008000 tx=0x7f5e60017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:15.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000be70 con 0x7f5e7005e250 2023-10-18T19:39:15.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000b8a0 con 0x7f5e7005e250 2023-10-18T19:39:15.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70069e00 con 0x7f5e7005e250 2023-10-18T19:39:15.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6001c670 con 0x7f5e7005e250 2023-10-18T19:39:15.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.664+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e70140e60 con 0x7f5e7005e250 2023-10-18T19:39:15.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.665+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 8) v1 ==== 48642+0+0 (secure 0 0 0) 0x7f5e6001ca20 con 0x7f5e7005e250 2023-10-18T19:39:15.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.665+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7005f270 con 0x7f5e7005e250 2023-10-18T19:39:15.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.666+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4169+0+0 (secure 0 0 0) 0x7f5e60057690 con 0x7f5e7005e250 2023-10-18T19:39:15.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.669+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5e6000ba10 con 0x7f5e7005e250 2023-10-18T19:39:15.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.838+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e700a0de0 con 0x7f5e7005e250 2023-10-18T19:39:15.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.838+0000 7f5e577fe700 1 -- 172.21.15.88:0/3357329661 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5e60020020 con 0x7f5e7005e250 2023-10-18T19:39:15.841 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 >> v1:172.21.15.88:6800/113625 conn(0x7f5e5c041ce0 legacy=0x7f5e5c0441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 msgr2=0x7f5e700a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5e60008000 tx=0x7f5e60017000).stop 2023-10-18T19:39:15.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 shutdown_connections 2023-10-18T19:39:15.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e701413e0 0x7f5e7013b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e7005e250 0x7f5e700a2830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 --2- 172.21.15.88:0/3357329661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e700a6aa0 0x7f5e700a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:15.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 >> 172.21.15.88:0/3357329661 conn(0x7f5e700665a0 msgr2=0x7f5e700aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:15.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 shutdown_connections 2023-10-18T19:39:15.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:15.840+0000 7f5e761ff700 1 -- 172.21.15.88:0/3357329661 wait complete. 2023-10-18T19:39:15.860 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:18.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:19.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.057+0000 7f3dcb5ff700 1 Processor -- start 2023-10-18T19:39:19.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.057+0000 7f3dcb5ff700 1 -- start start 2023-10-18T19:39:19.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.058+0000 7f3dcb5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:19.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.058+0000 7f3dcb5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3dc40a4c50 0x7f3dc41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:19.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.058+0000 7f3dcb5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40afd50 con 0x7f3dc40af970 2023-10-18T19:39:19.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.058+0000 7f3dcb5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40a47a0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.058+0000 7f3dcb5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40a3a10 con 0x7f3dc40a1790 2023-10-18T19:39:19.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc8b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:19.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc939b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3dc40af970 0x7f3dc4135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40218/0 (socket says 172.21.15.88:40218) 2023-10-18T19:39:19.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc939b700 1 -- 172.21.15.88:0/2703620747 learned_addr learned my addr 172.21.15.88:0/2703620747 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:39:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 --2- 172.21.15.88:0/2703620747 >> v2:172.21.15.88:3300/0 conn(0x7f3dc40a4c50 0x7f3dc41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 -- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 msgr2=0x7f3dc41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:19.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 -- 172.21.15.88:0/2703620747 >> v1:172.21.15.88:6789/0 conn(0x7f3dc40af970 legacy=0x7f3dc4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 -- 172.21.15.88:0/2703620747 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40a32d0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc8b9a700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:19.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dc9b9c700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40a4c50 0x7f3dc41437e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3dbc009e60 tx=0x7f3dbc009780).ready entity=mon.0 client_cookie=cba54cac7407d0be server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:19.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dbbfff700 1 -- 172.21.15.88:0/2703620747 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00e070 con 0x7f3dc40a4c50 2023-10-18T19:39:19.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dbbfff700 1 -- 172.21.15.88:0/2703620747 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc00bb60 con 0x7f3dc40a4c50 2023-10-18T19:39:19.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.059+0000 7f3dbbfff700 1 -- 172.21.15.88:0/2703620747 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc012410 con 0x7f3dc40a4c50 2023-10-18T19:39:19.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40a4c50 msgr2=0x7f3dc41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40a4c50 0x7f3dc41437e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3dbc009e60 tx=0x7f3dbc009780).stop 2023-10-18T19:39:19.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2703620747 shutdown_connections 2023-10-18T19:39:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40a4c50 0x7f3dc41437e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2703620747 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2703620747 >> 172.21.15.88:0/2703620747 conn(0x7f3dc405eb60 msgr2=0x7f3dc40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2703620747 shutdown_connections 2023-10-18T19:39:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.060+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2703620747 wait complete. 2023-10-18T19:39:19.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.061+0000 7f3dcb5ff700 1 Processor -- start 2023-10-18T19:39:19.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 -- start start 2023-10-18T19:39:19.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc4091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:19.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:19.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 0x7f3dc414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ac390 con 0x7f3dc40af970 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40ab1e0 con 0x7f3dc40a1790 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.062+0000 7f3dcb5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc414c930 con 0x7f3dc40a4c50 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc939b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc4091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:19.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc9b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 0x7f3dc414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:19.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43566/0 (socket says 172.21.15.88:43566) 2023-10-18T19:39:19.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 -- 172.21.15.88:0/2354671763 learned_addr learned my addr 172.21.15.88:0/2354671763 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:19.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 -- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 msgr2=0x7f3dc4091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc4091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 -- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 msgr2=0x7f3dc414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 0x7f3dc414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 -- 172.21.15.88:0/2354671763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40092a0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc9b9c700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 0x7f3dc414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:19.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dc8b9a700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3db400ea50 tx=0x7f3db4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:19.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400c640 con 0x7f3dc40a4c50 2023-10-18T19:39:19.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db400c7a0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc009a20 con 0x7f3dc40a4c50 2023-10-18T19:39:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.063+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400cb20 con 0x7f3dc40a4c50 2023-10-18T19:39:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.064+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc40aa440 con 0x7f3dc40a4c50 2023-10-18T19:39:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.065+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f3db40123f0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.065+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc405f270 con 0x7f3dc40a4c50 2023-10-18T19:39:19.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.065+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f3db40556c0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.068+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3db4035a00 con 0x7f3dc40a4c50 2023-10-18T19:39:19.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.237+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3dc40a2d50 con 0x7f3dc40a4c50 2023-10-18T19:39:19.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.237+0000 7f3db97fa700 1 -- 172.21.15.88:0/2354671763 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3db40391f0 con 0x7f3dc40a4c50 2023-10-18T19:39:19.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 >> v1:172.21.15.88:6800/113625 conn(0x7f3da8041bc0 legacy=0x7f3da8044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 msgr2=0x7f3dc40a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3db400ea50 tx=0x7f3db4009060).stop 2023-10-18T19:39:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 shutdown_connections 2023-10-18T19:39:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3dc40af970 0x7f3dc414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3dc40a1790 0x7f3dc4091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 --2- 172.21.15.88:0/2354671763 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3dc40a4c50 0x7f3dc40a8840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 >> 172.21.15.88:0/2354671763 conn(0x7f3dc405eb60 msgr2=0x7f3dc40ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 shutdown_connections 2023-10-18T19:39:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:19.239+0000 7f3dcb5ff700 1 -- 172.21.15.88:0/2354671763 wait complete. 2023-10-18T19:39:19.257 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:22.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:22.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.455+0000 7fe2d01ff700 1 Processor -- start 2023-10-18T19:39:22.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 -- start start 2023-10-18T19:39:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 0x7fe2c8135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2c81361c0 0x7fe2c81433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c805ed40 con 0x7fe2c805e960 2023-10-18T19:39:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c8136670 con 0x7fe2c81361c0 2023-10-18T19:39:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.456+0000 7fe2d01ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80a2ac0 con 0x7fe2c80a3580 2023-10-18T19:39:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2c81361c0 0x7fe2c81433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2cd79a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 0x7fe2c8135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2c81361c0 0x7fe2c81433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37740/0 (socket says 172.21.15.88:37740) 2023-10-18T19:39:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 -- 172.21.15.88:0/1280177907 learned_addr learned my addr 172.21.15.88:0/1280177907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 -- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 msgr2=0x7fe2c8135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 0x7fe2c8135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 -- 172.21.15.88:0/1280177907 >> v1:172.21.15.88:6789/0 conn(0x7fe2c805e960 legacy=0x7fe2c80a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 -- 172.21.15.88:0/1280177907 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80a2d60 con 0x7fe2c81361c0 2023-10-18T19:39:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2cd79a700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 0x7fe2c8135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ce79c700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c81361c0 0x7fe2c81433f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe2c0009f20 tx=0x7fe2c0009840).ready entity=mon.0 client_cookie=3d918ee7c834c984 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.457+0000 7fe2ccf99700 1 -- 172.21.15.88:0/1280177907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000e070 con 0x7fe2c81361c0 2023-10-18T19:39:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2ccf99700 1 -- 172.21.15.88:0/1280177907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000ba60 con 0x7fe2c81361c0 2023-10-18T19:39:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2ccf99700 1 -- 172.21.15.88:0/1280177907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000bde0 con 0x7fe2c81361c0 2023-10-18T19:39:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c81361c0 msgr2=0x7fe2c81433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c81361c0 0x7fe2c81433f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe2c0009f20 tx=0x7fe2c0009840).stop 2023-10-18T19:39:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280177907 shutdown_connections 2023-10-18T19:39:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c81361c0 0x7fe2c81433f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280177907 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c80a3580 0x7fe2c8135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280177907 >> 172.21.15.88:0/1280177907 conn(0x7fe2c8064bb0 msgr2=0x7fe2c805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280177907 shutdown_connections 2023-10-18T19:39:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.458+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280177907 wait complete. 2023-10-18T19:39:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.459+0000 7fe2d01ff700 1 Processor -- start 2023-10-18T19:39:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 -- start start 2023-10-18T19:39:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c805e960 0x7fe2c80a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c81361c0 0x7fe2c814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80a6fe0 con 0x7fe2c805e960 2023-10-18T19:39:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8137ea0 con 0x7fe2c80a3580 2023-10-18T19:39:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2d01ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80a5610 con 0x7fe2c81361c0 2023-10-18T19:39:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2cd79a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2cdf9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c805e960 0x7fe2c80a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2ce79c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c81361c0 0x7fe2c814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.460+0000 7fe2cd79a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59508/0 (socket says 172.21.15.88:59508) 2023-10-18T19:39:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 -- 172.21.15.88:0/1280890309 learned_addr learned my addr 172.21.15.88:0/1280890309 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 -- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c81361c0 msgr2=0x7fe2c814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c81361c0 0x7fe2c814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 -- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c805e960 msgr2=0x7fe2c80a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c805e960 0x7fe2c80a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 -- 172.21.15.88:0/1280890309 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80092a0 con 0x7fe2c80a3580 2023-10-18T19:39:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2cd79a700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe2b800e9d0 tx=0x7fe2b8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800c730 con 0x7fe2c80a3580 2023-10-18T19:39:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800c890 con 0x7fe2c80a3580 2023-10-18T19:39:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c0009ae0 con 0x7fe2c80a3580 2023-10-18T19:39:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800cc10 con 0x7fe2c80a3580 2023-10-18T19:39:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.461+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c80ac370 con 0x7fe2c80a3580 2023-10-18T19:39:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.463+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fe2b801b400 con 0x7fe2c80a3580 2023-10-18T19:39:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.463+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c80a62e0 con 0x7fe2c80a3580 2023-10-18T19:39:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.463+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fe2b8055e60 con 0x7fe2c80a3580 2023-10-18T19:39:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.467+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe2b80360e0 con 0x7fe2c80a3580 2023-10-18T19:39:22.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.634+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2c805f270 con 0x7fe2c80a3580 2023-10-18T19:39:22.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.635+0000 7fe2bdffb700 1 -- 172.21.15.88:0/1280890309 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe2b8016080 con 0x7fe2c80a3580 2023-10-18T19:39:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 >> v1:172.21.15.88:6800/113625 conn(0x7fe2ac041bc0 legacy=0x7fe2ac044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 msgr2=0x7fe2c80a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe2b800e9d0 tx=0x7fe2b8009060).stop 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 shutdown_connections 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2c81361c0 0x7fe2c814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c805e960 0x7fe2c80a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 --2- 172.21.15.88:0/1280890309 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c80a3580 0x7fe2c80a6610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.636+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 >> 172.21.15.88:0/1280890309 conn(0x7fe2c8064bb0 msgr2=0x7fe2c809f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.637+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 shutdown_connections 2023-10-18T19:39:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:22.637+0000 7fe2d01ff700 1 -- 172.21.15.88:0/1280890309 wait complete. 2023-10-18T19:39:22.655 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:25.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:25.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.851+0000 7f5b80bff700 1 Processor -- start 2023-10-18T19:39:25.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.851+0000 7f5b80bff700 1 -- start start 2023-10-18T19:39:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b80bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:25.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b80bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 0x7f5b7c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b80bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c05ed40 con 0x7f5b7c05e960 2023-10-18T19:39:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b80bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c136650 con 0x7f5b7c0a3580 2023-10-18T19:39:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b80bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0a2ac0 con 0x7f5b7c1361c0 2023-10-18T19:39:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b79d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:25.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 0x7f5b7c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b79d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37762/0 (socket says 172.21.15.88:37762) 2023-10-18T19:39:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b79d9b700 1 -- 172.21.15.88:0/3259976874 learned_addr learned my addr 172.21.15.88:0/3259976874 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 -- 172.21.15.88:0/3259976874 >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 msgr2=0x7f5b7c135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 --2- 172.21.15.88:0/3259976874 >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:25.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 -- 172.21.15.88:0/3259976874 >> v1:172.21.15.88:6789/0 conn(0x7f5b7c05e960 legacy=0x7f5b7c0a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 -- 172.21.15.88:0/3259976874 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0a2d60 con 0x7f5b7c1361c0 2023-10-18T19:39:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b79d9b700 1 --2- 172.21.15.88:0/3259976874 >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.852+0000 7f5b7ad9d700 1 --2- 172.21.15.88:0/3259976874 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 0x7f5b7c1433f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f5b74009e60 tx=0x7f5b74009780).ready entity=mon.2 client_cookie=4898ab671bd891d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b7959a700 1 -- 172.21.15.88:0/3259976874 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400e070 con 0x7f5b7c1361c0 2023-10-18T19:39:25.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b7959a700 1 -- 172.21.15.88:0/3259976874 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400bbf0 con 0x7f5b7c1361c0 2023-10-18T19:39:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b7959a700 1 -- 172.21.15.88:0/3259976874 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74012410 con 0x7f5b7c1361c0 2023-10-18T19:39:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 -- 172.21.15.88:0/3259976874 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 msgr2=0x7f5b7c1433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 --2- 172.21.15.88:0/3259976874 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 0x7f5b7c1433f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f5b74009e60 tx=0x7f5b74009780).stop 2023-10-18T19:39:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 -- 172.21.15.88:0/3259976874 shutdown_connections 2023-10-18T19:39:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 --2- 172.21.15.88:0/3259976874 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c1361c0 0x7f5b7c1433f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 --2- 172.21.15.88:0/3259976874 >> v2:172.21.15.88:3300/0 conn(0x7f5b7c0a3580 0x7f5b7c135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 -- 172.21.15.88:0/3259976874 >> 172.21.15.88:0/3259976874 conn(0x7f5b7c064bb0 msgr2=0x7f5b7c05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 -- 172.21.15.88:0/3259976874 shutdown_connections 2023-10-18T19:39:25.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.853+0000 7f5b80bff700 1 -- 172.21.15.88:0/3259976874 wait complete. 2023-10-18T19:39:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.855+0000 7f5b80bff700 1 Processor -- start 2023-10-18T19:39:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.855+0000 7f5b80bff700 1 -- start start 2023-10-18T19:39:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.855+0000 7f5b80bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 0x7f5b7c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.855+0000 7f5b80bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:25.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b80bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 0x7f5b7c139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b80bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0a5d20 con 0x7f5b7c0a3580 2023-10-18T19:39:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b80bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c148150 con 0x7f5b7c1361c0 2023-10-18T19:39:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b80bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1482c0 con 0x7f5b7c05e960 2023-10-18T19:39:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 0x7f5b7c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:25.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b79d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7ad9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 0x7f5b7c139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b79d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37774/0 (socket says 172.21.15.88:37774) 2023-10-18T19:39:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b79d9b700 1 -- 172.21.15.88:0/4136915447 learned_addr learned my addr 172.21.15.88:0/4136915447 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 -- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 msgr2=0x7f5b7c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:25.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 0x7f5b7c139120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:25.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 -- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 msgr2=0x7f5b7c0a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:25.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:25.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 -- 172.21.15.88:0/4136915447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70009370 con 0x7f5b7c05e960 2023-10-18T19:39:25.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7ad9d700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 0x7f5b7c139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:25.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b79d9b700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:25.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.856+0000 7f5b7a59c700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 0x7f5b7c13c220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5b6c00c440 tx=0x7f5b6c007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:25.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.857+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c007020 con 0x7f5b7c05e960 2023-10-18T19:39:25.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.857+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c007180 con 0x7f5b7c05e960 2023-10-18T19:39:25.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.857+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b74009a20 con 0x7f5b7c05e960 2023-10-18T19:39:25.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.857+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c007520 con 0x7f5b7c05e960 2023-10-18T19:39:25.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.857+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c138550 con 0x7f5b7c05e960 2023-10-18T19:39:25.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.858+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c05f270 con 0x7f5b7c05e960 2023-10-18T19:39:25.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.858+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f5b6c0068b0 con 0x7f5b7c05e960 2023-10-18T19:39:25.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.859+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f5b6c054bb0 con 0x7f5b7c05e960 2023-10-18T19:39:25.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:25.862+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5b6c034f50 con 0x7f5b7c05e960 2023-10-18T19:39:26.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.032+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b7c149120 con 0x7f5b7c05e960 2023-10-18T19:39:26.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.032+0000 7f5b6a7fc700 1 -- 172.21.15.88:0/4136915447 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5b6c038740 con 0x7f5b7c05e960 2023-10-18T19:39:26.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:26.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 >> v1:172.21.15.88:6800/113625 conn(0x7f5b5c041bc0 legacy=0x7f5b5c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:26.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 msgr2=0x7f5b7c13c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 0x7f5b7c13c220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5b6c00c440 tx=0x7f5b6c007d40).stop 2023-10-18T19:39:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 shutdown_connections 2023-10-18T19:39:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b7c1361c0 0x7f5b7c139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b7c05e960 0x7f5b7c13c220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.034+0000 7f5b80bff700 1 --2- 172.21.15.88:0/4136915447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b7c0a3580 0x7f5b7c0a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.035+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 >> 172.21.15.88:0/4136915447 conn(0x7f5b7c064bb0 msgr2=0x7f5b7c0ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.035+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 shutdown_connections 2023-10-18T19:39:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:26.035+0000 7f5b80bff700 1 -- 172.21.15.88:0/4136915447 wait complete. 2023-10-18T19:39:26.053 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:29.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.249+0000 7f5b3b9ff700 1 Processor -- start 2023-10-18T19:39:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 -- start start 2023-10-18T19:39:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 0x7f5b340a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b340a3a70 con 0x7f5b3405e960 2023-10-18T19:39:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3405ed40 con 0x7f5b340a4a20 2023-10-18T19:39:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.250+0000 7f5b3b9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34136670 con 0x7f5b341361c0 2023-10-18T19:39:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b38f9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b3979b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 0x7f5b340a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b38f9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:58670/0 (socket says 172.21.15.88:58670) 2023-10-18T19:39:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b3979b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 0x7f5b340a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33530/0 (socket says 172.21.15.88:33530) 2023-10-18T19:39:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b38f9a700 1 -- 172.21.15.88:0/4155595686 learned_addr learned my addr 172.21.15.88:0/4155595686 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 -- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 msgr2=0x7f5b34135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 -- 172.21.15.88:0/4155595686 >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 msgr2=0x7f5b340a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 --2- 172.21.15.88:0/4155595686 >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 0x7f5b340a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 -- 172.21.15.88:0/4155595686 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340a2ac0 con 0x7f5b341361c0 2023-10-18T19:39:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b38f9a700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.251+0000 7f5b39f9c700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5b2c009ec0 tx=0x7f5b2c009780).ready entity=mon.2 client_cookie=7132b169a972015a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b2bfff700 1 -- 172.21.15.88:0/4155595686 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00e070 con 0x7f5b341361c0 2023-10-18T19:39:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b2bfff700 1 -- 172.21.15.88:0/4155595686 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00bb30 con 0x7f5b341361c0 2023-10-18T19:39:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b2bfff700 1 -- 172.21.15.88:0/4155595686 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c012410 con 0x7f5b341361c0 2023-10-18T19:39:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 msgr2=0x7f5b34138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5b2c009ec0 tx=0x7f5b2c009780).stop 2023-10-18T19:39:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/4155595686 shutdown_connections 2023-10-18T19:39:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/4155595686 >> v2:172.21.15.88:3300/0 conn(0x7f5b3405e960 0x7f5b340a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/4155595686 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b340a4a20 0x7f5b34135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/4155595686 >> 172.21.15.88:0/4155595686 conn(0x7f5b34064bb0 msgr2=0x7f5b3405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/4155595686 shutdown_connections 2023-10-18T19:39:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.252+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/4155595686 wait complete. 2023-10-18T19:39:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.254+0000 7f5b3b9ff700 1 Processor -- start 2023-10-18T19:39:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.254+0000 7f5b3b9ff700 1 -- start start 2023-10-18T19:39:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.254+0000 7f5b3b9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.254+0000 7f5b3b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 0x7f5b340a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3b9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340a6d90 con 0x7f5b340a4a20 2023-10-18T19:39:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3b9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340a7eb0 con 0x7f5b3405e960 2023-10-18T19:39:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3b9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341485d0 con 0x7f5b341361c0 2023-10-18T19:39:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b38f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 0x7f5b340a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:58686/0 (socket says 172.21.15.88:58686) 2023-10-18T19:39:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 -- 172.21.15.88:0/1928956354 learned_addr learned my addr 172.21.15.88:0/1928956354 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b39f9c700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 -- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 msgr2=0x7f5b34138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 -- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 msgr2=0x7f5b340a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 0x7f5b340a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 -- 172.21.15.88:0/1928956354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009370 con 0x7f5b3405e960 2023-10-18T19:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b39f9c700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b38f9a700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 0x7f5b340a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.255+0000 7f5b3979b700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5b3000e930 tx=0x7f5b30009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.256+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30012600 con 0x7f5b3405e960 2023-10-18T19:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.256+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30012760 con 0x7f5b3405e960 2023-10-18T19:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.256+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c009a20 con 0x7f5b3405e960 2023-10-18T19:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.256+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30012ae0 con 0x7f5b3405e960 2023-10-18T19:39:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.256+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b340a88a0 con 0x7f5b3405e960 2023-10-18T19:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.257+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3405f270 con 0x7f5b3405e960 2023-10-18T19:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.257+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f5b3001b400 con 0x7f5b3405e960 2023-10-18T19:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.258+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f5b30055a90 con 0x7f5b3405e960 2023-10-18T19:39:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.261+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5b30035dd0 con 0x7f5b3405e960 2023-10-18T19:39:29.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.431+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b340a1100 con 0x7f5b3405e960 2023-10-18T19:39:29.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.431+0000 7f5b297fa700 1 -- 172.21.15.88:0/1928956354 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5b300395c0 con 0x7f5b3405e960 2023-10-18T19:39:29.433 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 >> v1:172.21.15.88:6800/113625 conn(0x7f5b18041b90 legacy=0x7f5b18044050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 msgr2=0x7f5b34147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5b3000e930 tx=0x7f5b30009060).stop 2023-10-18T19:39:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 shutdown_connections 2023-10-18T19:39:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b341361c0 0x7f5b34138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b3405e960 0x7f5b34147f10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 --2- 172.21.15.88:0/1928956354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b340a4a20 0x7f5b340a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 >> 172.21.15.88:0/1928956354 conn(0x7f5b34064bb0 msgr2=0x7f5b340a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 shutdown_connections 2023-10-18T19:39:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:29.433+0000 7f5b3b9ff700 1 -- 172.21.15.88:0/1928956354 wait complete. 2023-10-18T19:39:29.452 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:32.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:32.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.648+0000 7f2aa79ff700 1 Processor -- start 2023-10-18T19:39:32.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.648+0000 7f2aa79ff700 1 -- start start 2023-10-18T19:39:32.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00a13d0 0x7f2aa00a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2aa0135cb0 0x7f2aa0136130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00a0fc0 con 0x7f2aa0135cb0 2023-10-18T19:39:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00af5c0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0136620 con 0x7f2aa00af1e0 2023-10-18T19:39:32.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa4f9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00a13d0 0x7f2aa00a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa5f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2aa0135cb0 0x7f2aa0136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:41822/0 (socket says 172.21.15.88:41822) 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 -- 172.21.15.88:0/51892447 learned_addr learned my addr 172.21.15.88:0/51892447 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 -- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00a13d0 msgr2=0x7f2aa00a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 --2- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00a13d0 0x7f2aa00a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 -- 172.21.15.88:0/51892447 >> v2:172.21.15.88:3300/0 conn(0x7f2aa0135cb0 msgr2=0x7f2aa0136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 --2- 172.21.15.88:0/51892447 >> v2:172.21.15.88:3300/0 conn(0x7f2aa0135cb0 0x7f2aa0136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.649+0000 7f2aa579b700 1 -- 172.21.15.88:0/51892447 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00a4980 con 0x7f2aa00af1e0 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa579b700 1 --2- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2a9c009830 tx=0x7f2a9c0090f0).ready entity=mon.2 client_cookie=5b74504cf4b801aa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2a97fff700 1 -- 172.21.15.88:0/51892447 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00b530 con 0x7f2aa00af1e0 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2a97fff700 1 -- 172.21.15.88:0/51892447 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00b690 con 0x7f2aa00af1e0 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2a97fff700 1 -- 172.21.15.88:0/51892447 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00ba10 con 0x7f2aa00af1e0 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 -- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 msgr2=0x7f2aa00ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:32.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f2a9c009830 tx=0x7f2a9c0090f0).stop 2023-10-18T19:39:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 -- 172.21.15.88:0/51892447 shutdown_connections 2023-10-18T19:39:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa00af1e0 0x7f2aa00ac830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/51892447 >> v2:172.21.15.88:3300/0 conn(0x7f2aa0135cb0 0x7f2aa0136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/51892447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00a13d0 0x7f2aa00a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.650+0000 7f2aa79ff700 1 -- 172.21.15.88:0/51892447 >> 172.21.15.88:0/51892447 conn(0x7f2aa0064d50 msgr2=0x7f2aa0062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:32.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.651+0000 7f2aa79ff700 1 -- 172.21.15.88:0/51892447 shutdown_connections 2023-10-18T19:39:32.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.651+0000 7f2aa79ff700 1 -- 172.21.15.88:0/51892447 wait complete. 2023-10-18T19:39:32.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.652+0000 7f2aa79ff700 1 Processor -- start 2023-10-18T19:39:32.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.652+0000 7f2aa79ff700 1 -- start start 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 0x7f2aa014c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa0135cb0 0x7f2aa00a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00aa9f0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00a92a0 con 0x7f2aa00af1e0 2023-10-18T19:39:32.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00a9560 con 0x7f2aa0135cb0 2023-10-18T19:39:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33546/0 (socket says 172.21.15.88:33546) 2023-10-18T19:39:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 -- 172.21.15.88:0/3390598504 learned_addr learned my addr 172.21.15.88:0/3390598504 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa4f9a700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 0x7f2aa014c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa5f9c700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa0135cb0 0x7f2aa00a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 -- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa0135cb0 msgr2=0x7f2aa00a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa0135cb0 0x7f2aa00a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 -- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 msgr2=0x7f2aa014c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 0x7f2aa014c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa579b700 1 -- 172.21.15.88:0/3390598504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c009370 con 0x7f2aa00a13d0 2023-10-18T19:39:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.653+0000 7f2aa4f9a700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 0x7f2aa014c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2aa579b700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2a9c009e20 tx=0x7f2a9c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00be50 con 0x7f2aa00a13d0 2023-10-18T19:39:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00b800 con 0x7f2aa00a13d0 2023-10-18T19:39:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00a8c20 con 0x7f2aa00a13d0 2023-10-18T19:39:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c01c670 con 0x7f2aa00a13d0 2023-10-18T19:39:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.654+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00abfa0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.655+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa005f270 con 0x7f2aa00a13d0 2023-10-18T19:39:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.655+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f2a9c01c9e0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.656+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2a9c0572c0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.659+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2a9c006180 con 0x7f2aa00a13d0 2023-10-18T19:39:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.831+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2aa00afef0 con 0x7f2aa00a13d0 2023-10-18T19:39:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.831+0000 7f2a957fa700 1 -- 172.21.15.88:0/3390598504 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2a9c00b970 con 0x7f2aa00a13d0 2023-10-18T19:39:32.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 >> v1:172.21.15.88:6800/113625 conn(0x7f2a84041bc0 legacy=0x7f2a84044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 msgr2=0x7f2aa00ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2a9c009e20 tx=0x7f2a9c015000).stop 2023-10-18T19:39:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 shutdown_connections 2023-10-18T19:39:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2aa0135cb0 0x7f2aa00a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2aa00a13d0 0x7f2aa00ab3b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 --2- 172.21.15.88:0/3390598504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2aa00af1e0 0x7f2aa014c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 >> 172.21.15.88:0/3390598504 conn(0x7f2aa0064d50 msgr2=0x7f2aa00a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 shutdown_connections 2023-10-18T19:39:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:32.833+0000 7f2aa79ff700 1 -- 172.21.15.88:0/3390598504 wait complete. 2023-10-18T19:39:32.852 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:35.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:36.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.047+0000 7f29769ff700 1 Processor -- start 2023-10-18T19:39:36.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.047+0000 7f29769ff700 1 -- start start 2023-10-18T19:39:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.048+0000 7f29769ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29700af970 0x7f2970135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:36.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.048+0000 7f29769ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700a4c50 0x7f2970136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.048+0000 7f29769ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700afd50 con 0x7f29700a1790 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.048+0000 7f29769ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700a47a0 con 0x7f29700af970 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.048+0000 7f29769ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700a3a10 con 0x7f29700a4c50 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29700af970 0x7f2970135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29700af970 0x7f2970135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38186/0 (socket says 172.21.15.88:38186) 2023-10-18T19:39:36.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 -- 172.21.15.88:0/2630514523 learned_addr learned my addr 172.21.15.88:0/2630514523 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f2974f9c700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700a4c50 0x7f2970136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296f7fe700 1 --1- 172.21.15.88:0/2630514523 >> v1:172.21.15.88:6789/0 conn(0x7f29700a1790 0x7f297013bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60626/0 (socket says 172.21.15.88:60626) 2023-10-18T19:39:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 -- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700a4c50 msgr2=0x7f2970136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700a4c50 0x7f2970136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 -- 172.21.15.88:0/2630514523 >> v1:172.21.15.88:6789/0 conn(0x7f29700a1790 legacy=0x7f297013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 -- 172.21.15.88:0/2630514523 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700a32d0 con 0x7f29700af970 2023-10-18T19:39:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296effd700 1 -- 172.21.15.88:0/2630514523 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745604071 0 0) 0x7f29700afd50 con 0x7f29700a1790 2023-10-18T19:39:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296ffff700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700af970 0x7f2970135d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2960006fd0 tx=0x7f29600090f0).ready entity=mon.0 client_cookie=44906113b36a5710 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.049+0000 7f296effd700 1 -- 172.21.15.88:0/2630514523 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000b580 con 0x7f29700af970 2023-10-18T19:39:36.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f296effd700 1 -- 172.21.15.88:0/2630514523 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000b6e0 con 0x7f29700af970 2023-10-18T19:39:36.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f296effd700 1 -- 172.21.15.88:0/2630514523 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000ba60 con 0x7f29700af970 2023-10-18T19:39:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 -- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700af970 msgr2=0x7f2970135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700af970 0x7f2970135d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2960006fd0 tx=0x7f29600090f0).stop 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 -- 172.21.15.88:0/2630514523 shutdown_connections 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700a4c50 0x7f2970136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 --2- 172.21.15.88:0/2630514523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700af970 0x7f2970135d30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 -- 172.21.15.88:0/2630514523 >> 172.21.15.88:0/2630514523 conn(0x7f297005eb60 msgr2=0x7f29700af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 -- 172.21.15.88:0/2630514523 shutdown_connections 2023-10-18T19:39:36.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.050+0000 7f29769ff700 1 -- 172.21.15.88:0/2630514523 wait complete. 2023-10-18T19:39:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.051+0000 7f29769ff700 1 Processor -- start 2023-10-18T19:39:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 -- start start 2023-10-18T19:39:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 0x7f2970091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:36.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700af970 0x7f29700a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701490a0 con 0x7f29700a4c50 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700a97b0 con 0x7f29700af970 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.052+0000 7f29769ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ab240 con 0x7f29700a1790 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 0x7f2970091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:36.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f2974f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700af970 0x7f29700a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:46582/0 (socket says 172.21.15.88:46582) 2023-10-18T19:39:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 -- 172.21.15.88:0/2960243072 learned_addr learned my addr 172.21.15.88:0/2960243072 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 -- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700af970 msgr2=0x7f29700a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700af970 0x7f29700a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 -- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 msgr2=0x7f2970091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 0x7f2970091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 -- 172.21.15.88:0/2960243072 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009370 con 0x7f29700a1790 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296f7fe700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 0x7f2970091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f296ffff700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2960009130 tx=0x7f2960017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960000bc0 con 0x7f29700a1790 2023-10-18T19:39:36.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000b850 con 0x7f29700a1790 2023-10-18T19:39:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f29769ff700 1 -- 172.21.15.88:0/2960243072 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700ab500 con 0x7f29700a1790 2023-10-18T19:39:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.053+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960000d20 con 0x7f29700a1790 2023-10-18T19:39:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.054+0000 7f29769ff700 1 -- 172.21.15.88:0/2960243072 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700a8f60 con 0x7f29700a1790 2023-10-18T19:39:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.055+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297005f270 con 0x7f29700a1790 2023-10-18T19:39:36.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.055+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f296001b830 con 0x7f29700a1790 2023-10-18T19:39:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.056+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2960056fb0 con 0x7f29700a1790 2023-10-18T19:39:36.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.059+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f296003ad40 con 0x7f29700a1790 2023-10-18T19:39:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.230+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f29700a0ce0 con 0x7f29700a1790 2023-10-18T19:39:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.231+0000 7f2957fff700 1 -- 172.21.15.88:0/2960243072 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f296000b9c0 con 0x7f29700a1790 2023-10-18T19:39:36.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.232+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 >> v1:172.21.15.88:6800/113625 conn(0x7f295c041bc0 legacy=0x7f295c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.232+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 msgr2=0x7f29700aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.232+0000 7f2955ffb700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2960009130 tx=0x7f2960017000).stop 2023-10-18T19:39:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.232+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 shutdown_connections 2023-10-18T19:39:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f29700af970 0x7f29700a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f29700a1790 0x7f29700aac60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 --2- 172.21.15.88:0/2960243072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29700a4c50 0x7f2970091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 >> 172.21.15.88:0/2960243072 conn(0x7f297005eb60 msgr2=0x7f2970138e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 shutdown_connections 2023-10-18T19:39:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:36.233+0000 7f2955ffb700 1 -- 172.21.15.88:0/2960243072 wait complete. 2023-10-18T19:39:36.252 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:39.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:39.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.449+0000 7f9f857ff700 1 Processor -- start 2023-10-18T19:39:39.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.449+0000 7f9f857ff700 1 -- start start 2023-10-18T19:39:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.450+0000 7f9f857ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 0x7f9f8009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.450+0000 7f9f857ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f800aa190 0x7f9f80069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.450+0000 7f9f857ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8009d700 con 0x7f9f8006a0f0 2023-10-18T19:39:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.450+0000 7f9f857ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f80063280 con 0x7f9f800aa190 2023-10-18T19:39:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.450+0000 7f9f857ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800aa620 con 0x7f9f80062ea0 2023-10-18T19:39:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f800aa190 0x7f9f80069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 0x7f9f8009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:39.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f800aa190 0x7f9f80069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38198/0 (socket says 172.21.15.88:38198) 2023-10-18T19:39:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 -- 172.21.15.88:0/2271215932 learned_addr learned my addr 172.21.15.88:0/2271215932 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 -- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 msgr2=0x7f9f8009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 0x7f9f8009db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 -- 172.21.15.88:0/2271215932 >> v1:172.21.15.88:6789/0 conn(0x7f9f8006a0f0 legacy=0x7f9f800636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 -- 172.21.15.88:0/2271215932 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f800aa8c0 con 0x7f9f800aa190 2023-10-18T19:39:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7effd700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 0x7f9f8009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7e7fc700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f800aa190 0x7f9f80069c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f9f74006fd0 tx=0x7f9f740090f0).ready entity=mon.0 client_cookie=c0a1c69677657f70 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7dffb700 1 -- 172.21.15.88:0/2271215932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400b610 con 0x7f9f800aa190 2023-10-18T19:39:39.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7dffb700 1 -- 172.21.15.88:0/2271215932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400b770 con 0x7f9f800aa190 2023-10-18T19:39:39.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.451+0000 7f9f7dffb700 1 -- 172.21.15.88:0/2271215932 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400baf0 con 0x7f9f800aa190 2023-10-18T19:39:39.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 -- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f800aa190 msgr2=0x7f9f80069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f800aa190 0x7f9f80069c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f9f74006fd0 tx=0x7f9f740090f0).stop 2023-10-18T19:39:39.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 -- 172.21.15.88:0/2271215932 shutdown_connections 2023-10-18T19:39:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80062ea0 0x7f9f8009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 --2- 172.21.15.88:0/2271215932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f800aa190 0x7f9f80069c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 -- 172.21.15.88:0/2271215932 >> 172.21.15.88:0/2271215932 conn(0x7f9f80067ef0 msgr2=0x7f9f800625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:39.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 -- 172.21.15.88:0/2271215932 shutdown_connections 2023-10-18T19:39:39.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.452+0000 7f9f857ff700 1 -- 172.21.15.88:0/2271215932 wait complete. 2023-10-18T19:39:39.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.453+0000 7f9f857ff700 1 Processor -- start 2023-10-18T19:39:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.453+0000 7f9f857ff700 1 -- start start 2023-10-18T19:39:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80096410 0x7f9f8013ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:39.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9f8013bf10 0x7f9f80091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f80095950 con 0x7f9f80062ea0 2023-10-18T19:39:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f80095c30 con 0x7f9f80096410 2023-10-18T19:39:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f857ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f80094090 con 0x7f9f8013bf10 2023-10-18T19:39:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f7effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38214/0 (socket says 172.21.15.88:38214) 2023-10-18T19:39:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f7effd700 1 -- 172.21.15.88:0/1159041481 learned_addr learned my addr 172.21.15.88:0/1159041481 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f7e7fc700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80096410 0x7f9f8013ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.454+0000 7f9f7f7fe700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9f8013bf10 0x7f9f80091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 -- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9f8013bf10 msgr2=0x7f9f80091a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9f8013bf10 0x7f9f80091a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 -- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80096410 msgr2=0x7f9f8013ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80096410 0x7f9f8013ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 -- 172.21.15.88:0/1159041481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700092a0 con 0x7f9f80062ea0 2023-10-18T19:39:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f7effd700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9f7000ea20 tx=0x7f9f70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000ee60 con 0x7f9f80062ea0 2023-10-18T19:39:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7000c8e0 con 0x7f9f80062ea0 2023-10-18T19:39:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f74009370 con 0x7f9f80062ea0 2023-10-18T19:39:39.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000cc60 con 0x7f9f80062ea0 2023-10-18T19:39:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.455+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f80096810 con 0x7f9f80062ea0 2023-10-18T19:39:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.456+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f80096130 con 0x7f9f80062ea0 2023-10-18T19:39:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.457+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f9f7001b400 con 0x7f9f80062ea0 2023-10-18T19:39:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.457+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f9f70055d70 con 0x7f9f80062ea0 2023-10-18T19:39:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.461+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9f80096130 con 0x7f9f80062ea0 2023-10-18T19:39:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.636+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9f80096130 con 0x7f9f80062ea0 2023-10-18T19:39:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.637+0000 7f9f66ffd700 1 -- 172.21.15.88:0/1159041481 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9f80096130 con 0x7f9f80062ea0 2023-10-18T19:39:39.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 >> v1:172.21.15.88:6800/113625 conn(0x7f9f6c041bf0 legacy=0x7f9f6c0440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 msgr2=0x7f9f800a8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f9f7000ea20 tx=0x7f9f70009060).stop 2023-10-18T19:39:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 shutdown_connections 2023-10-18T19:39:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9f8013bf10 0x7f9f80091a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f80062ea0 0x7f9f800a8d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 --2- 172.21.15.88:0/1159041481 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f80096410 0x7f9f8013ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.638+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 >> 172.21.15.88:0/1159041481 conn(0x7f9f80067ef0 msgr2=0x7f9f800ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.639+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 shutdown_connections 2023-10-18T19:39:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:39.639+0000 7f9f857ff700 1 -- 172.21.15.88:0/1159041481 wait complete. 2023-10-18T19:39:39.658 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:42.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.853+0000 7f6e96dff700 1 Processor -- start 2023-10-18T19:39:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 -- start start 2023-10-18T19:39:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e900a1790 0x7f6e90136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e900afd50 con 0x7f6e900a4c50 2023-10-18T19:39:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e900a47a0 con 0x7f6e900a1790 2023-10-18T19:39:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.854+0000 7f6e96dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900a3a10 con 0x7f6e900af970 2023-10-18T19:39:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e900a1790 0x7f6e90136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e94b9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e900a1790 0x7f6e90136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38230/0 (socket says 172.21.15.88:38230) 2023-10-18T19:39:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e94b9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36474/0 (socket says 172.21.15.88:36474) 2023-10-18T19:39:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 -- 172.21.15.88:0/825979009 learned_addr learned my addr 172.21.15.88:0/825979009 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 -- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 msgr2=0x7f6e90135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 -- 172.21.15.88:0/825979009 >> v1:172.21.15.88:6789/0 conn(0x7f6e900a4c50 legacy=0x7f6e9013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:42.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 -- 172.21.15.88:0/825979009 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900a32d0 con 0x7f6e900a1790 2023-10-18T19:39:42.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e94b9b700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:42.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.855+0000 7f6e8ffff700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900a1790 0x7f6e90136220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6e7c006fd0 tx=0x7f6e7c0090f0).ready entity=mon.0 client_cookie=edf88963f829a924 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:42.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e8f7fe700 1 -- 172.21.15.88:0/825979009 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00b580 con 0x7f6e900a1790 2023-10-18T19:39:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e8f7fe700 1 -- 172.21.15.88:0/825979009 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c00b6e0 con 0x7f6e900a1790 2023-10-18T19:39:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e8f7fe700 1 -- 172.21.15.88:0/825979009 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00ba60 con 0x7f6e900a1790 2023-10-18T19:39:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 -- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900a1790 msgr2=0x7f6e90136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900a1790 0x7f6e90136220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6e7c006fd0 tx=0x7f6e7c0090f0).stop 2023-10-18T19:39:42.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 -- 172.21.15.88:0/825979009 shutdown_connections 2023-10-18T19:39:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900af970 0x7f6e90135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 --2- 172.21.15.88:0/825979009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900a1790 0x7f6e90136220 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 -- 172.21.15.88:0/825979009 >> 172.21.15.88:0/825979009 conn(0x7f6e9005eb60 msgr2=0x7f6e900af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 -- 172.21.15.88:0/825979009 shutdown_connections 2023-10-18T19:39:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.856+0000 7f6e96dff700 1 -- 172.21.15.88:0/825979009 wait complete. 2023-10-18T19:39:42.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 Processor -- start 2023-10-18T19:39:42.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 -- start start 2023-10-18T19:39:42.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e900a1790 0x7f6e900a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:42.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:42.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900af970 0x7f6e9013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:42.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900a8470 con 0x7f6e900af970 2023-10-18T19:39:42.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900a9810 con 0x7f6e900a4c50 2023-10-18T19:39:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.858+0000 7f6e96dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e900a7d00 con 0x7f6e900a1790 2023-10-18T19:39:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e9539c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900af970 0x7f6e9013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e94b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e900a1790 0x7f6e900a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:42.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36490/0 (socket says 172.21.15.88:36490) 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 -- 172.21.15.88:0/3100435189 learned_addr learned my addr 172.21.15.88:0/3100435189 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 -- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e900a1790 msgr2=0x7f6e900a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e900a1790 0x7f6e900a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 -- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900af970 msgr2=0x7f6e9013f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900af970 0x7f6e9013f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:42.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 -- 172.21.15.88:0/3100435189 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840092a0 con 0x7f6e900a4c50 2023-10-18T19:39:42.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.859+0000 7f6e8ffff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6e7c009fd0 tx=0x7f6e7c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:42.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.860+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c000bc0 con 0x7f6e900a4c50 2023-10-18T19:39:42.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.860+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c00b850 con 0x7f6e900a4c50 2023-10-18T19:39:42.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.860+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c000d20 con 0x7f6e900a4c50 2023-10-18T19:39:42.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.860+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c009370 con 0x7f6e900a4c50 2023-10-18T19:39:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.860+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e900a6580 con 0x7f6e900a4c50 2023-10-18T19:39:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.861+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e900a34c0 con 0x7f6e900a4c50 2023-10-18T19:39:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.861+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f6e7c01cad0 con 0x7f6e900a4c50 2023-10-18T19:39:42.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.862+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f6e7c0577d0 con 0x7f6e900a4c50 2023-10-18T19:39:42.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:42.865+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6e7c03b260 con 0x7f6e900a4c50 2023-10-18T19:39:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.032+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6e900a3010 con 0x7f6e900a4c50 2023-10-18T19:39:43.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.032+0000 7f6e8cff9700 1 -- 172.21.15.88:0/3100435189 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6e7c020070 con 0x7f6e900a4c50 2023-10-18T19:39:43.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 >> v1:172.21.15.88:6800/113625 conn(0x7f6e74041bf0 legacy=0x7f6e740440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 msgr2=0x7f6e900a7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6e7c009fd0 tx=0x7f6e7c017000).stop 2023-10-18T19:39:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 shutdown_connections 2023-10-18T19:39:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e900af970 0x7f6e9013f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6e900a1790 0x7f6e900a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 --2- 172.21.15.88:0/3100435189 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e900a4c50 0x7f6e900a7330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 >> 172.21.15.88:0/3100435189 conn(0x7f6e9005eb60 msgr2=0x7f6e90138290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 shutdown_connections 2023-10-18T19:39:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:43.034+0000 7f6e96dff700 1 -- 172.21.15.88:0/3100435189 wait complete. 2023-10-18T19:39:43.054 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:46.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:46.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.248+0000 7facfa5ff700 1 Processor -- start 2023-10-18T19:39:46.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.248+0000 7facfa5ff700 1 -- start start 2023-10-18T19:39:46.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.249+0000 7facfa5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7facf40af970 0x7facf4135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:46.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.249+0000 7facfa5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 0x7facf4136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:46.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.249+0000 7facfa5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf40afd50 con 0x7facf40a4c50 2023-10-18T19:39:46.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.249+0000 7facfa5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf40a47a0 con 0x7facf40af970 2023-10-18T19:39:46.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.249+0000 7facfa5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf40a3a10 con 0x7facf40a1790 2023-10-18T19:39:46.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7facf40af970 0x7facf4135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:46.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf37fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 0x7facf4136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:46.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7facf40af970 0x7facf4135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56660/0 (socket says 172.21.15.88:56660) 2023-10-18T19:39:46.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 -- 172.21.15.88:0/3322497785 learned_addr learned my addr 172.21.15.88:0/3322497785 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:46.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 -- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 msgr2=0x7facf4136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:46.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 0x7facf4136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 -- 172.21.15.88:0/3322497785 >> v1:172.21.15.88:6789/0 conn(0x7facf40a4c50 legacy=0x7facf413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 -- 172.21.15.88:0/3322497785 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40a32d0 con 0x7facf40af970 2023-10-18T19:39:46.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf37fe700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 0x7facf4136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:46.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.250+0000 7facf3fff700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40af970 0x7facf4135d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7face4006fd0 tx=0x7face40090f0).ready entity=mon.0 client_cookie=35e7d511370c4627 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:46.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facf2ffd700 1 -- 172.21.15.88:0/3322497785 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400b580 con 0x7facf40af970 2023-10-18T19:39:46.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facf2ffd700 1 -- 172.21.15.88:0/3322497785 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400b6e0 con 0x7facf40af970 2023-10-18T19:39:46.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facf2ffd700 1 -- 172.21.15.88:0/3322497785 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400ba60 con 0x7facf40af970 2023-10-18T19:39:46.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 -- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40af970 msgr2=0x7facf4135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40af970 0x7facf4135d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7face4006fd0 tx=0x7face40090f0).stop 2023-10-18T19:39:46.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 -- 172.21.15.88:0/3322497785 shutdown_connections 2023-10-18T19:39:46.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40af970 0x7facf4135d30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 --2- 172.21.15.88:0/3322497785 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40a1790 0x7facf4136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 -- 172.21.15.88:0/3322497785 >> 172.21.15.88:0/3322497785 conn(0x7facf405eb60 msgr2=0x7facf40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:46.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 -- 172.21.15.88:0/3322497785 shutdown_connections 2023-10-18T19:39:46.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.251+0000 7facfa5ff700 1 -- 172.21.15.88:0/3322497785 wait complete. 2023-10-18T19:39:46.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.252+0000 7facfa5ff700 1 Processor -- start 2023-10-18T19:39:46.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 -- start start 2023-10-18T19:39:46.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:46.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facf40a4c50 0x7facf40a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:46.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40af970 0x7facf414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:46.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40a8da0 con 0x7facf40a1790 2023-10-18T19:39:46.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40a9f40 con 0x7facf40a4c50 2023-10-18T19:39:46.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.253+0000 7facfa5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf40a92d0 con 0x7facf40af970 2023-10-18T19:39:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56668/0 (socket says 172.21.15.88:56668) 2023-10-18T19:39:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 -- 172.21.15.88:0/33394864 learned_addr learned my addr 172.21.15.88:0/33394864 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf8b9c700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40af970 0x7facf414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:46.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf37fe700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facf40a4c50 0x7facf40a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 -- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40af970 msgr2=0x7facf414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40af970 0x7facf414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 -- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facf40a4c50 msgr2=0x7facf40a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facf40a4c50 0x7facf40a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 -- 172.21.15.88:0/33394864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80092a0 con 0x7facf40a1790 2023-10-18T19:39:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facf3fff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7facf40a48e0 tx=0x7face4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4000bc0 con 0x7facf40a1790 2023-10-18T19:39:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400b850 con 0x7facf40a1790 2023-10-18T19:39:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.254+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4000d20 con 0x7facf40a1790 2023-10-18T19:39:46.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.255+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face4009370 con 0x7facf40a1790 2023-10-18T19:39:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.255+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf40a3800 con 0x7facf40a1790 2023-10-18T19:39:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.256+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf405f270 con 0x7facf40a1790 2023-10-18T19:39:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.256+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7face401bac0 con 0x7facf40a1790 2023-10-18T19:39:46.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.256+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7face4056ff0 con 0x7facf40a1790 2023-10-18T19:39:46.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.260+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7face403ab00 con 0x7facf40a1790 2023-10-18T19:39:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.431+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7facf40a37a0 con 0x7facf40a1790 2023-10-18T19:39:46.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.431+0000 7facdbfff700 1 -- 172.21.15.88:0/33394864 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7face403ab00 con 0x7facf40a1790 2023-10-18T19:39:46.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:46.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 >> v1:172.21.15.88:6800/113625 conn(0x7face0041bc0 legacy=0x7face0044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 msgr2=0x7facf40abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:46.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7facf40a48e0 tx=0x7face4017000).stop 2023-10-18T19:39:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 shutdown_connections 2023-10-18T19:39:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7facf40af970 0x7facf414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facf40a1790 0x7facf40abe60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 --2- 172.21.15.88:0/33394864 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facf40a4c50 0x7facf40a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 >> 172.21.15.88:0/33394864 conn(0x7facf405eb60 msgr2=0x7facf4138200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 shutdown_connections 2023-10-18T19:39:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:46.433+0000 7facfa5ff700 1 -- 172.21.15.88:0/33394864 wait complete. 2023-10-18T19:39:46.454 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:49.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.650+0000 7f5e56fff700 1 Processor -- start 2023-10-18T19:39:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.650+0000 7f5e56fff700 1 -- start start 2023-10-18T19:39:49.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e56fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 0x7f5e50135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:49.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e56fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 0x7f5e50136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:49.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e56fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e500afd50 con 0x7f5e500a1790 2023-10-18T19:39:49.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e56fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500a47a0 con 0x7f5e500af970 2023-10-18T19:39:49.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e56fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500a3a10 con 0x7f5e500a4c50 2023-10-18T19:39:49.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e5559c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 0x7f5e50136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:49.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e54d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 0x7f5e50135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:49.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.651+0000 7f5e4ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5e500a1790 0x7f5e5013bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45376/0 (socket says 172.21.15.88:45376) 2023-10-18T19:39:49.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e4ffff700 1 -- 172.21.15.88:0/1073230138 learned_addr learned my addr 172.21.15.88:0/1073230138 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:39:49.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 msgr2=0x7f5e50136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:49.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e54d9b700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 0x7f5e50136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1073230138 >> v1:172.21.15.88:6789/0 conn(0x7f5e500a1790 legacy=0x7f5e5013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e4f7fe700 1 -- 172.21.15.88:0/1073230138 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346625979 0 0) 0x7f5e500afd50 con 0x7f5e500a1790 2023-10-18T19:39:49.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1073230138 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e500a32d0 con 0x7f5e500af970 2023-10-18T19:39:49.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e5559c700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 0x7f5e50136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:49.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e54d9b700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 0x7f5e50135d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5e44009790 tx=0x7f5e44009060).ready entity=mon.1 client_cookie=2e3b071791b1c603 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e4f7fe700 1 -- 172.21.15.88:0/1073230138 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400f510 con 0x7f5e500af970 2023-10-18T19:39:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e4f7fe700 1 -- 172.21.15.88:0/1073230138 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400f670 con 0x7f5e500af970 2023-10-18T19:39:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.652+0000 7f5e4f7fe700 1 -- 172.21.15.88:0/1073230138 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400f9f0 con 0x7f5e500af970 2023-10-18T19:39:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 -- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 msgr2=0x7f5e50135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 0x7f5e50135d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5e44009790 tx=0x7f5e44009060).stop 2023-10-18T19:39:49.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 -- 172.21.15.88:0/1073230138 shutdown_connections 2023-10-18T19:39:49.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500a4c50 0x7f5e50136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1073230138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500af970 0x7f5e50135d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 -- 172.21.15.88:0/1073230138 >> 172.21.15.88:0/1073230138 conn(0x7f5e5005eb60 msgr2=0x7f5e500af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:49.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 -- 172.21.15.88:0/1073230138 shutdown_connections 2023-10-18T19:39:49.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.653+0000 7f5e56fff700 1 -- 172.21.15.88:0/1073230138 wait complete. 2023-10-18T19:39:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.654+0000 7f5e56fff700 1 Processor -- start 2023-10-18T19:39:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.654+0000 7f5e56fff700 1 -- start start 2023-10-18T19:39:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:49.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 0x7f5e500aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:49.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 0x7f5e5014c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:49.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500a95b0 con 0x7f5e500a4c50 2023-10-18T19:39:49.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500a7d10 con 0x7f5e500a1790 2023-10-18T19:39:49.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e56fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500a7fd0 con 0x7f5e500af970 2023-10-18T19:39:49.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e54d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:49.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 0x7f5e500aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:49.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e5559c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 0x7f5e5014c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e54d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:45182/0 (socket says 172.21.15.88:45182) 2023-10-18T19:39:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e4ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 0x7f5e500aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56674/0 (socket says 172.21.15.88:56674) 2023-10-18T19:39:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1458738493 learned_addr learned my addr 172.21.15.88:0/1458738493 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.655+0000 7f5e5559c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 0x7f5e5014c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56816/0 (socket says 172.21.15.88:56816) 2023-10-18T19:39:49.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 msgr2=0x7f5e5014c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 0x7f5e5014c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 msgr2=0x7f5e500aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 0x7f5e500aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 -- 172.21.15.88:0/1458738493 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009a20 con 0x7f5e500a1790 2023-10-18T19:39:49.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e54d9b700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5e44006d70 tx=0x7f5e44017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:49.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400f7e0 con 0x7f5e500a1790 2023-10-18T19:39:49.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400f940 con 0x7f5e500a1790 2023-10-18T19:39:49.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e440092a0 con 0x7f5e500a1790 2023-10-18T19:39:49.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4401c670 con 0x7f5e500a1790 2023-10-18T19:39:49.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.656+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5013ca80 con 0x7f5e500a1790 2023-10-18T19:39:49.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.657+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5005f270 con 0x7f5e500a1790 2023-10-18T19:39:49.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.657+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f5e4401ca60 con 0x7f5e500a1790 2023-10-18T19:39:49.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.658+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f5e44057660 con 0x7f5e500a1790 2023-10-18T19:39:49.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.662+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5e440089c0 con 0x7f5e500a1790 2023-10-18T19:39:49.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.830+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e5013cdf0 con 0x7f5e500a1790 2023-10-18T19:39:49.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.831+0000 7f5e4cff9700 1 -- 172.21.15.88:0/1458738493 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5e44020070 con 0x7f5e500a1790 2023-10-18T19:39:49.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 >> v1:172.21.15.88:6800/113625 conn(0x7f5e34041bc0 legacy=0x7f5e34044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 msgr2=0x7f5e500a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5e44006d70 tx=0x7f5e44017000).stop 2023-10-18T19:39:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 shutdown_connections 2023-10-18T19:39:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5e500af970 0x7f5e5014c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5e500a1790 0x7f5e500a8bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 --2- 172.21.15.88:0/1458738493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e500a4c50 0x7f5e500aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 >> 172.21.15.88:0/1458738493 conn(0x7f5e5005eb60 msgr2=0x7f5e50137160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 shutdown_connections 2023-10-18T19:39:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:49.833+0000 7f5e56fff700 1 -- 172.21.15.88:0/1458738493 wait complete. 2023-10-18T19:39:49.852 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:52.854 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:53.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.047+0000 7f58fadff700 1 Processor -- start 2023-10-18T19:39:53.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.047+0000 7f58fadff700 1 -- start start 2023-10-18T19:39:53.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58fadff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 0x7f58f41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:53.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58fadff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f58f40a4c50 0x7f58f41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:53.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58fadff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f40afd50 con 0x7f58f40af970 2023-10-18T19:39:53.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58fadff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40a47a0 con 0x7f58f40a4c50 2023-10-18T19:39:53.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58fadff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40a3a10 con 0x7f58f40a1790 2023-10-18T19:39:53.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f8b9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f58f40af970 0x7f58f4135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45382/0 (socket says 172.21.15.88:45382) 2023-10-18T19:39:53.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f8b9b700 1 -- 172.21.15.88:0/2909657673 learned_addr learned my addr 172.21.15.88:0/2909657673 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:39:53.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f3fff700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 0x7f58f41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:53.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 --2- 172.21.15.88:0/2909657673 >> v2:172.21.15.88:3300/0 conn(0x7f58f40a4c50 0x7f58f41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:53.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 -- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 msgr2=0x7f58f41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:53.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 0x7f58f41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 -- 172.21.15.88:0/2909657673 >> v1:172.21.15.88:6789/0 conn(0x7f58f40af970 legacy=0x7f58f4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 -- 172.21.15.88:0/2909657673 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40a32d0 con 0x7f58f40a4c50 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f3fff700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 0x7f58f41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.048+0000 7f58f939c700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f41437e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f58ec009e60 tx=0x7f58ec009780).ready entity=mon.0 client_cookie=b8f527d56a428f20 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58f37fe700 1 -- 172.21.15.88:0/2909657673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00e070 con 0x7f58f40a4c50 2023-10-18T19:39:53.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58f37fe700 1 -- 172.21.15.88:0/2909657673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec00bb60 con 0x7f58f40a4c50 2023-10-18T19:39:53.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58f37fe700 1 -- 172.21.15.88:0/2909657673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec012410 con 0x7f58f40a4c50 2023-10-18T19:39:53.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 -- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 msgr2=0x7f58f41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f41437e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f58ec009e60 tx=0x7f58ec009780).stop 2023-10-18T19:39:53.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 -- 172.21.15.88:0/2909657673 shutdown_connections 2023-10-18T19:39:53.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f41437e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 --2- 172.21.15.88:0/2909657673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40a1790 0x7f58f41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 -- 172.21.15.88:0/2909657673 >> 172.21.15.88:0/2909657673 conn(0x7f58f405eb60 msgr2=0x7f58f40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:53.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 -- 172.21.15.88:0/2909657673 shutdown_connections 2023-10-18T19:39:53.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.049+0000 7f58fadff700 1 -- 172.21.15.88:0/2909657673 wait complete. 2023-10-18T19:39:53.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.051+0000 7f58fadff700 1 Processor -- start 2023-10-18T19:39:53.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.051+0000 7f58fadff700 1 -- start start 2023-10-18T19:39:53.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:53.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f40a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:53.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 0x7f58f414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:53.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40ac390 con 0x7f58f40a4c50 2023-10-18T19:39:53.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40ab1e0 con 0x7f58f40af970 2023-10-18T19:39:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.052+0000 7f58fadff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58f414c930 con 0x7f58f40a1790 2023-10-18T19:39:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f939c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 0x7f58f414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:56826/0 (socket says 172.21.15.88:56826) 2023-10-18T19:39:53.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f40a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 -- 172.21.15.88:0/416174522 learned_addr learned my addr 172.21.15.88:0/416174522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 -- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 msgr2=0x7f58f414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 0x7f58f414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 -- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 msgr2=0x7f58f40a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f40a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 -- 172.21.15.88:0/416174522 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00092a0 con 0x7f58f40a1790 2023-10-18T19:39:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f939c700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 0x7f58f414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f3fff700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f40a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f8b9b700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f58e8001eb0 tx=0x7f58e8007e50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:53.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.053+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e80070d0 con 0x7f58f40a1790 2023-10-18T19:39:53.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.054+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8007230 con 0x7f58f40a1790 2023-10-18T19:39:53.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.054+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e80075d0 con 0x7f58f40a1790 2023-10-18T19:39:53.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.054+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec009a20 con 0x7f58f40a1790 2023-10-18T19:39:53.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.054+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f40aa440 con 0x7f58f40a1790 2023-10-18T19:39:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.055+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f405f270 con 0x7f58f40a1790 2023-10-18T19:39:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.055+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f58e80059b0 con 0x7f58f40a1790 2023-10-18T19:39:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.056+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f58e8054e00 con 0x7f58f40a1790 2023-10-18T19:39:53.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.059+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f58e80351a0 con 0x7f58f40a1790 2023-10-18T19:39:53.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.226+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f58f40a2d50 con 0x7f58f40a1790 2023-10-18T19:39:53.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.227+0000 7f58f0ff9700 1 -- 172.21.15.88:0/416174522 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f58e8038990 con 0x7f58f40a1790 2023-10-18T19:39:53.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:53.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.228+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 >> v1:172.21.15.88:6800/113625 conn(0x7f58d8041bc0 legacy=0x7f58d8044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.228+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 msgr2=0x7f58f4091a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:53.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.228+0000 7f58fadff700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f58e8001eb0 tx=0x7f58e8007e50).stop 2023-10-18T19:39:53.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 shutdown_connections 2023-10-18T19:39:53.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f58f40af970 0x7f58f414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f58f40a1790 0x7f58f4091a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 --2- 172.21.15.88:0/416174522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f40a4c50 0x7f58f40a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 >> 172.21.15.88:0/416174522 conn(0x7f58f405eb60 msgr2=0x7f58f40ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 shutdown_connections 2023-10-18T19:39:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:53.229+0000 7f58fadff700 1 -- 172.21.15.88:0/416174522 wait complete. 2023-10-18T19:39:53.248 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:56.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:56.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.443+0000 7f1cf95ff700 1 Processor -- start 2023-10-18T19:39:56.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.443+0000 7f1cf95ff700 1 -- start start 2023-10-18T19:39:56.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf95ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:56.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf95ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf4135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:56.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf95ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf405ed40 con 0x7f1cf41361c0 2023-10-18T19:39:56.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf95ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40a3a70 con 0x7f1cf405e960 2023-10-18T19:39:56.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf95ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4136640 con 0x7f1cf40a4a20 2023-10-18T19:39:56.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:56.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf27fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf4135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:56.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1cf41361c0 0x7f1cf4138ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51804/0 (socket says 172.21.15.88:51804) 2023-10-18T19:39:56.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf37fe700 1 -- 172.21.15.88:0/40287769 learned_addr learned my addr 172.21.15.88:0/40287769 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:39:56.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:43896/0 (socket says 172.21.15.88:43896) 2023-10-18T19:39:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf27fc700 1 -- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 msgr2=0x7f1cf40a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.444+0000 7f1cf1ffb700 1 -- 172.21.15.88:0/40287769 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273036572 0 0) 0x7f1cf405ed40 con 0x7f1cf41361c0 2023-10-18T19:39:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf27fc700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf27fc700 1 -- 172.21.15.88:0/40287769 >> v1:172.21.15.88:6789/0 conn(0x7f1cf41361c0 legacy=0x7f1cf4138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf27fc700 1 -- 172.21.15.88:0/40287769 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40a2ac0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf2ffd700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf27fc700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf4135cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1ce80097c0 tx=0x7f1ce8009060).ready entity=mon.2 client_cookie=3d058d877b08018f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf1ffb700 1 -- 172.21.15.88:0/40287769 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800b530 con 0x7f1cf40a4a20 2023-10-18T19:39:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf1ffb700 1 -- 172.21.15.88:0/40287769 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce800b690 con 0x7f1cf40a4a20 2023-10-18T19:39:56.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.445+0000 7f1cf1ffb700 1 -- 172.21.15.88:0/40287769 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800ba10 con 0x7f1cf40a4a20 2023-10-18T19:39:56.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 -- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 msgr2=0x7f1cf4135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf4135cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1ce80097c0 tx=0x7f1ce8009060).stop 2023-10-18T19:39:56.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 -- 172.21.15.88:0/40287769 shutdown_connections 2023-10-18T19:39:56.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf405e960 0x7f1cf40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/40287769 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf4135cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 -- 172.21.15.88:0/40287769 >> 172.21.15.88:0/40287769 conn(0x7f1cf4064bb0 msgr2=0x7f1cf405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:56.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 -- 172.21.15.88:0/40287769 shutdown_connections 2023-10-18T19:39:56.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.446+0000 7f1cf95ff700 1 -- 172.21.15.88:0/40287769 wait complete. 2023-10-18T19:39:56.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.448+0000 7f1cf95ff700 1 Processor -- start 2023-10-18T19:39:56.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.448+0000 7f1cf95ff700 1 -- start start 2023-10-18T19:39:56.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:56.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf40a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:56.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 0x7f1cf414bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:56.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40a8480 con 0x7f1cf405e960 2023-10-18T19:39:56.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4138220 con 0x7f1cf41361c0 2023-10-18T19:39:56.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf95ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40a7190 con 0x7f1cf40a4a20 2023-10-18T19:39:56.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 0x7f1cf414bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:56.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:56.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf27fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf40a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:56.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34028/0 (socket says 172.21.15.88:34028) 2023-10-18T19:39:56.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.449+0000 7f1cf2ffd700 1 -- 172.21.15.88:0/700284019 learned_addr learned my addr 172.21.15.88:0/700284019 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:56.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 -- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 msgr2=0x7f1cf414bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 0x7f1cf414bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 -- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 msgr2=0x7f1cf40a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 -- 172.21.15.88:0/700284019 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40092a0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf2ffd700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf37fe700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 0x7f1cf414bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf27fc700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf40a67c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1ce8014000 tx=0x7f1ce8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:56.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8021070 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8000bc0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce80092a0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce801c420 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.450+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf40a5770 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.451+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f1ce801c7d0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.452+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf405f270 con 0x7f1cf40a4a20 2023-10-18T19:39:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.452+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f1ce80568b0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.456+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f1ce803a560 con 0x7f1cf40a4a20 2023-10-18T19:39:56.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.624+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1cf413a7a0 con 0x7f1cf40a4a20 2023-10-18T19:39:56.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.624+0000 7f1cdaffd700 1 -- 172.21.15.88:0/700284019 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1ce803a380 con 0x7f1cf40a4a20 2023-10-18T19:39:56.627 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:39:56.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 >> v1:172.21.15.88:6800/113625 conn(0x7f1ce0041bc0 legacy=0x7f1ce0044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 msgr2=0x7f1cf40a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:56.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf40a67c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1ce8014000 tx=0x7f1ce8017000).stop 2023-10-18T19:39:56.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 shutdown_connections 2023-10-18T19:39:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1cf41361c0 0x7f1cf414bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1cf405e960 0x7f1cf40a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 --2- 172.21.15.88:0/700284019 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f1cf40a4a20 0x7f1cf40a67c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 >> 172.21.15.88:0/700284019 conn(0x7f1cf4064bb0 msgr2=0x7f1cf4139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 shutdown_connections 2023-10-18T19:39:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:56.626+0000 7f1cf95ff700 1 -- 172.21.15.88:0/700284019 wait complete. 2023-10-18T19:39:56.645 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:39:59.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:39:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.840+0000 7f2c963ff700 1 Processor -- start 2023-10-18T19:39:59.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.841+0000 7f2c963ff700 1 -- start start 2023-10-18T19:39:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.841+0000 7f2c963ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 0x7f2c90136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c963ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 0x7f2c90136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:59.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c963ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c900ab970 con 0x7f2c900ab590 2023-10-18T19:39:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c963ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90135a50 con 0x7f2c9006aa30 2023-10-18T19:39:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c963ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90135cf0 con 0x7f2c9006a310 2023-10-18T19:39:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c8f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 0x7f2c90136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:59.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c8ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c900ab590 0x7f2c90139630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51818/0 (socket says 172.21.15.88:51818) 2023-10-18T19:39:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c8ffff700 1 -- 172.21.15.88:0/49581407 learned_addr learned my addr 172.21.15.88:0/49581407 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:39:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 0x7f2c90136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c8effd700 1 -- 172.21.15.88:0/49581407 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400034706 0 0) 0x7f2c900ab970 con 0x7f2c900ab590 2023-10-18T19:39:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 -- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 msgr2=0x7f2c90136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:39:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 0x7f2c90136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 -- 172.21.15.88:0/49581407 >> v1:172.21.15.88:6789/0 conn(0x7f2c900ab590 legacy=0x7f2c90139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 -- 172.21.15.88:0/49581407 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90139d40 con 0x7f2c9006aa30 2023-10-18T19:39:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 0x7f2c90136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.842+0000 7f2c9499c700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 0x7f2c90136700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2c88009e90 tx=0x7f2c88009780).ready entity=mon.1 client_cookie=451fc779be44231f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c8effd700 1 -- 172.21.15.88:0/49581407 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800e070 con 0x7f2c9006aa30 2023-10-18T19:39:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c8effd700 1 -- 172.21.15.88:0/49581407 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8800bb60 con 0x7f2c9006aa30 2023-10-18T19:39:59.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c8effd700 1 -- 172.21.15.88:0/49581407 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88012410 con 0x7f2c9006aa30 2023-10-18T19:39:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 -- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 msgr2=0x7f2c90136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 0x7f2c90136700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2c88009e90 tx=0x7f2c88009780).stop 2023-10-18T19:39:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 -- 172.21.15.88:0/49581407 shutdown_connections 2023-10-18T19:39:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006aa30 0x7f2c90136700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 --2- 172.21.15.88:0/49581407 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c9006a310 0x7f2c90136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 -- 172.21.15.88:0/49581407 >> 172.21.15.88:0/49581407 conn(0x7f2c9005eb30 msgr2=0x7f2c900aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:39:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 -- 172.21.15.88:0/49581407 shutdown_connections 2023-10-18T19:39:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.843+0000 7f2c963ff700 1 -- 172.21.15.88:0/49581407 wait complete. 2023-10-18T19:39:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.845+0000 7f2c963ff700 1 Processor -- start 2023-10-18T19:39:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.845+0000 7f2c963ff700 1 -- start start 2023-10-18T19:39:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9006aa30 0x7f2c901344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 0x7f2c90134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:39:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c901486e0 con 0x7f2c9006aa30 2023-10-18T19:39:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90135480 con 0x7f2c9006a310 2023-10-18T19:39:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c963ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c90135210 con 0x7f2c900ab590 2023-10-18T19:39:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c8ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 0x7f2c90134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c8ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:43926/0 (socket says 172.21.15.88:43926) 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c8ffff700 1 -- 172.21.15.88:0/2228647717 learned_addr learned my addr 172.21.15.88:0/2228647717 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c8f7fe700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9006aa30 0x7f2c901344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 -- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 msgr2=0x7f2c901380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 -- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9006aa30 msgr2=0x7f2c901344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:39:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9006aa30 0x7f2c901344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:39:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c9499c700 1 -- 172.21.15.88:0/2228647717 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8400b540 con 0x7f2c900ab590 2023-10-18T19:39:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.846+0000 7f2c8ffff700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:39:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c9499c700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 0x7f2c90134990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2c88014000 tx=0x7f2c88009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:39:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8801d630 con 0x7f2c900ab590 2023-10-18T19:39:59.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8801d790 con 0x7f2c900ab590 2023-10-18T19:39:59.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88009a20 con 0x7f2c900ab590 2023-10-18T19:39:59.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8801db10 con 0x7f2c900ab590 2023-10-18T19:39:59.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.847+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c90138640 con 0x7f2c900ab590 2023-10-18T19:39:59.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.848+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9005f270 con 0x7f2c900ab590 2023-10-18T19:39:59.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.848+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f2c88026410 con 0x7f2c900ab590 2023-10-18T19:39:59.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.849+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2c880575c0 con 0x7f2c900ab590 2023-10-18T19:39:59.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:39:59.852+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2c8800a940 con 0x7f2c900ab590 2023-10-18T19:40:00.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.020+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2c90064ed0 con 0x7f2c900ab590 2023-10-18T19:40:00.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.020+0000 7f2c77fff700 1 -- 172.21.15.88:0/2228647717 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2c8803b0f0 con 0x7f2c900ab590 2023-10-18T19:40:00.023 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 >> v1:172.21.15.88:6800/113625 conn(0x7f2c7c041bc0 legacy=0x7f2c7c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 msgr2=0x7f2c90134990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 0x7f2c90134990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2c88014000 tx=0x7f2c88009780).stop 2023-10-18T19:40:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 shutdown_connections 2023-10-18T19:40:00.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2c900ab590 0x7f2c90134990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c9006a310 0x7f2c901380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 --2- 172.21.15.88:0/2228647717 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9006aa30 0x7f2c901344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 >> 172.21.15.88:0/2228647717 conn(0x7f2c9005eb30 msgr2=0x7f2c90135f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:00.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 shutdown_connections 2023-10-18T19:40:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:00.022+0000 7f2c963ff700 1 -- 172.21.15.88:0/2228647717 wait complete. 2023-10-18T19:40:00.041 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:03.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:03.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.239+0000 7fb83e5ff700 1 Processor -- start 2023-10-18T19:40:03.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.239+0000 7fb83e5ff700 1 -- start start 2023-10-18T19:40:03.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8380af970 0x7fb838135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a1790 0x7fb838136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 0x7fb83813bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8380afd50 con 0x7fb8380af970 2023-10-18T19:40:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380a47a0 con 0x7fb8380a4c50 2023-10-18T19:40:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380a3a10 con 0x7fb8380a1790 2023-10-18T19:40:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8380af970 0x7fb838135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83cb9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 0x7fb83813bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a1790 0x7fb838136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8380af970 0x7fb838135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34056/0 (socket says 172.21.15.88:34056) 2023-10-18T19:40:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 -- 172.21.15.88:0/4049233673 learned_addr learned my addr 172.21.15.88:0/4049233673 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 -- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a1790 msgr2=0x7fb838136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a1790 0x7fb838136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 -- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 msgr2=0x7fb83813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 0x7fb83813bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb837fff700 1 -- 172.21.15.88:0/4049233673 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380a32d0 con 0x7fb8380af970 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.240+0000 7fb83cb9c700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 0x7fb83813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb837fff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb838135d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb828009830 tx=0x7fb8280090f0).ready entity=mon.0 client_cookie=93baed7b5b913b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb836ffd700 1 -- 172.21.15.88:0/4049233673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800f510 con 0x7fb8380af970 2023-10-18T19:40:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb836ffd700 1 -- 172.21.15.88:0/4049233673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800f670 con 0x7fb8380af970 2023-10-18T19:40:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb836ffd700 1 -- 172.21.15.88:0/4049233673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800f9f0 con 0x7fb8380af970 2023-10-18T19:40:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb83e5ff700 1 -- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 msgr2=0x7fb838135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.241+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb838135d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fb828009830 tx=0x7fb8280090f0).stop 2023-10-18T19:40:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 -- 172.21.15.88:0/4049233673 shutdown_connections 2023-10-18T19:40:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a4c50 0x7fb83813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb838135d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/4049233673 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a1790 0x7fb838136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 -- 172.21.15.88:0/4049233673 >> 172.21.15.88:0/4049233673 conn(0x7fb83805eb60 msgr2=0x7fb8380af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 -- 172.21.15.88:0/4049233673 shutdown_connections 2023-10-18T19:40:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.242+0000 7fb83e5ff700 1 -- 172.21.15.88:0/4049233673 wait complete. 2023-10-18T19:40:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.243+0000 7fb83e5ff700 1 Processor -- start 2023-10-18T19:40:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.243+0000 7fb83e5ff700 1 -- start start 2023-10-18T19:40:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a1790 0x7fb8380a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380aabd0 con 0x7fb8380af970 2023-10-18T19:40:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380aa770 con 0x7fb8380a1790 2023-10-18T19:40:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83e5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380aa510 con 0x7fb8380a4c50 2023-10-18T19:40:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb837fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a1790 0x7fb8380a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34060/0 (socket says 172.21.15.88:34060) 2023-10-18T19:40:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 -- 172.21.15.88:0/2592730334 learned_addr learned my addr 172.21.15.88:0/2592730334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb8377fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:57678/0 (socket says 172.21.15.88:57678) 2023-10-18T19:40:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 -- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 msgr2=0x7fb8380aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 -- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a1790 msgr2=0x7fb8380a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:03.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a1790 0x7fb8380a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb83cb9c700 1 -- 172.21.15.88:0/2592730334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830009a20 con 0x7fb8380af970 2023-10-18T19:40:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.244+0000 7fb8377fe700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb83cb9c700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fb830009fc0 tx=0x7fb83000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000cbd0 con 0x7fb8380af970 2023-10-18T19:40:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000f040 con 0x7fb8380af970 2023-10-18T19:40:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830013400 con 0x7fb8380af970 2023-10-18T19:40:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb828009370 con 0x7fb8380af970 2023-10-18T19:40:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.245+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8380a6de0 con 0x7fb8380af970 2023-10-18T19:40:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.246+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8380af080 con 0x7fb8380af970 2023-10-18T19:40:03.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.246+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fb8300137f0 con 0x7fb8380af970 2023-10-18T19:40:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.247+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fb8300560d0 con 0x7fb8380af970 2023-10-18T19:40:03.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.250+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb830036470 con 0x7fb8380af970 2023-10-18T19:40:03.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.421+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb83805f270 con 0x7fb8380af970 2023-10-18T19:40:03.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.422+0000 7fb81ffff700 1 -- 172.21.15.88:0/2592730334 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb830039c60 con 0x7fb8380af970 2023-10-18T19:40:03.425 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:03.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.423+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 >> v1:172.21.15.88:6800/113625 conn(0x7fb824041bc0 legacy=0x7fb824044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 msgr2=0x7fb83814b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fb830009fc0 tx=0x7fb83000b040).stop 2023-10-18T19:40:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 shutdown_connections 2023-10-18T19:40:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8380af970 0x7fb83814b720 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8380a1790 0x7fb8380a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 --2- 172.21.15.88:0/2592730334 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb8380a4c50 0x7fb8380aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 >> 172.21.15.88:0/2592730334 conn(0x7fb83805eb60 msgr2=0x7fb8380627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 shutdown_connections 2023-10-18T19:40:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:03.424+0000 7fb83e5ff700 1 -- 172.21.15.88:0/2592730334 wait complete. 2023-10-18T19:40:03.443 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:06.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:06.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.638+0000 7f7828fff700 1 Processor -- start 2023-10-18T19:40:06.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 -- start start 2023-10-18T19:40:06.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f782405e960 0x7f78240a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:06.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78240a4a20 0x7f7824135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:06.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782405ed40 con 0x7f78241361c0 2023-10-18T19:40:06.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78240a3a70 con 0x7f782405e960 2023-10-18T19:40:06.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.639+0000 7f7828fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7824136670 con 0x7f78240a4a20 2023-10-18T19:40:06.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f782405e960 0x7f78240a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:06.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f7821d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78240a4a20 0x7f7824135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:06.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f782405e960 0x7f78240a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56998/0 (socket says 172.21.15.88:56998) 2023-10-18T19:40:06.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 -- 172.21.15.88:0/1837707119 learned_addr learned my addr 172.21.15.88:0/1837707119 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:06.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 -- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78240a4a20 msgr2=0x7f7824135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:06.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 --2- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78240a4a20 0x7f7824135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 -- 172.21.15.88:0/1837707119 >> v1:172.21.15.88:6789/0 conn(0x7f78241361c0 legacy=0x7f7824138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 -- 172.21.15.88:0/1837707119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240a2ac0 con 0x7f782405e960 2023-10-18T19:40:06.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782259c700 1 --2- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782405e960 0x7f78240a3580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f7814006fd0 tx=0x7f78140090f0).ready entity=mon.0 client_cookie=52baa4696c16de74 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:06.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782159a700 1 -- 172.21.15.88:0/1837707119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400b610 con 0x7f782405e960 2023-10-18T19:40:06.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782159a700 1 -- 172.21.15.88:0/1837707119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b770 con 0x7f782405e960 2023-10-18T19:40:06.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.640+0000 7f782159a700 1 -- 172.21.15.88:0/1837707119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400baf0 con 0x7f782405e960 2023-10-18T19:40:06.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 -- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782405e960 msgr2=0x7f78240a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 --2- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782405e960 0x7f78240a3580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f7814006fd0 tx=0x7f78140090f0).stop 2023-10-18T19:40:06.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 -- 172.21.15.88:0/1837707119 shutdown_connections 2023-10-18T19:40:06.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 --2- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782405e960 0x7f78240a3580 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 --2- 172.21.15.88:0/1837707119 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f78240a4a20 0x7f7824135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 -- 172.21.15.88:0/1837707119 >> 172.21.15.88:0/1837707119 conn(0x7f7824064bb0 msgr2=0x7f782405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:06.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 -- 172.21.15.88:0/1837707119 shutdown_connections 2023-10-18T19:40:06.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.641+0000 7f7828fff700 1 -- 172.21.15.88:0/1837707119 wait complete. 2023-10-18T19:40:06.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.642+0000 7f7828fff700 1 Processor -- start 2023-10-18T19:40:06.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 -- start start 2023-10-18T19:40:06.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:06.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78240a4a20 0x7f78240a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:06.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78241361c0 0x7f78240a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:06.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240a6d60 con 0x7f78241361c0 2023-10-18T19:40:06.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782414bd50 con 0x7f78240a4a20 2023-10-18T19:40:06.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7828fff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782414c010 con 0x7f782405e960 2023-10-18T19:40:06.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f782259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:06.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38378/0 (socket says 172.21.15.88:38378) 2023-10-18T19:40:06.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 -- 172.21.15.88:0/897694199 learned_addr learned my addr 172.21.15.88:0/897694199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:06.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.643+0000 7f7822d9d700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78241361c0 0x7f78240a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:06.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f7821d9b700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78240a4a20 0x7f78240a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:06.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 -- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78240a4a20 msgr2=0x7f78240a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78240a4a20 0x7f78240a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 -- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78241361c0 msgr2=0x7f78240a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78241361c0 0x7f78240a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 -- 172.21.15.88:0/897694199 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009370 con 0x7f782405e960 2023-10-18T19:40:06.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f782259c700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7814009130 tx=0x7f7814017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:06.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400beb0 con 0x7f782405e960 2023-10-18T19:40:06.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b8e0 con 0x7f782405e960 2023-10-18T19:40:06.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781401c650 con 0x7f782405e960 2023-10-18T19:40:06.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.644+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240a7a30 con 0x7f782405e960 2023-10-18T19:40:06.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.645+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78241389a0 con 0x7f782405e960 2023-10-18T19:40:06.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.645+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782405f270 con 0x7f782405e960 2023-10-18T19:40:06.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.646+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f781401ca40 con 0x7f782405e960 2023-10-18T19:40:06.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.647+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f78140578b0 con 0x7f782405e960 2023-10-18T19:40:06.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.650+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f7814006af0 con 0x7f782405e960 2023-10-18T19:40:06.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.819+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f78240a1100 con 0x7f782405e960 2023-10-18T19:40:06.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.821+0000 7f78127fc700 1 -- 172.21.15.88:0/897694199 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f7814006af0 con 0x7f782405e960 2023-10-18T19:40:06.823 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:06.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.822+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 >> v1:172.21.15.88:6800/113625 conn(0x7f7804041b90 legacy=0x7f7804044050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.822+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 msgr2=0x7f78240a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.822+0000 7f7828fff700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7814009130 tx=0x7f7814017000).stop 2023-10-18T19:40:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 shutdown_connections 2023-10-18T19:40:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78241361c0 0x7f78240a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f782405e960 0x7f78240a6530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 --2- 172.21.15.88:0/897694199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f78240a4a20 0x7f78240a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 >> 172.21.15.88:0/897694199 conn(0x7f7824064bb0 msgr2=0x7f78240a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 shutdown_connections 2023-10-18T19:40:06.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:06.823+0000 7f7828fff700 1 -- 172.21.15.88:0/897694199 wait complete. 2023-10-18T19:40:06.841 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:09.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:10.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.036+0000 7fc5837ff700 1 Processor -- start 2023-10-18T19:40:10.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.036+0000 7fc5837ff700 1 -- start start 2023-10-18T19:40:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc5837ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:10.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc5837ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc5837ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0ab970 con 0x7fc57c0ab590 2023-10-18T19:40:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc5837ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c135a50 con 0x7fc57c06aa30 2023-10-18T19:40:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc5837ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c135cf0 con 0x7fc57c06a310 2023-10-18T19:40:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc581d9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:10.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc58159b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc57c0ab590 0x7fc57c139630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45148/0 (socket says 172.21.15.88:45148) 2023-10-18T19:40:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc58159b700 1 -- 172.21.15.88:0/2999912054 learned_addr learned my addr 172.21.15.88:0/2999912054 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:40:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc580d9a700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc581d9c700 1 -- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 msgr2=0x7fc57c136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc581d9c700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc581d9c700 1 -- 172.21.15.88:0/2999912054 >> v1:172.21.15.88:6789/0 conn(0x7fc57c0ab590 legacy=0x7fc57c139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc573fff700 1 -- 172.21.15.88:0/2999912054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840732302 0 0) 0x7fc57c0ab970 con 0x7fc57c0ab590 2023-10-18T19:40:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc581d9c700 1 -- 172.21.15.88:0/2999912054 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c139d40 con 0x7fc57c06aa30 2023-10-18T19:40:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.037+0000 7fc580d9a700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc581d9c700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c136700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc574009e90 tx=0x7fc574009780).ready entity=mon.1 client_cookie=dad8ed6b4436148c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:10.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc573fff700 1 -- 172.21.15.88:0/2999912054 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400bb60 con 0x7fc57c06aa30 2023-10-18T19:40:10.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc573fff700 1 -- 172.21.15.88:0/2999912054 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400bcc0 con 0x7fc57c06aa30 2023-10-18T19:40:10.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc573fff700 1 -- 172.21.15.88:0/2999912054 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011690 con 0x7fc57c06aa30 2023-10-18T19:40:10.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc5837ff700 1 -- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 msgr2=0x7fc57c136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc5837ff700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c136700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc574009e90 tx=0x7fc574009780).stop 2023-10-18T19:40:10.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc5837ff700 1 -- 172.21.15.88:0/2999912054 shutdown_connections 2023-10-18T19:40:10.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.038+0000 7fc5837ff700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c136700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.039+0000 7fc5837ff700 1 --2- 172.21.15.88:0/2999912054 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.039+0000 7fc5837ff700 1 -- 172.21.15.88:0/2999912054 >> 172.21.15.88:0/2999912054 conn(0x7fc57c05eb30 msgr2=0x7fc57c0aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.039+0000 7fc5837ff700 1 -- 172.21.15.88:0/2999912054 shutdown_connections 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.039+0000 7fc5837ff700 1 -- 172.21.15.88:0/2999912054 wait complete. 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.040+0000 7fc5837ff700 1 Processor -- start 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.040+0000 7fc5837ff700 1 -- start start 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:10.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c095f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:10.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c0ab590 0x7fc57c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:10.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c148590 con 0x7fc57c0ab590 2023-10-18T19:40:10.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c13e4e0 con 0x7fc57c06aa30 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc5837ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1462c0 con 0x7fc57c06a310 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38398/0 (socket says 172.21.15.88:38398) 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 -- 172.21.15.88:0/4219312346 learned_addr learned my addr 172.21.15.88:0/4219312346 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc580d9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c095f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:10.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc581d9c700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c0ab590 0x7fc57c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:10.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 -- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 msgr2=0x7fc57c095f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c095f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 -- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c0ab590 msgr2=0x7fc57c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c0ab590 0x7fc57c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc58159b700 1 -- 172.21.15.88:0/4219312346 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0092a0 con 0x7fc57c06a310 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.041+0000 7fc580d9a700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c095f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc58159b700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc57800c490 tx=0x7fc578007e40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780070d0 con 0x7fc57c06a310 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578007230 con 0x7fc57c06a310 2023-10-18T19:40:10.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc574009a20 con 0x7fc57c06a310 2023-10-18T19:40:10.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780075f0 con 0x7fc57c06a310 2023-10-18T19:40:10.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.042+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c096470 con 0x7fc57c06a310 2023-10-18T19:40:10.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.043+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c05f270 con 0x7fc57c06a310 2023-10-18T19:40:10.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.043+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fc578005bc0 con 0x7fc57c06a310 2023-10-18T19:40:10.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.044+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fc578055090 con 0x7fc57c06a310 2023-10-18T19:40:10.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.047+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fc5780353f0 con 0x7fc57c06a310 2023-10-18T19:40:10.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.214+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc57c06a810 con 0x7fc57c06a310 2023-10-18T19:40:10.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.215+0000 7fc5717fa700 1 -- 172.21.15.88:0/4219312346 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc578038be0 con 0x7fc57c06a310 2023-10-18T19:40:10.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:10.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 >> v1:172.21.15.88:6800/113625 conn(0x7fc560041bc0 legacy=0x7fc560044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 msgr2=0x7fc57c13d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:10.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc57800c490 tx=0x7fc578007e40).stop 2023-10-18T19:40:10.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 shutdown_connections 2023-10-18T19:40:10.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc57c0ab590 0x7fc57c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc57c06a310 0x7fc57c13d9f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 --2- 172.21.15.88:0/4219312346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc57c06aa30 0x7fc57c095f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:10.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 >> 172.21.15.88:0/4219312346 conn(0x7fc57c05eb30 msgr2=0x7fc57c135f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:10.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 shutdown_connections 2023-10-18T19:40:10.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:10.216+0000 7fc5837ff700 1 -- 172.21.15.88:0/4219312346 wait complete. 2023-10-18T19:40:10.235 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:13.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:13.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.430+0000 7fc898bff700 1 Processor -- start 2023-10-18T19:40:13.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.430+0000 7fc898bff700 1 -- start start 2023-10-18T19:40:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 0x7fc8940a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 0x7fc894135be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89405ed40 con 0x7fc8940a38c0 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940a2fb0 con 0x7fc89405e960 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc898bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940a49d0 con 0x7fc8940a34a0 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc892d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc89259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 0x7fc8940a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc891d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 0x7fc894135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc892d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57028/0 (socket says 172.21.15.88:57028) 2023-10-18T19:40:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc89259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 0x7fc8940a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:39020/0 (socket says 172.21.15.88:39020) 2023-10-18T19:40:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.431+0000 7fc892d9d700 1 -- 172.21.15.88:0/1570119340 learned_addr learned my addr 172.21.15.88:0/1570119340 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 -- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 msgr2=0x7fc8940a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 --2- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 0x7fc8940a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 -- 172.21.15.88:0/1570119340 >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 msgr2=0x7fc8941360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 --2- 172.21.15.88:0/1570119340 >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 -- 172.21.15.88:0/1570119340 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940a4c70 con 0x7fc8940a34a0 2023-10-18T19:40:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc892d9d700 1 --2- 172.21.15.88:0/1570119340 >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc891d9b700 1 --2- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 0x7fc894135be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc888009790 tx=0x7fc888009060).ready entity=mon.2 client_cookie=da87c2a523dc64fd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:13.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc89159a700 1 -- 172.21.15.88:0/1570119340 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800d4a0 con 0x7fc8940a34a0 2023-10-18T19:40:13.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc89159a700 1 -- 172.21.15.88:0/1570119340 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800d600 con 0x7fc8940a34a0 2023-10-18T19:40:13.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.432+0000 7fc89159a700 1 -- 172.21.15.88:0/1570119340 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800d980 con 0x7fc8940a34a0 2023-10-18T19:40:13.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 -- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 msgr2=0x7fc894135be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:13.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 --2- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 0x7fc894135be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc888009790 tx=0x7fc888009060).stop 2023-10-18T19:40:13.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 -- 172.21.15.88:0/1570119340 shutdown_connections 2023-10-18T19:40:13.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 --2- 172.21.15.88:0/1570119340 >> v2:172.21.15.88:3300/0 conn(0x7fc8940a38c0 0x7fc8941360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 --2- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc89405e960 0x7fc8940a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 --2- 172.21.15.88:0/1570119340 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc8940a34a0 0x7fc894135be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 -- 172.21.15.88:0/1570119340 >> 172.21.15.88:0/1570119340 conn(0x7fc894064bb0 msgr2=0x7fc89405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:13.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 -- 172.21.15.88:0/1570119340 shutdown_connections 2023-10-18T19:40:13.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.433+0000 7fc898bff700 1 -- 172.21.15.88:0/1570119340 wait complete. 2023-10-18T19:40:13.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.435+0000 7fc898bff700 1 Processor -- start 2023-10-18T19:40:13.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.435+0000 7fc898bff700 1 -- start start 2023-10-18T19:40:13.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8940a34a0 0x7fc8940a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8940a38c0 0x7fc8941377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:13.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940a8220 con 0x7fc8940a38c0 2023-10-18T19:40:13.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940a7570 con 0x7fc8940a34a0 2023-10-18T19:40:13.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc898bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940a5790 con 0x7fc89405e960 2023-10-18T19:40:13.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc89259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc89259c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38408/0 (socket says 172.21.15.88:38408) 2023-10-18T19:40:13.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc89259c700 1 -- 172.21.15.88:0/1065400288 learned_addr learned my addr 172.21.15.88:0/1065400288 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc891d9b700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8940a34a0 0x7fc8940a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.436+0000 7fc892d9d700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8940a38c0 0x7fc8941377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 -- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8940a34a0 msgr2=0x7fc8940a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8940a34a0 0x7fc8940a7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 -- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8940a38c0 msgr2=0x7fc8941377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:13.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8940a38c0 0x7fc8941377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 -- 172.21.15.88:0/1065400288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009ae0 con 0x7fc89405e960 2023-10-18T19:40:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc89259c700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc88400e930 tx=0x7fc884009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400c680 con 0x7fc89405e960 2023-10-18T19:40:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400c7e0 con 0x7fc89405e960 2023-10-18T19:40:13.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880092a0 con 0x7fc89405e960 2023-10-18T19:40:13.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400cb60 con 0x7fc89405e960 2023-10-18T19:40:13.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.437+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8940a5a80 con 0x7fc89405e960 2023-10-18T19:40:13.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.438+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8940a7a70 con 0x7fc89405e960 2023-10-18T19:40:13.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.438+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fc88401b400 con 0x7fc89405e960 2023-10-18T19:40:13.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.439+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fc884055e10 con 0x7fc89405e960 2023-10-18T19:40:13.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.442+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fc884036090 con 0x7fc89405e960 2023-10-18T19:40:13.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.614+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc89405f270 con 0x7fc89405e960 2023-10-18T19:40:13.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.614+0000 7fc8827fc700 1 -- 172.21.15.88:0/1065400288 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc884054a50 con 0x7fc89405e960 2023-10-18T19:40:13.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 >> v1:172.21.15.88:6800/113625 conn(0x7fc874041bc0 legacy=0x7fc874044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 msgr2=0x7fc89413c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc88400e930 tx=0x7fc884009060).stop 2023-10-18T19:40:13.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 shutdown_connections 2023-10-18T19:40:13.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8940a38c0 0x7fc8941377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fc89405e960 0x7fc89413c980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 --2- 172.21.15.88:0/1065400288 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8940a34a0 0x7fc8940a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:13.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 >> 172.21.15.88:0/1065400288 conn(0x7fc894064bb0 msgr2=0x7fc894134eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:13.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 shutdown_connections 2023-10-18T19:40:13.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:13.616+0000 7fc898bff700 1 -- 172.21.15.88:0/1065400288 wait complete. 2023-10-18T19:40:13.634 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:16.636 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:16.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.830+0000 7f4e615ff700 1 Processor -- start 2023-10-18T19:40:16.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.830+0000 7f4e615ff700 1 -- start start 2023-10-18T19:40:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e615ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e615ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 0x7f4e5c0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e615ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c05e630 con 0x7f4e5c0a8b70 2023-10-18T19:40:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e615ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0a7260 con 0x7f4e5c0a6aa0 2023-10-18T19:40:16.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e615ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0a1a70 con 0x7f4e5c05e250 2023-10-18T19:40:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e5affd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e5a7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 0x7f4e5c0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e5affd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45062/0 (socket says 172.21.15.88:45062) 2023-10-18T19:40:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e5affd700 1 -- 172.21.15.88:0/4155969445 learned_addr learned my addr 172.21.15.88:0/4155969445 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:16.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.831+0000 7f4e5b7fe700 1 --1- 172.21.15.88:0/4155969445 >> v1:172.21.15.88:6789/0 conn(0x7f4e5c0a8b70 0x7f4e5c13c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60016/0 (socket says 172.21.15.88:60016) 2023-10-18T19:40:16.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5affd700 1 -- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 msgr2=0x7f4e5c0a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:16.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5affd700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 0x7f4e5c0a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:16.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5affd700 1 -- 172.21.15.88:0/4155969445 >> v1:172.21.15.88:6789/0 conn(0x7f4e5c0a8b70 legacy=0x7f4e5c13c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:16.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e59ffb700 1 -- 172.21.15.88:0/4155969445 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733160119 0 0) 0x7f4e5c05e630 con 0x7f4e5c0a8b70 2023-10-18T19:40:16.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5affd700 1 -- 172.21.15.88:0/4155969445 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c0a8060 con 0x7f4e5c05e250 2023-10-18T19:40:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5a7fc700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 0x7f4e5c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e5affd700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4e4c009830 tx=0x7f4e4c0090f0).ready entity=mon.2 client_cookie=c7a157bb448b6a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e59ffb700 1 -- 172.21.15.88:0/4155969445 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00b520 con 0x7f4e5c05e250 2023-10-18T19:40:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e59ffb700 1 -- 172.21.15.88:0/4155969445 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00b680 con 0x7f4e5c05e250 2023-10-18T19:40:16.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.832+0000 7f4e59ffb700 1 -- 172.21.15.88:0/4155969445 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ba00 con 0x7f4e5c05e250 2023-10-18T19:40:16.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 -- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 msgr2=0x7f4e5c0a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:16.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4e4c009830 tx=0x7f4e4c0090f0).stop 2023-10-18T19:40:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 -- 172.21.15.88:0/4155969445 shutdown_connections 2023-10-18T19:40:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c0a1580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 --2- 172.21.15.88:0/4155969445 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a6aa0 0x7f4e5c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 -- 172.21.15.88:0/4155969445 >> 172.21.15.88:0/4155969445 conn(0x7f4e5c0665a0 msgr2=0x7f4e5c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 -- 172.21.15.88:0/4155969445 shutdown_connections 2023-10-18T19:40:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.833+0000 7f4e615ff700 1 -- 172.21.15.88:0/4155969445 wait complete. 2023-10-18T19:40:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.834+0000 7f4e615ff700 1 Processor -- start 2023-10-18T19:40:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.834+0000 7f4e615ff700 1 -- start start 2023-10-18T19:40:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 0x7f4e5c14c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:16.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a8b70 0x7f4e5c0a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:16.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c13c580 con 0x7f4e5c0a6aa0 2023-10-18T19:40:16.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0a34f0 con 0x7f4e5c0a8b70 2023-10-18T19:40:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e615ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1344d0 con 0x7f4e5c05e250 2023-10-18T19:40:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e5affd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e5affd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45076/0 (socket says 172.21.15.88:45076) 2023-10-18T19:40:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e5affd700 1 -- 172.21.15.88:0/3220188531 learned_addr learned my addr 172.21.15.88:0/3220188531 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e5a7fc700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 0x7f4e5c14c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.835+0000 7f4e5b7fe700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a8b70 0x7f4e5c0a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 -- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a8b70 msgr2=0x7f4e5c0a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a8b70 0x7f4e5c0a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 -- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 msgr2=0x7f4e5c14c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 0x7f4e5c14c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 -- 172.21.15.88:0/3220188531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500092a0 con 0x7f4e5c05e250 2023-10-18T19:40:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5a7fc700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 0x7f4e5c14c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e5affd700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e4c009130 tx=0x7f4e4c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c000bc0 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00b7f0 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c000d20 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c009370 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.836+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c0a2f90 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.837+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c05f270 con 0x7f4e5c05e250 2023-10-18T19:40:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.837+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f4e4c01c8c0 con 0x7f4e5c05e250 2023-10-18T19:40:16.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.838+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f4e4c0575e0 con 0x7f4e5c05e250 2023-10-18T19:40:16.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:16.841+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f4e4c006ad0 con 0x7f4e5c05e250 2023-10-18T19:40:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.008+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e5c0a0de0 con 0x7f4e5c05e250 2023-10-18T19:40:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.008+0000 7f4e42ffd700 1 -- 172.21.15.88:0/3220188531 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f4e4c020070 con 0x7f4e5c05e250 2023-10-18T19:40:17.011 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 >> v1:172.21.15.88:6800/113625 conn(0x7f4e48041bc0 legacy=0x7f4e48044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 msgr2=0x7f4e5c14bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e4c009130 tx=0x7f4e4c017000).stop 2023-10-18T19:40:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 shutdown_connections 2023-10-18T19:40:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e5c0a8b70 0x7f4e5c0a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4e5c05e250 0x7f4e5c14bdc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 --2- 172.21.15.88:0/3220188531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e5c0a6aa0 0x7f4e5c14c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:17.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 >> 172.21.15.88:0/3220188531 conn(0x7f4e5c0665a0 msgr2=0x7f4e5c062d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:17.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.010+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 shutdown_connections 2023-10-18T19:40:17.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:17.011+0000 7f4e615ff700 1 -- 172.21.15.88:0/3220188531 wait complete. 2023-10-18T19:40:17.029 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:20.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:20.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.228+0000 7fa38a5ff700 1 Processor -- start 2023-10-18T19:40:20.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.228+0000 7fa38a5ff700 1 -- start start 2023-10-18T19:40:20.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa38a5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:20.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa38a5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 0x7fa3841433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:20.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa38a5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38405ed40 con 0x7fa38405e960 2023-10-18T19:40:20.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa38a5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384136670 con 0x7fa3840a3580 2023-10-18T19:40:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa38a5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840a2ac0 con 0x7fa3841361c0 2023-10-18T19:40:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa3837fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa388b9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 0x7fa3841433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa383fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa38405e960 0x7fa3840a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60030/0 (socket says 172.21.15.88:60030) 2023-10-18T19:40:20.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.229+0000 7fa383fff700 1 -- 172.21.15.88:0/3652901077 learned_addr learned my addr 172.21.15.88:0/3652901077 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:40:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa382ffd700 1 -- 172.21.15.88:0/3652901077 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636495452 0 0) 0x7fa38405ed40 con 0x7fa38405e960 2023-10-18T19:40:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa382ffd700 1 -- 172.21.15.88:0/3652901077 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa36c0033f0 con 0x7fa38405e960 2023-10-18T19:40:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa388b9c700 1 -- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 msgr2=0x7fa384135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa388b9c700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa388b9c700 1 -- 172.21.15.88:0/3652901077 >> v1:172.21.15.88:6789/0 conn(0x7fa38405e960 legacy=0x7fa3840a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa388b9c700 1 -- 172.21.15.88:0/3652901077 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840a2d60 con 0x7fa3841361c0 2023-10-18T19:40:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa3837fe700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa388b9c700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 0x7fa3841433f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa37c009ec0 tx=0x7fa37c009780).ready entity=mon.2 client_cookie=9f887ad0744ea0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa382ffd700 1 -- 172.21.15.88:0/3652901077 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00e070 con 0x7fa3841361c0 2023-10-18T19:40:20.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa382ffd700 1 -- 172.21.15.88:0/3652901077 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c00bb70 con 0x7fa3841361c0 2023-10-18T19:40:20.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.230+0000 7fa382ffd700 1 -- 172.21.15.88:0/3652901077 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c012410 con 0x7fa3841361c0 2023-10-18T19:40:20.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 msgr2=0x7fa3841433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 0x7fa3841433f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa37c009ec0 tx=0x7fa37c009780).stop 2023-10-18T19:40:20.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3652901077 shutdown_connections 2023-10-18T19:40:20.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa3841361c0 0x7fa3841433f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3652901077 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3652901077 >> 172.21.15.88:0/3652901077 conn(0x7fa384064bb0 msgr2=0x7fa38405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:20.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3652901077 shutdown_connections 2023-10-18T19:40:20.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.231+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3652901077 wait complete. 2023-10-18T19:40:20.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.233+0000 7fa38a5ff700 1 Processor -- start 2023-10-18T19:40:20.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.233+0000 7fa38a5ff700 1 -- start start 2023-10-18T19:40:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa38405e960 0x7fa384148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3841361c0 0x7fa3840a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840a8590 con 0x7fa3841361c0 2023-10-18T19:40:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840a8ad0 con 0x7fa3840a3580 2023-10-18T19:40:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa38a5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa384148790 con 0x7fa38405e960 2023-10-18T19:40:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa3837fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa383fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa38405e960 0x7fa384148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa388b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3841361c0 0x7fa3840a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa3837fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:53052/0 (socket says 172.21.15.88:53052) 2023-10-18T19:40:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.234+0000 7fa3837fe700 1 -- 172.21.15.88:0/3649727811 learned_addr learned my addr 172.21.15.88:0/3649727811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 -- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa38405e960 msgr2=0x7fa384148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa38405e960 0x7fa384148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 -- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3841361c0 msgr2=0x7fa3840a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3841361c0 0x7fa3840a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 -- 172.21.15.88:0/3649727811 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780092a0 con 0x7fa3840a3580 2023-10-18T19:40:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa3837fe700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa37800e9d0 tx=0x7fa378009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800c6a0 con 0x7fa3840a3580 2023-10-18T19:40:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800c800 con 0x7fa3840a3580 2023-10-18T19:40:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800cb80 con 0x7fa3840a3580 2023-10-18T19:40:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c009a20 con 0x7fa3840a3580 2023-10-18T19:40:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.235+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840a56a0 con 0x7fa3840a3580 2023-10-18T19:40:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.236+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38405f270 con 0x7fa3840a3580 2023-10-18T19:40:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.237+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fa37801b400 con 0x7fa3840a3580 2023-10-18T19:40:20.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.237+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fa378055dd0 con 0x7fa3840a3580 2023-10-18T19:40:20.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.240+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa378036050 con 0x7fa3840a3580 2023-10-18T19:40:20.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.408+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa38413cef0 con 0x7fa3840a3580 2023-10-18T19:40:20.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.409+0000 7fa36bfff700 1 -- 172.21.15.88:0/3649727811 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa378016080 con 0x7fa3840a3580 2023-10-18T19:40:20.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.410+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 >> v1:172.21.15.88:6800/113625 conn(0x7fa370041bc0 legacy=0x7fa370044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.410+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 msgr2=0x7fa384138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.410+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa37800e9d0 tx=0x7fa378009060).stop 2023-10-18T19:40:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 shutdown_connections 2023-10-18T19:40:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3841361c0 0x7fa3840a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa38405e960 0x7fa384148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 --2- 172.21.15.88:0/3649727811 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3840a3580 0x7fa384138e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 >> 172.21.15.88:0/3649727811 conn(0x7fa384064bb0 msgr2=0x7fa38413c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 shutdown_connections 2023-10-18T19:40:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:20.411+0000 7fa38a5ff700 1 -- 172.21.15.88:0/3649727811 wait complete. 2023-10-18T19:40:20.429 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:23.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:23.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.625+0000 7f43319ff700 1 Processor -- start 2023-10-18T19:40:23.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.625+0000 7f43319ff700 1 -- start start 2023-10-18T19:40:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.626+0000 7f43319ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f432c0a6b10 0x7f432c135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.626+0000 7f43319ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f43319ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c0a6330 con 0x7f432c05e250 2023-10-18T19:40:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f43319ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c05e630 con 0x7f432c0a6b10 2023-10-18T19:40:23.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f43319ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0a1f80 con 0x7f432c1361e0 2023-10-18T19:40:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f432c0a6b10 0x7f432c135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f432c0a6b10 0x7f432c135cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34748/0 (socket says 172.21.15.88:34748) 2023-10-18T19:40:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 -- 172.21.15.88:0/3702710990 learned_addr learned my addr 172.21.15.88:0/3702710990 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:23.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 -- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 msgr2=0x7f432c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 --2- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 -- 172.21.15.88:0/3702710990 >> v1:172.21.15.88:6789/0 conn(0x7f432c05e250 legacy=0x7f432c0a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 -- 172.21.15.88:0/3702710990 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0a2240 con 0x7f432c0a6b10 2023-10-18T19:40:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.627+0000 7f432a7fc700 1 --2- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c135cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4320006fd0 tx=0x7f43200090f0).ready entity=mon.0 client_cookie=49494088ab33d2ba server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:23.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f4329ffb700 1 -- 172.21.15.88:0/3702710990 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000b580 con 0x7f432c0a6b10 2023-10-18T19:40:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f4329ffb700 1 -- 172.21.15.88:0/3702710990 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000b6e0 con 0x7f432c0a6b10 2023-10-18T19:40:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f4329ffb700 1 -- 172.21.15.88:0/3702710990 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000ba60 con 0x7f432c0a6b10 2023-10-18T19:40:23.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 -- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 msgr2=0x7f432c135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 --2- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c135cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4320006fd0 tx=0x7f43200090f0).stop 2023-10-18T19:40:23.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 -- 172.21.15.88:0/3702710990 shutdown_connections 2023-10-18T19:40:23.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 --2- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 --2- 172.21.15.88:0/3702710990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c135cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 -- 172.21.15.88:0/3702710990 >> 172.21.15.88:0/3702710990 conn(0x7f432c0665a0 msgr2=0x7f432c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:23.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 -- 172.21.15.88:0/3702710990 shutdown_connections 2023-10-18T19:40:23.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.628+0000 7f43319ff700 1 -- 172.21.15.88:0/3702710990 wait complete. 2023-10-18T19:40:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.630+0000 7f43319ff700 1 Processor -- start 2023-10-18T19:40:23.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.630+0000 7f43319ff700 1 -- start start 2023-10-18T19:40:23.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.630+0000 7f43319ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 0x7f432c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:23.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.630+0000 7f43319ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:23.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.630+0000 7f43319ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f43319ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c14c840 con 0x7f432c0a6b10 2023-10-18T19:40:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f43319ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0a4320 con 0x7f432c1361e0 2023-10-18T19:40:23.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f43319ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0a45e0 con 0x7f432c05e250 2023-10-18T19:40:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432affd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 0x7f432c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:23.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34752/0 (socket says 172.21.15.88:34752) 2023-10-18T19:40:23.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 -- 172.21.15.88:0/3899487215 learned_addr learned my addr 172.21.15.88:0/3899487215 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:23.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432affd700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 0x7f432c0a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:45104/0 (socket says 172.21.15.88:45104) 2023-10-18T19:40:23.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432b7fe700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:23.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 -- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 msgr2=0x7f432c0a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 0x7f432c0a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 -- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 msgr2=0x7f432c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 -- 172.21.15.88:0/3899487215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009370 con 0x7f432c0a6b10 2023-10-18T19:40:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.631+0000 7f432a7fc700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4320009fd0 tx=0x7f4320017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.632+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320000bc0 con 0x7f432c0a6b10 2023-10-18T19:40:23.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.632+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000b850 con 0x7f432c0a6b10 2023-10-18T19:40:23.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.632+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c0a5640 con 0x7f432c0a6b10 2023-10-18T19:40:23.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.632+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320000d20 con 0x7f432c0a6b10 2023-10-18T19:40:23.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.632+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c117510 con 0x7f432c0a6b10 2023-10-18T19:40:23.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.633+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f432001cad0 con 0x7f432c0a6b10 2023-10-18T19:40:23.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.633+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c117700 con 0x7f432c0a6b10 2023-10-18T19:40:23.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.633+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f4320057740 con 0x7f432c0a6b10 2023-10-18T19:40:23.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.637+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f432003b620 con 0x7f432c0a6b10 2023-10-18T19:40:23.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.807+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f432c05f270 con 0x7f432c0a6b10 2023-10-18T19:40:23.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.808+0000 7f4312ffd700 1 -- 172.21.15.88:0/3899487215 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f4320020070 con 0x7f432c0a6b10 2023-10-18T19:40:23.811 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 >> v1:172.21.15.88:6800/113625 conn(0x7f4318041bf0 legacy=0x7f43180440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 msgr2=0x7f432c14bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f4320009fd0 tx=0x7f4320017000).stop 2023-10-18T19:40:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 shutdown_connections 2023-10-18T19:40:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f432c1361e0 0x7f432c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f432c05e250 0x7f432c0a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 --2- 172.21.15.88:0/3899487215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f432c0a6b10 0x7f432c14bd80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 >> 172.21.15.88:0/3899487215 conn(0x7f432c0665a0 msgr2=0x7f432c0a92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.809+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 shutdown_connections 2023-10-18T19:40:23.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:23.810+0000 7f43319ff700 1 -- 172.21.15.88:0/3899487215 wait complete. 2023-10-18T19:40:23.829 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:26.830 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:27.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.025+0000 7f4bd67ff700 1 Processor -- start 2023-10-18T19:40:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.025+0000 7f4bd67ff700 1 -- start start 2023-10-18T19:40:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd67ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:27.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd67ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 0x7f4bd0141480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:27.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd67ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd0091b30 con 0x7f4bd00ab3d0 2023-10-18T19:40:27.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd67ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd0134610 con 0x7f4bd0136b60 2023-10-18T19:40:27.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd67ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006aa40 con 0x7f4bd009a860 2023-10-18T19:40:27.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bcf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:27.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bd4d9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 0x7f4bd0141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bcf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35168/0 (socket says 172.21.15.88:35168) 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.026+0000 7f4bcf7fe700 1 -- 172.21.15.88:0/3756044844 learned_addr learned my addr 172.21.15.88:0/3756044844 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/3756044844 >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 msgr2=0x7f4bd0091f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bd4d9c700 1 --2- 172.21.15.88:0/3756044844 >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/3756044844 >> v1:172.21.15.88:6789/0 conn(0x7f4bd00ab3d0 legacy=0x7f4bd0069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/3756044844 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0137090 con 0x7f4bd009a860 2023-10-18T19:40:27.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bcf7fe700 1 --2- 172.21.15.88:0/3756044844 >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:27.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bd4d9c700 1 --2- 172.21.15.88:0/3756044844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 0x7f4bd0141480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4bc8009e90 tx=0x7f4bc8009780).ready entity=mon.1 client_cookie=e89de0da07b64dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:27.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bceffd700 1 -- 172.21.15.88:0/3756044844 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800e070 con 0x7f4bd009a860 2023-10-18T19:40:27.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bceffd700 1 -- 172.21.15.88:0/3756044844 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800bb20 con 0x7f4bd009a860 2023-10-18T19:40:27.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.027+0000 7f4bceffd700 1 -- 172.21.15.88:0/3756044844 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800bea0 con 0x7f4bd009a860 2023-10-18T19:40:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 -- 172.21.15.88:0/3756044844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 msgr2=0x7f4bd0141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/3756044844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 0x7f4bd0141480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4bc8009e90 tx=0x7f4bc8009780).stop 2023-10-18T19:40:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 -- 172.21.15.88:0/3756044844 shutdown_connections 2023-10-18T19:40:27.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/3756044844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd009a860 0x7f4bd0141480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/3756044844 >> v2:172.21.15.88:3300/0 conn(0x7f4bd0136b60 0x7f4bd0091f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 -- 172.21.15.88:0/3756044844 >> 172.21.15.88:0/3756044844 conn(0x7f4bd005eb30 msgr2=0x7f4bd00aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 -- 172.21.15.88:0/3756044844 shutdown_connections 2023-10-18T19:40:27.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.028+0000 7f4bd67ff700 1 -- 172.21.15.88:0/3756044844 wait complete. 2023-10-18T19:40:27.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.030+0000 7f4bd67ff700 1 Processor -- start 2023-10-18T19:40:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.030+0000 7f4bd67ff700 1 -- start start 2023-10-18T19:40:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.030+0000 7f4bd67ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd67ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 0x7f4bd0067af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd67ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:27.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd67ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd009c3e0 con 0x7f4bd009a860 2023-10-18T19:40:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd67ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd009c6a0 con 0x7f4bd00ab3d0 2023-10-18T19:40:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd67ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00688e0 con 0x7f4bd0136b60 2023-10-18T19:40:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:27.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 0x7f4bd0067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:27.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:27.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35170/0 (socket says 172.21.15.88:35170) 2023-10-18T19:40:27.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 0x7f4bd0067af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36484/0 (socket says 172.21.15.88:36484) 2023-10-18T19:40:27.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcffff700 1 -- 172.21.15.88:0/2663687315 learned_addr learned my addr 172.21.15.88:0/2663687315 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:27.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52510/0 (socket says 172.21.15.88:52510) 2023-10-18T19:40:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 msgr2=0x7f4bd0067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 0x7f4bd0067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 msgr2=0x7f4bd0096ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 -- 172.21.15.88:0/2663687315 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009370 con 0x7f4bd0136b60 2023-10-18T19:40:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bcffff700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.031+0000 7f4bd4d9c700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4bc8014000 tx=0x7f4bc8009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.032+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc801d630 con 0x7f4bd0136b60 2023-10-18T19:40:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.032+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc801d790 con 0x7f4bd0136b60 2023-10-18T19:40:27.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.032+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc8009a20 con 0x7f4bd0136b60 2023-10-18T19:40:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.032+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc801db50 con 0x7f4bd0136b60 2023-10-18T19:40:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.032+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd00985c0 con 0x7f4bd0136b60 2023-10-18T19:40:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.033+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd0098870 con 0x7f4bd0136b60 2023-10-18T19:40:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.033+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f4bc8003040 con 0x7f4bd0136b60 2023-10-18T19:40:27.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.034+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f4bc8057730 con 0x7f4bd0136b60 2023-10-18T19:40:27.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.037+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f4bc80066a0 con 0x7f4bd0136b60 2023-10-18T19:40:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.209+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4bd005f270 con 0x7f4bd0136b60 2023-10-18T19:40:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.209+0000 7f4bb7fff700 1 -- 172.21.15.88:0/2663687315 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f4bc80066a0 con 0x7f4bd0136b60 2023-10-18T19:40:27.212 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:27.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 >> v1:172.21.15.88:6800/113625 conn(0x7f4bbc041bc0 legacy=0x7f4bbc044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 msgr2=0x7f4bd00980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4bc8014000 tx=0x7f4bc8009780).stop 2023-10-18T19:40:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 shutdown_connections 2023-10-18T19:40:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f4bd0136b60 0x7f4bd00980d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bd009a860 0x7f4bd0096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 --2- 172.21.15.88:0/2663687315 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bd00ab3d0 0x7f4bd0067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:27.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 >> 172.21.15.88:0/2663687315 conn(0x7f4bd005eb30 msgr2=0x7f4bd00a8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:27.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 shutdown_connections 2023-10-18T19:40:27.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:27.211+0000 7f4bd67ff700 1 -- 172.21.15.88:0/2663687315 wait complete. 2023-10-18T19:40:27.230 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:30.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:30.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.425+0000 7fdcab1ff700 1 Processor -- start 2023-10-18T19:40:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 -- start start 2023-10-18T19:40:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdca40a4c50 0x7fdca413bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40afd50 con 0x7fdca40a4c50 2023-10-18T19:40:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a47a0 con 0x7fdca40a1790 2023-10-18T19:40:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.426+0000 7fdcab1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a3a10 con 0x7fdca40af970 2023-10-18T19:40:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca8f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdca40a4c50 0x7fdca413bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca8f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52522/0 (socket says 172.21.15.88:52522) 2023-10-18T19:40:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36488/0 (socket says 172.21.15.88:36488) 2023-10-18T19:40:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca8f9b700 1 -- 172.21.15.88:0/2631009021 learned_addr learned my addr 172.21.15.88:0/2631009021 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:30.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 -- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 msgr2=0x7fdca4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 -- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 msgr2=0x7fdca4136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 -- 172.21.15.88:0/2631009021 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40a32d0 con 0x7fdca40a4c50 2023-10-18T19:40:30.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca8f9b700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca3fff700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.427+0000 7fdca979c700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40a4c50 0x7fdca413bf90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdc9c009e90 tx=0x7fdc9c009780).ready entity=mon.0 client_cookie=67809ae33a70a107 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdca37fe700 1 -- 172.21.15.88:0/2631009021 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00e070 con 0x7fdca40a4c50 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdca37fe700 1 -- 172.21.15.88:0/2631009021 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00ba70 con 0x7fdca40a4c50 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdca37fe700 1 -- 172.21.15.88:0/2631009021 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bdf0 con 0x7fdca40a4c50 2023-10-18T19:40:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 -- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40a4c50 msgr2=0x7fdca413bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40a4c50 0x7fdca413bf90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdc9c009e90 tx=0x7fdc9c009780).stop 2023-10-18T19:40:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 -- 172.21.15.88:0/2631009021 shutdown_connections 2023-10-18T19:40:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40af970 0x7fdca4135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40a4c50 0x7fdca413bf90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/2631009021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a1790 0x7fdca4136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 -- 172.21.15.88:0/2631009021 >> 172.21.15.88:0/2631009021 conn(0x7fdca405eb60 msgr2=0x7fdca40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 -- 172.21.15.88:0/2631009021 shutdown_connections 2023-10-18T19:40:30.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.428+0000 7fdcab1ff700 1 -- 172.21.15.88:0/2631009021 wait complete. 2023-10-18T19:40:30.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 Processor -- start 2023-10-18T19:40:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 -- start start 2023-10-18T19:40:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a4c50 0x7fdca4148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40af970 0x7fdca414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:30.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a9610 con 0x7fdca40af970 2023-10-18T19:40:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.430+0000 7fdcab1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40aac10 con 0x7fdca40a4c50 2023-10-18T19:40:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdcab1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40a7f70 con 0x7fdca40a1790 2023-10-18T19:40:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a4c50 0x7fdca4148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52534/0 (socket says 172.21.15.88:52534) 2023-10-18T19:40:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 -- 172.21.15.88:0/3745056816 learned_addr learned my addr 172.21.15.88:0/3745056816 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca979c700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40af970 0x7fdca414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 -- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a4c50 msgr2=0x7fdca4148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a4c50 0x7fdca4148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 -- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40af970 msgr2=0x7fdca414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40af970 0x7fdca414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 -- 172.21.15.88:0/3745056816 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc900092a0 con 0x7fdca40a1790 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca8f9b700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdc9800e970 tx=0x7fdc980090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.431+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98012600 con 0x7fdca40a1790 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.432+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98012760 con 0x7fdca40a1790 2023-10-18T19:40:30.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.432+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc98009370 con 0x7fdca40a1790 2023-10-18T19:40:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.432+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98012ae0 con 0x7fdca40a1790 2023-10-18T19:40:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.432+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c009a20 con 0x7fdca40a1790 2023-10-18T19:40:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.433+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fdc9801b400 con 0x7fdca40a1790 2023-10-18T19:40:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.433+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4148c30 con 0x7fdca40a1790 2023-10-18T19:40:30.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.433+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fdc98055d40 con 0x7fdca40a1790 2023-10-18T19:40:30.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.437+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fdc98035fc0 con 0x7fdca40a1790 2023-10-18T19:40:30.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.607+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdca405f270 con 0x7fdca40a1790 2023-10-18T19:40:30.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.607+0000 7fdca0ff9700 1 -- 172.21.15.88:0/3745056816 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fdc98016080 con 0x7fdca40a1790 2023-10-18T19:40:30.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 >> v1:172.21.15.88:6800/113625 conn(0x7fdc88041bc0 legacy=0x7fdc88044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 msgr2=0x7fdca40ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:30.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdc9800e970 tx=0x7fdc980090f0).stop 2023-10-18T19:40:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 shutdown_connections 2023-10-18T19:40:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdca40af970 0x7fdca414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdca40a1790 0x7fdca40ab560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 --2- 172.21.15.88:0/3745056816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdca40a4c50 0x7fdca4148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:30.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 >> 172.21.15.88:0/3745056816 conn(0x7fdca405eb60 msgr2=0x7fdca4135060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 shutdown_connections 2023-10-18T19:40:30.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:30.609+0000 7fdcab1ff700 1 -- 172.21.15.88:0/3745056816 wait complete. 2023-10-18T19:40:30.629 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:33.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.825+0000 7f2e30dff700 1 Processor -- start 2023-10-18T19:40:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.825+0000 7f2e30dff700 1 -- start start 2023-10-18T19:40:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e30dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 0x7f2e2c0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e30dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e30dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c05e630 con 0x7f2e2c05e250 2023-10-18T19:40:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e30dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a7260 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e30dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a8060 con 0x7f2e2c0a1580 2023-10-18T19:40:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35206/0 (socket says 172.21.15.88:35206) 2023-10-18T19:40:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 -- 172.21.15.88:0/3966211850 learned_addr learned my addr 172.21.15.88:0/3966211850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e29d9b700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 0x7f2e2c0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 -- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 msgr2=0x7f2e2c0a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 0x7f2e2c0a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 -- 172.21.15.88:0/3966211850 >> v1:172.21.15.88:6789/0 conn(0x7f2e2c05e250 legacy=0x7f2e2c0a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e2ad9d700 1 -- 172.21.15.88:0/3966211850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c0a2350 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.826+0000 7f2e29d9b700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 0x7f2e2c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e2ad9d700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f2e24009f20 tx=0x7f2e24009840).ready entity=mon.0 client_cookie=b849d5530d83ed37 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e2959a700 1 -- 172.21.15.88:0/3966211850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400e070 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e2959a700 1 -- 172.21.15.88:0/3966211850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2400b9d0 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e2959a700 1 -- 172.21.15.88:0/3966211850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400bd50 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 -- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a8b70 msgr2=0x7f2e2c1433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f2e24009f20 tx=0x7f2e24009840).stop 2023-10-18T19:40:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 -- 172.21.15.88:0/3966211850 shutdown_connections 2023-10-18T19:40:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a8b70 0x7f2e2c1433f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3966211850 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a1580 0x7f2e2c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 -- 172.21.15.88:0/3966211850 >> 172.21.15.88:0/3966211850 conn(0x7f2e2c0665a0 msgr2=0x7f2e2c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 -- 172.21.15.88:0/3966211850 shutdown_connections 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.827+0000 7f2e30dff700 1 -- 172.21.15.88:0/3966211850 wait complete. 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.829+0000 7f2e30dff700 1 Processor -- start 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.829+0000 7f2e30dff700 1 -- start start 2023-10-18T19:40:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.829+0000 7f2e30dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 0x7f2e2c0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.829+0000 7f2e30dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e30dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 0x7f2e2c147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e30dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13ca00 con 0x7f2e2c0a1580 2023-10-18T19:40:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e30dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c13cc30 con 0x7f2e2c0a8b70 2023-10-18T19:40:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e30dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c148790 con 0x7f2e2c05e250 2023-10-18T19:40:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e29d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 0x7f2e2c0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e29d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35208/0 (socket says 172.21.15.88:35208) 2023-10-18T19:40:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e29d9b700 1 -- 172.21.15.88:0/3272274469 learned_addr learned my addr 172.21.15.88:0/3272274469 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2ad9d700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 0x7f2e2c147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 -- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 msgr2=0x7f2e2c147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 0x7f2e2c147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 -- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 msgr2=0x7f2e2c147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 -- 172.21.15.88:0/3272274469 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200092a0 con 0x7f2e2c05e250 2023-10-18T19:40:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e29d9b700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2ad9d700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 0x7f2e2c147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.830+0000 7f2e2a59c700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 0x7f2e2c0a9470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2e1c00c440 tx=0x7f2e1c007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.831+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c007020 con 0x7f2e2c05e250 2023-10-18T19:40:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.831+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c007180 con 0x7f2e2c05e250 2023-10-18T19:40:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.831+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c007520 con 0x7f2e2c05e250 2023-10-18T19:40:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.831+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24009ae0 con 0x7f2e2c05e250 2023-10-18T19:40:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.831+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c0a4d70 con 0x7f2e2c05e250 2023-10-18T19:40:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.832+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c05f270 con 0x7f2e2c05e250 2023-10-18T19:40:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.832+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f2e1c0068b0 con 0x7f2e2c05e250 2023-10-18T19:40:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.833+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2e1c055290 con 0x7f2e2c05e250 2023-10-18T19:40:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:33.836+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2e1c035570 con 0x7f2e2c05e250 2023-10-18T19:40:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.008+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e2c148a50 con 0x7f2e2c05e250 2023-10-18T19:40:34.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.009+0000 7f2e1a7fc700 1 -- 172.21.15.88:0/3272274469 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2e1c038d60 con 0x7f2e2c05e250 2023-10-18T19:40:34.012 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 >> v1:172.21.15.88:6800/113625 conn(0x7f2e0c041bc0 legacy=0x7f2e0c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 msgr2=0x7f2e2c0a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 0x7f2e2c0a9470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f2e1c00c440 tx=0x7f2e1c007d40).stop 2023-10-18T19:40:34.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 shutdown_connections 2023-10-18T19:40:34.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e2c0a8b70 0x7f2e2c147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:34.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2e2c05e250 0x7f2e2c0a9470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:34.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 --2- 172.21.15.88:0/3272274469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e2c0a1580 0x7f2e2c147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:34.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 >> 172.21.15.88:0/3272274469 conn(0x7f2e2c0665a0 msgr2=0x7f2e2c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 shutdown_connections 2023-10-18T19:40:34.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:34.010+0000 7f2e30dff700 1 -- 172.21.15.88:0/3272274469 wait complete. 2023-10-18T19:40:34.030 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:37.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.230+0000 7f5b585ff700 1 Processor -- start 2023-10-18T19:40:37.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.230+0000 7f5b585ff700 1 -- start start 2023-10-18T19:40:37.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b585ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b500aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:37.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b585ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b50069b40 0x7f5b50063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:37.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b585ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5006a320 con 0x7f5b50062ea0 2023-10-18T19:40:37.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b585ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b50063280 con 0x7f5b50069b40 2023-10-18T19:40:37.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b585ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5006ab10 con 0x7f5b5009db80 2023-10-18T19:40:37.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b50069b40 0x7f5b50063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:37.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b55b9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b500aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:37.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b50069b40 0x7f5b50063df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49220/0 (socket says 172.21.15.88:49220) 2023-10-18T19:40:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 -- 172.21.15.88:0/135572237 learned_addr learned my addr 172.21.15.88:0/135572237 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 -- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 msgr2=0x7f5b500aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b500aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 -- 172.21.15.88:0/135572237 >> v1:172.21.15.88:6789/0 conn(0x7f5b50062ea0 legacy=0x7f5b500636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b56b9c700 1 -- 172.21.15.88:0/135572237 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5006a080 con 0x7f5b50069b40 2023-10-18T19:40:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.231+0000 7f5b55b9a700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b500aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b56b9c700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50069b40 0x7f5b50063df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5b48009f20 tx=0x7f5b48009840).ready entity=mon.0 client_cookie=11fabeee822f9089 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b55399700 1 -- 172.21.15.88:0/135572237 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800e070 con 0x7f5b50069b40 2023-10-18T19:40:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b55399700 1 -- 172.21.15.88:0/135572237 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800b9d0 con 0x7f5b50069b40 2023-10-18T19:40:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b55399700 1 -- 172.21.15.88:0/135572237 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800bd50 con 0x7f5b50069b40 2023-10-18T19:40:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 -- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50069b40 msgr2=0x7f5b50063df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50069b40 0x7f5b50063df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5b48009f20 tx=0x7f5b48009840).stop 2023-10-18T19:40:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 -- 172.21.15.88:0/135572237 shutdown_connections 2023-10-18T19:40:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50069b40 0x7f5b50063df0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 --2- 172.21.15.88:0/135572237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b500aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 -- 172.21.15.88:0/135572237 >> 172.21.15.88:0/135572237 conn(0x7f5b50067ef0 msgr2=0x7f5b500625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:37.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 -- 172.21.15.88:0/135572237 shutdown_connections 2023-10-18T19:40:37.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.232+0000 7f5b585ff700 1 -- 172.21.15.88:0/135572237 wait complete. 2023-10-18T19:40:37.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.234+0000 7f5b585ff700 1 Processor -- start 2023-10-18T19:40:37.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.234+0000 7f5b585ff700 1 -- start start 2023-10-18T19:40:37.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.234+0000 7f5b585ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50062ea0 0x7f5b500a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:37.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.234+0000 7f5b585ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:37.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b585ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:37.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b585ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50096ad0 con 0x7f5b50062ea0 2023-10-18T19:40:37.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b585ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50095210 con 0x7f5b5009db80 2023-10-18T19:40:37.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b585ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500954d0 con 0x7f5b50069b40 2023-10-18T19:40:37.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b55b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:46974/0 (socket says 172.21.15.88:46974) 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b55b9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60410/0 (socket says 172.21.15.88:60410) 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 -- 172.21.15.88:0/40025899 learned_addr learned my addr 172.21.15.88:0/40025899 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b5639b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50062ea0 0x7f5b500a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:37.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 -- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 msgr2=0x7f5b500975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 -- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50062ea0 msgr2=0x7f5b500a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50062ea0 0x7f5b500a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 -- 172.21.15.88:0/40025899 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b400092a0 con 0x7f5b5009db80 2023-10-18T19:40:37.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b55b9a700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:37.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.235+0000 7f5b56b9c700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5b48009880 tx=0x7f5b5009d5e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:37.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.236+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480092e0 con 0x7f5b5009db80 2023-10-18T19:40:37.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.236+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4801e470 con 0x7f5b5009db80 2023-10-18T19:40:37.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.236+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4801e830 con 0x7f5b5009db80 2023-10-18T19:40:37.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.236+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b48009ae0 con 0x7f5b5009db80 2023-10-18T19:40:37.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.236+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b50094e60 con 0x7f5b5009db80 2023-10-18T19:40:37.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.237+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b50096ff0 con 0x7f5b5009db80 2023-10-18T19:40:37.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.237+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f5b48003040 con 0x7f5b5009db80 2023-10-18T19:40:37.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.237+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f5b48056d20 con 0x7f5b5009db80 2023-10-18T19:40:37.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.241+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f5b50096ff0 con 0x7f5b5009db80 2023-10-18T19:40:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.409+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b50096ff0 con 0x7f5b5009db80 2023-10-18T19:40:37.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.410+0000 7f5b467fc700 1 -- 172.21.15.88:0/40025899 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5b50096ff0 con 0x7f5b5009db80 2023-10-18T19:40:37.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:37.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.411+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 >> v1:172.21.15.88:6800/113625 conn(0x7f5b34041bf0 legacy=0x7f5b340440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 msgr2=0x7f5b50092a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5b48009880 tx=0x7f5b5009d5e0).stop 2023-10-18T19:40:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 shutdown_connections 2023-10-18T19:40:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5b5009db80 0x7f5b50092a20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b50062ea0 0x7f5b500a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 --2- 172.21.15.88:0/40025899 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f5b50069b40 0x7f5b500975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:37.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 >> 172.21.15.88:0/40025899 conn(0x7f5b50067ef0 msgr2=0x7f5b500ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:37.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 shutdown_connections 2023-10-18T19:40:37.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:37.412+0000 7f5b585ff700 1 -- 172.21.15.88:0/40025899 wait complete. 2023-10-18T19:40:37.431 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:40.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.626+0000 7fa7dafff700 1 Processor -- start 2023-10-18T19:40:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.627+0000 7fa7dafff700 1 -- start start 2023-10-18T19:40:40.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.627+0000 7fa7dafff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:40.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7dafff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7d40a1790 0x7fa7d4136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:40.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7dafff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40afd50 con 0x7fa7d40a4c50 2023-10-18T19:40:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7dafff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40a47a0 con 0x7fa7d40a1790 2023-10-18T19:40:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7dafff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40a3a10 con 0x7fa7d40af970 2023-10-18T19:40:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d8d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7d40a1790 0x7fa7d4136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:40.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa7d40a1790 0x7fa7d4136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49236/0 (socket says 172.21.15.88:49236) 2023-10-18T19:40:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d8d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60424/0 (socket says 172.21.15.88:60424) 2023-10-18T19:40:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 -- 172.21.15.88:0/600275435 learned_addr learned my addr 172.21.15.88:0/600275435 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 -- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 msgr2=0x7fa7d4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 -- 172.21.15.88:0/600275435 >> v1:172.21.15.88:6789/0 conn(0x7fa7d40a4c50 legacy=0x7fa7d413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 -- 172.21.15.88:0/600275435 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40a32d0 con 0x7fa7d40a1790 2023-10-18T19:40:40.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d8d9b700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:40.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.628+0000 7fa7d3fff700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d4136220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa7c0006fd0 tx=0x7fa7c00090f0).ready entity=mon.0 client_cookie=32639a4e08c13b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:40.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7d37fe700 1 -- 172.21.15.88:0/600275435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000b580 con 0x7fa7d40a1790 2023-10-18T19:40:40.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7d37fe700 1 -- 172.21.15.88:0/600275435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b6e0 con 0x7fa7d40a1790 2023-10-18T19:40:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7d37fe700 1 -- 172.21.15.88:0/600275435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ba60 con 0x7fa7d40a1790 2023-10-18T19:40:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 -- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 msgr2=0x7fa7d4136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d4136220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa7c0006fd0 tx=0x7fa7c00090f0).stop 2023-10-18T19:40:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 -- 172.21.15.88:0/600275435 shutdown_connections 2023-10-18T19:40:40.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d4135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 --2- 172.21.15.88:0/600275435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d4136220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 -- 172.21.15.88:0/600275435 >> 172.21.15.88:0/600275435 conn(0x7fa7d405eb60 msgr2=0x7fa7d40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 -- 172.21.15.88:0/600275435 shutdown_connections 2023-10-18T19:40:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.629+0000 7fa7dafff700 1 -- 172.21.15.88:0/600275435 wait complete. 2023-10-18T19:40:40.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.630+0000 7fa7dafff700 1 Processor -- start 2023-10-18T19:40:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 -- start start 2023-10-18T19:40:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7d40a4c50 0x7fa7d40a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:40.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40a8470 con 0x7fa7d40a1790 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40a9810 con 0x7fa7d40a4c50 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.631+0000 7fa7dafff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40a7d00 con 0x7fa7d40af970 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7d40a4c50 0x7fa7d40a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:40.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d959c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49240/0 (socket says 172.21.15.88:49240) 2023-10-18T19:40:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 -- 172.21.15.88:0/2717348644 learned_addr learned my addr 172.21.15.88:0/2717348644 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 -- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 msgr2=0x7fa7d413f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d413f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 -- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7d40a4c50 msgr2=0x7fa7d40a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7d40a4c50 0x7fa7d40a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 -- 172.21.15.88:0/2717348644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80092a0 con 0x7fa7d40a1790 2023-10-18T19:40:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d8d9b700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fa7c800e980 tx=0x7fa7c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8012600 con 0x7fa7d40a1790 2023-10-18T19:40:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.632+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8012760 con 0x7fa7d40a1790 2023-10-18T19:40:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.633+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0009370 con 0x7fa7d40a1790 2023-10-18T19:40:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.633+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8012ae0 con 0x7fa7d40a1790 2023-10-18T19:40:40.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.633+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d4140f00 con 0x7fa7d40a1790 2023-10-18T19:40:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.634+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d40a34c0 con 0x7fa7d40a1790 2023-10-18T19:40:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.634+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fa7c801b400 con 0x7fa7d40a1790 2023-10-18T19:40:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.635+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fa7c8055c30 con 0x7fa7d40a1790 2023-10-18T19:40:40.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.638+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa7c8035fb0 con 0x7fa7d40a1790 2023-10-18T19:40:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.809+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa7d405f270 con 0x7fa7d40a1790 2023-10-18T19:40:40.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.810+0000 7fa7d0ff9700 1 -- 172.21.15.88:0/2717348644 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa7c8039760 con 0x7fa7d40a1790 2023-10-18T19:40:40.813 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 >> v1:172.21.15.88:6800/113625 conn(0x7fa7b8041bf0 legacy=0x7fa7b80440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 msgr2=0x7fa7d40a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fa7c800e980 tx=0x7fa7c8009060).stop 2023-10-18T19:40:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 shutdown_connections 2023-10-18T19:40:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa7d40af970 0x7fa7d413f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7d40a1790 0x7fa7d40a8c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 --2- 172.21.15.88:0/2717348644 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7d40a4c50 0x7fa7d40a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.811+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 >> 172.21.15.88:0/2717348644 conn(0x7fa7d405eb60 msgr2=0x7fa7d4138290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.812+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 shutdown_connections 2023-10-18T19:40:40.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:40.812+0000 7fa7dafff700 1 -- 172.21.15.88:0/2717348644 wait complete. 2023-10-18T19:40:40.831 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:43.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:44.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.025+0000 7f2152bff700 1 Processor -- start 2023-10-18T19:40:44.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.025+0000 7f2152bff700 1 -- start start 2023-10-18T19:40:44.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a1790 0x7f214c136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f214c0a4c50 0x7f214c13bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0afd50 con 0x7f214c0a4c50 2023-10-18T19:40:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0a47a0 con 0x7f214c0af970 2023-10-18T19:40:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.026+0000 7f2152bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0a3a10 con 0x7f214c0a1790 2023-10-18T19:40:44.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215099b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f214c0a4c50 0x7f214c13bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f214bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a1790 0x7f214c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f214c0a4c50 0x7f214c13bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49256/0 (socket says 172.21.15.88:49256) 2023-10-18T19:40:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215099b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:46992/0 (socket says 172.21.15.88:46992) 2023-10-18T19:40:44.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 -- 172.21.15.88:0/3625208570 learned_addr learned my addr 172.21.15.88:0/3625208570 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 -- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a1790 msgr2=0x7f214c136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a1790 0x7f214c136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 -- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 msgr2=0x7f214c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 -- 172.21.15.88:0/3625208570 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0a32d0 con 0x7f214c0a4c50 2023-10-18T19:40:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215099b700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f215119c700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0a4c50 0x7f214c13bf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f2144009f50 tx=0x7f2144009840).ready entity=mon.0 client_cookie=e4d620903892d67d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f214b7fe700 1 -- 172.21.15.88:0/3625208570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400e070 con 0x7f214c0a4c50 2023-10-18T19:40:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.027+0000 7f214b7fe700 1 -- 172.21.15.88:0/3625208570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400b910 con 0x7f214c0a4c50 2023-10-18T19:40:44.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f214b7fe700 1 -- 172.21.15.88:0/3625208570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400bc90 con 0x7f214c0a4c50 2023-10-18T19:40:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 -- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0a4c50 msgr2=0x7f214c13bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:44.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0a4c50 0x7f214c13bf90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f2144009f50 tx=0x7f2144009840).stop 2023-10-18T19:40:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 -- 172.21.15.88:0/3625208570 shutdown_connections 2023-10-18T19:40:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0a4c50 0x7f214c13bf90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0af970 0x7f214c135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 --2- 172.21.15.88:0/3625208570 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a1790 0x7f214c136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 -- 172.21.15.88:0/3625208570 >> 172.21.15.88:0/3625208570 conn(0x7f214c05eb60 msgr2=0x7f214c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:44.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 -- 172.21.15.88:0/3625208570 shutdown_connections 2023-10-18T19:40:44.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.028+0000 7f2152bff700 1 -- 172.21.15.88:0/3625208570 wait complete. 2023-10-18T19:40:44.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.029+0000 7f2152bff700 1 Processor -- start 2023-10-18T19:40:44.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 -- start start 2023-10-18T19:40:44.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a4c50 0x7f214c0ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0af970 0x7f214c0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:44.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0aa940 con 0x7f214c0af970 2023-10-18T19:40:44.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0a9630 con 0x7f214c0a1790 2023-10-18T19:40:44.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f2152bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214c14c180 con 0x7f214c0a4c50 2023-10-18T19:40:44.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.030+0000 7f215099b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f214bfff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a4c50 0x7f214c0ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:46994/0 (socket says 172.21.15.88:46994) 2023-10-18T19:40:44.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215119c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0af970 0x7f214c0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:44.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 -- 172.21.15.88:0/3155427681 learned_addr learned my addr 172.21.15.88:0/3155427681 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:44.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 -- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a4c50 msgr2=0x7f214c0ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:44.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a4c50 0x7f214c0ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 -- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0af970 msgr2=0x7f214c0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:44.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0af970 0x7f214c0a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 -- 172.21.15.88:0/3155427681 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400092a0 con 0x7f214c0a1790 2023-10-18T19:40:44.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f215099b700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f214000e980 tx=0x7f2140009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:44.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140012600 con 0x7f214c0a1790 2023-10-18T19:40:44.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140012760 con 0x7f214c0a1790 2023-10-18T19:40:44.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2144009ae0 con 0x7f214c0a1790 2023-10-18T19:40:44.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.031+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140012ae0 con 0x7f214c0a1790 2023-10-18T19:40:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.032+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0a9280 con 0x7f214c0a1790 2023-10-18T19:40:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.033+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c05f270 con 0x7f214c0a1790 2023-10-18T19:40:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.033+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f214001b400 con 0x7f214c0a1790 2023-10-18T19:40:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.034+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2140055ca0 con 0x7f214c0a1790 2023-10-18T19:40:44.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.037+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2140035fe0 con 0x7f214c0a1790 2023-10-18T19:40:44.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.208+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f214c13cdf0 con 0x7f214c0a1790 2023-10-18T19:40:44.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.209+0000 7f2148ff9700 1 -- 172.21.15.88:0/3155427681 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f21400397d0 con 0x7f214c0a1790 2023-10-18T19:40:44.212 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:44.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.210+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 >> v1:172.21.15.88:6800/113625 conn(0x7f2130041bc0 legacy=0x7f2130044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:44.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 msgr2=0x7f214c14c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:44.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f214000e980 tx=0x7f2140009060).stop 2023-10-18T19:40:44.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 shutdown_connections 2023-10-18T19:40:44.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f214c0af970 0x7f214c0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f214c0a1790 0x7f214c14c690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 --2- 172.21.15.88:0/3155427681 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f214c0a4c50 0x7f214c0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:44.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 >> 172.21.15.88:0/3155427681 conn(0x7f214c05eb60 msgr2=0x7f214c0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:44.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 shutdown_connections 2023-10-18T19:40:44.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:44.211+0000 7f2152bff700 1 -- 172.21.15.88:0/3155427681 wait complete. 2023-10-18T19:40:44.230 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:47.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:47.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.426+0000 7f9ecedff700 1 Processor -- start 2023-10-18T19:40:47.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.426+0000 7f9ecedff700 1 -- start start 2023-10-18T19:40:47.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecedff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ec805e960 0x7f9ec80a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:47.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecedff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec81363e0 0x7f9ec81433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:47.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecedff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec805ed40 con 0x7f9ec80a4a20 2023-10-18T19:40:47.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecedff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80a3a70 con 0x7f9ec805e960 2023-10-18T19:40:47.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecedff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80a2ac0 con 0x7f9ec81363e0 2023-10-18T19:40:47.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ec805e960 0x7f9ec80a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:47.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ec805e960 0x7f9ec80a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51176/0 (socket says 172.21.15.88:51176) 2023-10-18T19:40:47.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9ecd39c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec81363e0 0x7f9ec81433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:47.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 -- 172.21.15.88:0/2918512248 learned_addr learned my addr 172.21.15.88:0/2918512248 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:47.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 -- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec81363e0 msgr2=0x7f9ec81433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 --2- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec81363e0 0x7f9ec81433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 -- 172.21.15.88:0/2918512248 >> v1:172.21.15.88:6789/0 conn(0x7f9ec80a4a20 legacy=0x7f9ec8135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.427+0000 7f9eccb9b700 1 -- 172.21.15.88:0/2918512248 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80a2d60 con 0x7f9ec805e960 2023-10-18T19:40:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9eccb9b700 1 --2- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec805e960 0x7f9ec80a3580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9ebc006fd0 tx=0x7f9ebc0090f0).ready entity=mon.0 client_cookie=4d4fad991edecf20 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:47.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ec77fe700 1 -- 172.21.15.88:0/2918512248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00b610 con 0x7f9ec805e960 2023-10-18T19:40:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ec77fe700 1 -- 172.21.15.88:0/2918512248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00b770 con 0x7f9ec805e960 2023-10-18T19:40:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ec77fe700 1 -- 172.21.15.88:0/2918512248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00baf0 con 0x7f9ec805e960 2023-10-18T19:40:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 -- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec805e960 msgr2=0x7f9ec80a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 --2- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec805e960 0x7f9ec80a3580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9ebc006fd0 tx=0x7f9ebc0090f0).stop 2023-10-18T19:40:47.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 -- 172.21.15.88:0/2918512248 shutdown_connections 2023-10-18T19:40:47.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 --2- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec81363e0 0x7f9ec81433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 --2- 172.21.15.88:0/2918512248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec805e960 0x7f9ec80a3580 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 -- 172.21.15.88:0/2918512248 >> 172.21.15.88:0/2918512248 conn(0x7f9ec8064bb0 msgr2=0x7f9ec805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:47.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.428+0000 7f9ecedff700 1 -- 172.21.15.88:0/2918512248 shutdown_connections 2023-10-18T19:40:47.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.429+0000 7f9ecedff700 1 -- 172.21.15.88:0/2918512248 wait complete. 2023-10-18T19:40:47.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.430+0000 7f9ecedff700 1 Processor -- start 2023-10-18T19:40:47.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.430+0000 7f9ecedff700 1 -- start start 2023-10-18T19:40:47.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.430+0000 7f9ecedff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:47.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.430+0000 7f9ecedff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 0x7f9ec80a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.430+0000 7f9ecedff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecedff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec813d010 con 0x7f9ec81363e0 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecedff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80a54b0 con 0x7f9ec805e960 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecedff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80a7360 con 0x7f9ec80a4a20 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 0x7f9ec80a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:47.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:47.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecd39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:47.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:35522/0 (socket says 172.21.15.88:35522) 2023-10-18T19:40:47.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecd39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51180/0 (socket says 172.21.15.88:51180) 2023-10-18T19:40:47.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 0x7f9ec80a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:53476/0 (socket says 172.21.15.88:53476) 2023-10-18T19:40:47.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 -- 172.21.15.88:0/3413362447 learned_addr learned my addr 172.21.15.88:0/3413362447 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:47.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 -- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 msgr2=0x7f9ec80a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 0x7f9ec80a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 -- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 msgr2=0x7f9ec81377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 -- 172.21.15.88:0/3413362447 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009370 con 0x7f9ec805e960 2023-10-18T19:40:47.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9ecd39c700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:47.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.431+0000 7f9eccb9b700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9ebc009ea0 tx=0x7f9ebc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:47.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.432+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00beb0 con 0x7f9ec805e960 2023-10-18T19:40:47.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.432+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00b8e0 con 0x7f9ec805e960 2023-10-18T19:40:47.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.432+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80a7560 con 0x7f9ec805e960 2023-10-18T19:40:47.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.432+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc01c670 con 0x7f9ec805e960 2023-10-18T19:40:47.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.432+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec8138cc0 con 0x7f9ec805e960 2023-10-18T19:40:47.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.433+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec805f270 con 0x7f9ec805e960 2023-10-18T19:40:47.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.433+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f9ebc01c9e0 con 0x7f9ec805e960 2023-10-18T19:40:47.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.434+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f9ebc0573d0 con 0x7f9ec805e960 2023-10-18T19:40:47.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.437+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9ebc002800 con 0x7f9ec805e960 2023-10-18T19:40:47.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.611+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9ec80a4f30 con 0x7f9ec805e960 2023-10-18T19:40:47.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.611+0000 7f9ec4ff9700 1 -- 172.21.15.88:0/3413362447 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9ebc00ba50 con 0x7f9ec805e960 2023-10-18T19:40:47.614 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 >> v1:172.21.15.88:6800/113625 conn(0x7f9eac041bc0 legacy=0x7f9eac044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 msgr2=0x7f9ec80a6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9ebc009ea0 tx=0x7f9ebc017000).stop 2023-10-18T19:40:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 shutdown_connections 2023-10-18T19:40:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ec81363e0 0x7f9ec81377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ec805e960 0x7f9ec80a6970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 --2- 172.21.15.88:0/3413362447 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9ec80a4a20 0x7f9ec80a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 >> 172.21.15.88:0/3413362447 conn(0x7f9ec8064bb0 msgr2=0x7f9ec8135a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 shutdown_connections 2023-10-18T19:40:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:47.613+0000 7f9ecedff700 1 -- 172.21.15.88:0/3413362447 wait complete. 2023-10-18T19:40:47.632 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:50.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.828+0000 7fec771ff700 1 Processor -- start 2023-10-18T19:40:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.828+0000 7fec771ff700 1 -- start start 2023-10-18T19:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec771ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec771ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec70136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec771ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700afd50 con 0x7fec700a1790 2023-10-18T19:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec771ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec700a47a0 con 0x7fec700af970 2023-10-18T19:40:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec771ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec700a3a10 con 0x7fec700a4c50 2023-10-18T19:40:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec74f9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec7579c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec70136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec74f9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51190/0 (socket says 172.21.15.88:51190) 2023-10-18T19:40:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.829+0000 7fec74f9b700 1 -- 172.21.15.88:0/1295762183 learned_addr learned my addr 172.21.15.88:0/1295762183 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec7579c700 1 -- 172.21.15.88:0/1295762183 >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 msgr2=0x7fec70135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec7579c700 1 --2- 172.21.15.88:0/1295762183 >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec7579c700 1 -- 172.21.15.88:0/1295762183 >> v1:172.21.15.88:6789/0 conn(0x7fec700a1790 legacy=0x7fec7013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec7579c700 1 -- 172.21.15.88:0/1295762183 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700a32d0 con 0x7fec700a4c50 2023-10-18T19:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec74f9b700 1 --2- 172.21.15.88:0/1295762183 >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec7579c700 1 --2- 172.21.15.88:0/1295762183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec70136220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fec68009e60 tx=0x7fec68009780).ready entity=mon.1 client_cookie=57eb5535d6a2a464 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec6f7fe700 1 -- 172.21.15.88:0/1295762183 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800e070 con 0x7fec700a4c50 2023-10-18T19:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec6f7fe700 1 -- 172.21.15.88:0/1295762183 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800bb60 con 0x7fec700a4c50 2023-10-18T19:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.830+0000 7fec6f7fe700 1 -- 172.21.15.88:0/1295762183 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68012410 con 0x7fec700a4c50 2023-10-18T19:40:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 -- 172.21.15.88:0/1295762183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 msgr2=0x7fec70136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 --2- 172.21.15.88:0/1295762183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec70136220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fec68009e60 tx=0x7fec68009780).stop 2023-10-18T19:40:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 -- 172.21.15.88:0/1295762183 shutdown_connections 2023-10-18T19:40:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 --2- 172.21.15.88:0/1295762183 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec70136220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 --2- 172.21.15.88:0/1295762183 >> v2:172.21.15.88:3300/0 conn(0x7fec700af970 0x7fec70135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:50.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 -- 172.21.15.88:0/1295762183 >> 172.21.15.88:0/1295762183 conn(0x7fec7005eb60 msgr2=0x7fec700af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:50.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 -- 172.21.15.88:0/1295762183 shutdown_connections 2023-10-18T19:40:50.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.831+0000 7fec771ff700 1 -- 172.21.15.88:0/1295762183 wait complete. 2023-10-18T19:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.832+0000 7fec771ff700 1 Processor -- start 2023-10-18T19:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.832+0000 7fec771ff700 1 -- start start 2023-10-18T19:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec700ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 0x7fec700aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:50.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70149260 con 0x7fec700af970 2023-10-18T19:40:50.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70149520 con 0x7fec700a4c50 2023-10-18T19:40:50.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec771ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec700aa9c0 con 0x7fec700a1790 2023-10-18T19:40:50.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec74f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:50.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec74f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:53482/0 (socket says 172.21.15.88:53482) 2023-10-18T19:40:50.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec74f9b700 1 -- 172.21.15.88:0/2711507271 learned_addr learned my addr 172.21.15.88:0/2711507271 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:50.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec7579c700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 0x7fec700aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:50.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.833+0000 7fec6ffff700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec700ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:50.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 -- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 msgr2=0x7fec700ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec700ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 -- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 msgr2=0x7fec700aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 0x7fec700aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 -- 172.21.15.88:0/2711507271 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009370 con 0x7fec700a1790 2023-10-18T19:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec7579c700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 0x7fec700aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec74f9b700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fec64006d00 tx=0x7fec640090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64012600 con 0x7fec700a1790 2023-10-18T19:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64012760 con 0x7fec700a1790 2023-10-18T19:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64012ae0 con 0x7fec700a1790 2023-10-18T19:40:50.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec68009a20 con 0x7fec700a1790 2023-10-18T19:40:50.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.834+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70092200 con 0x7fec700a1790 2023-10-18T19:40:50.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.835+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7005f270 con 0x7fec700a1790 2023-10-18T19:40:50.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.836+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fec6401b400 con 0x7fec700a1790 2023-10-18T19:40:50.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.836+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fec64055c60 con 0x7fec700a1790 2023-10-18T19:40:50.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:50.839+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fec64035fa0 con 0x7fec700a1790 2023-10-18T19:40:51.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.008+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fec700a3010 con 0x7fec700a1790 2023-10-18T19:40:51.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.008+0000 7fec6cff9700 1 -- 172.21.15.88:0/2711507271 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fec64016080 con 0x7fec700a1790 2023-10-18T19:40:51.011 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 >> v1:172.21.15.88:6800/113625 conn(0x7fec54041bf0 legacy=0x7fec540440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 msgr2=0x7fec70148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fec64006d00 tx=0x7fec640090f0).stop 2023-10-18T19:40:51.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 shutdown_connections 2023-10-18T19:40:51.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec700af970 0x7fec700aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:51.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fec700a1790 0x7fec70148c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:51.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 --2- 172.21.15.88:0/2711507271 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec700a4c50 0x7fec700ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:51.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 >> 172.21.15.88:0/2711507271 conn(0x7fec7005eb60 msgr2=0x7fec70138fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:51.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 shutdown_connections 2023-10-18T19:40:51.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:51.010+0000 7fec771ff700 1 -- 172.21.15.88:0/2711507271 wait complete. 2023-10-18T19:40:51.029 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:54.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:54.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.225+0000 7f6c7ddff700 1 Processor -- start 2023-10-18T19:40:54.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.225+0000 7f6c7ddff700 1 -- start start 2023-10-18T19:40:54.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c78062ea0 0x7f6c7809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:54.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c7ddff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c781406f0 0x7f6c78142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:54.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c7ddff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7809d700 con 0x7f6c780aa190 2023-10-18T19:40:54.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c7ddff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7806a310 con 0x7f6c781406f0 2023-10-18T19:40:54.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78063280 con 0x7f6c78062ea0 2023-10-18T19:40:54.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c77fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c781406f0 0x7f6c78142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:54.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c77fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c781406f0 0x7f6c78142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51206/0 (socket says 172.21.15.88:51206) 2023-10-18T19:40:54.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c77fff700 1 -- 172.21.15.88:0/1811000791 learned_addr learned my addr 172.21.15.88:0/1811000791 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:54.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.226+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c78062ea0 0x7f6c7809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:54.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c77fff700 1 -- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c78062ea0 msgr2=0x7f6c7809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:54.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c77fff700 1 --2- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c78062ea0 0x7f6c7809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c77fff700 1 -- 172.21.15.88:0/1811000791 >> v1:172.21.15.88:6789/0 conn(0x7f6c780aa190 legacy=0x7f6c78069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c77fff700 1 -- 172.21.15.88:0/1811000791 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780aa620 con 0x7f6c781406f0 2023-10-18T19:40:54.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c77fff700 1 --2- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c781406f0 0x7f6c78142ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6c70009f20 tx=0x7f6c70009840).ready entity=mon.0 client_cookie=393c916c09ed0b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:54.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c767fc700 1 -- 172.21.15.88:0/1811000791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000e070 con 0x7f6c781406f0 2023-10-18T19:40:54.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c767fc700 1 -- 172.21.15.88:0/1811000791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7000ba60 con 0x7f6c781406f0 2023-10-18T19:40:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.227+0000 7f6c767fc700 1 -- 172.21.15.88:0/1811000791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000bde0 con 0x7f6c781406f0 2023-10-18T19:40:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c781406f0 msgr2=0x7f6c78142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c781406f0 0x7f6c78142ae0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f6c70009f20 tx=0x7f6c70009840).stop 2023-10-18T19:40:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1811000791 shutdown_connections 2023-10-18T19:40:54.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c781406f0 0x7f6c78142ae0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1811000791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c78062ea0 0x7f6c7809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1811000791 >> 172.21.15.88:0/1811000791 conn(0x7f6c78067ef0 msgr2=0x7f6c780625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:54.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1811000791 shutdown_connections 2023-10-18T19:40:54.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.228+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1811000791 wait complete. 2023-10-18T19:40:54.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.229+0000 7f6c7ddff700 1 Processor -- start 2023-10-18T19:40:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.229+0000 7f6c7ddff700 1 -- start start 2023-10-18T19:40:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c781406f0 0x7f6c780a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:54.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6c780a5560 0x7f6c78148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7813f7e0 con 0x7f6c78062ea0 2023-10-18T19:40:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7814cc20 con 0x7f6c780a5560 2023-10-18T19:40:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78148b10 con 0x7f6c781406f0 2023-10-18T19:40:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:54.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51222/0 (socket says 172.21.15.88:51222) 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6c780a5560 0x7f6c78148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c76ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c781406f0 0x7f6c780a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.230+0000 7f6c777fe700 1 -- 172.21.15.88:0/1380730174 learned_addr learned my addr 172.21.15.88:0/1380730174 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 -- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c781406f0 msgr2=0x7f6c780a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c781406f0 0x7f6c780a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 -- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6c780a5560 msgr2=0x7f6c78148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6c780a5560 0x7f6c78148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 -- 172.21.15.88:0/1380730174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70009ae0 con 0x7f6c78062ea0 2023-10-18T19:40:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c777fe700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f6c6800e930 tx=0x7f6c68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68012600 con 0x7f6c78062ea0 2023-10-18T19:40:54.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68012760 con 0x7f6c78062ea0 2023-10-18T19:40:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7814c230 con 0x7f6c78062ea0 2023-10-18T19:40:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68012ae0 con 0x7f6c78062ea0 2023-10-18T19:40:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.231+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c78148790 con 0x7f6c78062ea0 2023-10-18T19:40:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.232+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7814c420 con 0x7f6c78062ea0 2023-10-18T19:40:54.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.232+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f6c6801b400 con 0x7f6c78062ea0 2023-10-18T19:40:54.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.233+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f6c68055d20 con 0x7f6c78062ea0 2023-10-18T19:40:54.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.236+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6c68036170 con 0x7f6c78062ea0 2023-10-18T19:40:54.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.408+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6c7805f270 con 0x7f6c78062ea0 2023-10-18T19:40:54.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.408+0000 7f6c5f7fe700 1 -- 172.21.15.88:0/1380730174 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6c68054960 con 0x7f6c78062ea0 2023-10-18T19:40:54.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:54.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 >> v1:172.21.15.88:6800/113625 conn(0x7f6c64041bf0 legacy=0x7f6c640440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 msgr2=0x7f6c7814c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:54.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f6c6800e930 tx=0x7f6c68009060).stop 2023-10-18T19:40:54.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 shutdown_connections 2023-10-18T19:40:54.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6c780a5560 0x7f6c78148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c78062ea0 0x7f6c7814c730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 --2- 172.21.15.88:0/1380730174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6c781406f0 0x7f6c780a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:54.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 >> 172.21.15.88:0/1380730174 conn(0x7f6c78067ef0 msgr2=0x7f6c7809d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:54.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 shutdown_connections 2023-10-18T19:40:54.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:54.410+0000 7f6c7ddff700 1 -- 172.21.15.88:0/1380730174 wait complete. 2023-10-18T19:40:54.431 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:40:57.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:40:57.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.630+0000 7f3a2f5ff700 1 Processor -- start 2023-10-18T19:40:57.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.630+0000 7f3a2f5ff700 1 -- start start 2023-10-18T19:40:57.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2f5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 0x7f3a28135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:57.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2f5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 0x7f3a281434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2f5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280a6330 con 0x7f3a2805e250 2023-10-18T19:40:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2f5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2805e630 con 0x7f3a281361e0 2023-10-18T19:40:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2f5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280a1f80 con 0x7f3a280a6b10 2023-10-18T19:40:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2d39b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a2805e250 0x7f3a280a16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60332/0 (socket says 172.21.15.88:60332) 2023-10-18T19:40:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2cb9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 0x7f3a28135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2d39b700 1 -- 172.21.15.88:0/3812953124 learned_addr learned my addr 172.21.15.88:0/3812953124 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:40:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.631+0000 7f3a2db9c700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 0x7f3a281434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a1ffff700 1 -- 172.21.15.88:0/3812953124 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347363850 0 0) 0x7f3a280a6330 con 0x7f3a2805e250 2023-10-18T19:40:57.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a1ffff700 1 -- 172.21.15.88:0/3812953124 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a140033f0 con 0x7f3a2805e250 2023-10-18T19:40:57.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2db9c700 1 -- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 msgr2=0x7f3a28135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:40:57.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2db9c700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 0x7f3a28135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2db9c700 1 -- 172.21.15.88:0/3812953124 >> v1:172.21.15.88:6789/0 conn(0x7f3a2805e250 legacy=0x7f3a280a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2db9c700 1 -- 172.21.15.88:0/3812953124 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280a2240 con 0x7f3a281361e0 2023-10-18T19:40:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2cb9a700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 0x7f3a28135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a2db9c700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 0x7f3a281434d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3a20009e90 tx=0x7f3a20009780).ready entity=mon.1 client_cookie=45de5433f75c414c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:57.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a1ffff700 1 -- 172.21.15.88:0/3812953124 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000e070 con 0x7f3a281361e0 2023-10-18T19:40:57.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a1ffff700 1 -- 172.21.15.88:0/3812953124 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000bab0 con 0x7f3a281361e0 2023-10-18T19:40:57.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.632+0000 7f3a1ffff700 1 -- 172.21.15.88:0/3812953124 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000be30 con 0x7f3a281361e0 2023-10-18T19:40:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 msgr2=0x7f3a281434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 0x7f3a281434d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3a20009e90 tx=0x7f3a20009780).stop 2023-10-18T19:40:57.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/3812953124 shutdown_connections 2023-10-18T19:40:57.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a281361e0 0x7f3a281434d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/3812953124 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a280a6b10 0x7f3a28135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/3812953124 >> 172.21.15.88:0/3812953124 conn(0x7f3a280665a0 msgr2=0x7f3a280625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:57.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/3812953124 shutdown_connections 2023-10-18T19:40:57.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.633+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/3812953124 wait complete. 2023-10-18T19:40:57.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.634+0000 7f3a2f5ff700 1 Processor -- start 2023-10-18T19:40:57.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.634+0000 7f3a2f5ff700 1 -- start start 2023-10-18T19:40:57.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:57.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 0x7f3a28067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:57.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a281361e0 0x7f3a280a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:40:57.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2814c5d0 con 0x7f3a280a6b10 2023-10-18T19:40:57.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2814bc50 con 0x7f3a2805e250 2023-10-18T19:40:57.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2f5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280a2f40 con 0x7f3a281361e0 2023-10-18T19:40:57.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2d39b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:57.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2db9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a281361e0 0x7f3a280a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:57.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2cb9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 0x7f3a28067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:40:57.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2d39b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:43836/0 (socket says 172.21.15.88:43836) 2023-10-18T19:40:57.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.635+0000 7f3a2d39b700 1 -- 172.21.15.88:0/1470797219 learned_addr learned my addr 172.21.15.88:0/1470797219 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:40:57.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 -- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a281361e0 msgr2=0x7f3a280a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a281361e0 0x7f3a280a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 -- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 msgr2=0x7f3a28067230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 0x7f3a28067230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 -- 172.21.15.88:0/1470797219 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180092a0 con 0x7f3a2805e250 2023-10-18T19:40:57.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2cb9a700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 0x7f3a28067230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:40:57.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2d39b700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3a2400c590 tx=0x7f3a24007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:40:57.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240072e0 con 0x7f3a2805e250 2023-10-18T19:40:57.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24007440 con 0x7f3a2805e250 2023-10-18T19:40:57.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a20009a20 con 0x7f3a2805e250 2023-10-18T19:40:57.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240057a0 con 0x7f3a2805e250 2023-10-18T19:40:57.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.636+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28135a20 con 0x7f3a2805e250 2023-10-18T19:40:57.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.637+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2814bf30 con 0x7f3a2805e250 2023-10-18T19:40:57.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.638+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f3a24005bd0 con 0x7f3a2805e250 2023-10-18T19:40:57.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.638+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f3a240550a0 con 0x7f3a2805e250 2023-10-18T19:40:57.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.641+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3a2407c000 con 0x7f3a2805e250 2023-10-18T19:40:57.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.809+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3a2805f270 con 0x7f3a2805e250 2023-10-18T19:40:57.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.810+0000 7f3a1d7fa700 1 -- 172.21.15.88:0/1470797219 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3a24035380 con 0x7f3a2805e250 2023-10-18T19:40:57.812 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:40:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 >> v1:172.21.15.88:6800/113625 conn(0x7f3a0c041bc0 legacy=0x7f3a0c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 msgr2=0x7f3a2814c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:40:57.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f3a2400c590 tx=0x7f3a24007c80).stop 2023-10-18T19:40:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 shutdown_connections 2023-10-18T19:40:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3a281361e0 0x7f3a280a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3a2805e250 0x7f3a2814c0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 --2- 172.21.15.88:0/1470797219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a280a6b10 0x7f3a28067230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:40:57.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 >> 172.21.15.88:0/1470797219 conn(0x7f3a280665a0 msgr2=0x7f3a28062d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:40:57.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 shutdown_connections 2023-10-18T19:40:57.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:40:57.811+0000 7f3a2f5ff700 1 -- 172.21.15.88:0/1470797219 wait complete. 2023-10-18T19:40:57.830 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:00.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:01.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.025+0000 7f7f485ff700 1 Processor -- start 2023-10-18T19:41:01.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.026+0000 7f7f485ff700 1 -- start start 2023-10-18T19:41:01.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.026+0000 7f7f485ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f485ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 0x7f7f40136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f485ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 0x7f7f4013bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f485ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f400afd50 con 0x7f7f400a1790 2023-10-18T19:41:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f485ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400a47a0 con 0x7f7f400a4c50 2023-10-18T19:41:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f485ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400a3a10 con 0x7f7f400af970 2023-10-18T19:41:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f45b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 0x7f7f40136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:43454/0 (socket says 172.21.15.88:43454) 2023-10-18T19:41:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 -- 172.21.15.88:0/3821211761 learned_addr learned my addr 172.21.15.88:0/3821211761 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f46b9c700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 0x7f7f4013bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 -- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 msgr2=0x7f7f4013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 0x7f7f4013bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 -- 172.21.15.88:0/3821211761 >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 msgr2=0x7f7f40136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 --2- 172.21.15.88:0/3821211761 >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 0x7f7f40136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f4639b700 1 -- 172.21.15.88:0/3821211761 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400a32d0 con 0x7f7f400af970 2023-10-18T19:41:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f45b9a700 1 --2- 172.21.15.88:0/3821211761 >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 0x7f7f40136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.027+0000 7f7f46b9c700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 0x7f7f4013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:01.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f4639b700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7f3c009830 tx=0x7f7f3c0090f0).ready entity=mon.2 client_cookie=90b823a98f7c6b7c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:01.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f45399700 1 -- 172.21.15.88:0/3821211761 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00f510 con 0x7f7f400af970 2023-10-18T19:41:01.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f45399700 1 -- 172.21.15.88:0/3821211761 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00f670 con 0x7f7f400af970 2023-10-18T19:41:01.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f45399700 1 -- 172.21.15.88:0/3821211761 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00f9f0 con 0x7f7f400af970 2023-10-18T19:41:01.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 -- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 msgr2=0x7f7f40135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7f3c009830 tx=0x7f7f3c0090f0).stop 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 -- 172.21.15.88:0/3821211761 shutdown_connections 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400af970 0x7f7f40135d30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 --2- 172.21.15.88:0/3821211761 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400a4c50 0x7f7f4013bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 --2- 172.21.15.88:0/3821211761 >> v2:172.21.15.88:3300/0 conn(0x7f7f400a1790 0x7f7f40136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 -- 172.21.15.88:0/3821211761 >> 172.21.15.88:0/3821211761 conn(0x7f7f4005eb60 msgr2=0x7f7f400af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:01.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.028+0000 7f7f485ff700 1 -- 172.21.15.88:0/3821211761 shutdown_connections 2023-10-18T19:41:01.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.029+0000 7f7f485ff700 1 -- 172.21.15.88:0/3821211761 wait complete. 2023-10-18T19:41:01.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.030+0000 7f7f485ff700 1 Processor -- start 2023-10-18T19:41:01.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.030+0000 7f7f485ff700 1 -- start start 2023-10-18T19:41:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400a4c50 0x7f7f400ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400af970 0x7f7f400a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:01.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400ab240 con 0x7f7f400a1790 2023-10-18T19:41:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400ab440 con 0x7f7f400af970 2023-10-18T19:41:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f485ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400aa060 con 0x7f7f400a4c50 2023-10-18T19:41:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49186/0 (socket says 172.21.15.88:49186) 2023-10-18T19:41:01.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 -- 172.21.15.88:0/1147178808 learned_addr learned my addr 172.21.15.88:0/1147178808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:01.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f46b9c700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400af970 0x7f7f400a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f45b9a700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400a4c50 0x7f7f400ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:01.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 -- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400a4c50 msgr2=0x7f7f400ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:01.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400a4c50 0x7f7f400ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 -- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400af970 msgr2=0x7f7f400a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400af970 0x7f7f400a7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 -- 172.21.15.88:0/1147178808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300092a0 con 0x7f7f400a1790 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.031+0000 7f7f4639b700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7f400a3ba0 tx=0x7f7f3c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.032+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00f7e0 con 0x7f7f400a1790 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.032+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00f940 con 0x7f7f400a1790 2023-10-18T19:41:01.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.032+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f38009a20 con 0x7f7f400a1790 2023-10-18T19:41:01.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.032+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c01b660 con 0x7f7f400a1790 2023-10-18T19:41:01.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.032+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c009370 con 0x7f7f400a1790 2023-10-18T19:41:01.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.033+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4005f270 con 0x7f7f400a1790 2023-10-18T19:41:01.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.033+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f7f3c01ba10 con 0x7f7f400a1790 2023-10-18T19:41:01.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.034+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f7f3c056ff0 con 0x7f7f400a1790 2023-10-18T19:41:01.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.037+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f7f3c007e60 con 0x7f7f400a1790 2023-10-18T19:41:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.214+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f400a3010 con 0x7f7f400a1790 2023-10-18T19:41:01.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.214+0000 7f7f367fc700 1 -- 172.21.15.88:0/1147178808 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f7f3c03aac0 con 0x7f7f400a1790 2023-10-18T19:41:01.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:01.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 >> v1:172.21.15.88:6800/113625 conn(0x7f7f24041bc0 legacy=0x7f7f24044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:01.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 msgr2=0x7f7f401493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:01.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7f400a3ba0 tx=0x7f7f3c015000).stop 2023-10-18T19:41:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 shutdown_connections 2023-10-18T19:41:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f400af970 0x7f7f400a7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f400a1790 0x7f7f401493e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 --2- 172.21.15.88:0/1147178808 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f7f400a4c50 0x7f7f400ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 >> 172.21.15.88:0/1147178808 conn(0x7f7f4005eb60 msgr2=0x7f7f400ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 shutdown_connections 2023-10-18T19:41:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:01.216+0000 7f7f485ff700 1 -- 172.21.15.88:0/1147178808 wait complete. 2023-10-18T19:41:01.234 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:04.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:04.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.430+0000 7f9bc37ff700 1 Processor -- start 2023-10-18T19:41:04.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 -- start start 2023-10-18T19:41:04.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 0x7f9bbc09db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:04.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 0x7f9bbc142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:04.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc09d700 con 0x7f9bbc062ea0 2023-10-18T19:41:04.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc06a310 con 0x7f9bbc0aa190 2023-10-18T19:41:04.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.431+0000 7f9bc37ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc063280 con 0x7f9bbc1406f0 2023-10-18T19:41:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc0d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 0x7f9bbc09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 0x7f9bbc142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc0d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 0x7f9bbc09db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49202/0 (socket says 172.21.15.88:49202) 2023-10-18T19:41:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc0d9a700 1 -- 172.21.15.88:0/3361117925 learned_addr learned my addr 172.21.15.88:0/3361117925 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:04.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 -- 172.21.15.88:0/3361117925 >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 msgr2=0x7f9bbc09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 --2- 172.21.15.88:0/3361117925 >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 0x7f9bbc09db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 -- 172.21.15.88:0/3361117925 >> v1:172.21.15.88:6789/0 conn(0x7f9bbc062ea0 legacy=0x7f9bbc069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 -- 172.21.15.88:0/3361117925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0aa620 con 0x7f9bbc1406f0 2023-10-18T19:41:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.432+0000 7f9bc1d9c700 1 --2- 172.21.15.88:0/3361117925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 0x7f9bbc142ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9bb4009e60 tx=0x7f9bb4009780).ready entity=mon.1 client_cookie=b2bc77da1bd2fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:04.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bb3fff700 1 -- 172.21.15.88:0/3361117925 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400e070 con 0x7f9bbc1406f0 2023-10-18T19:41:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bb3fff700 1 -- 172.21.15.88:0/3361117925 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb400bbf0 con 0x7f9bbc1406f0 2023-10-18T19:41:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bb3fff700 1 -- 172.21.15.88:0/3361117925 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4012410 con 0x7f9bbc1406f0 2023-10-18T19:41:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3361117925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 msgr2=0x7f9bbc142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3361117925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 0x7f9bbc142ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9bb4009e60 tx=0x7f9bb4009780).stop 2023-10-18T19:41:04.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3361117925 shutdown_connections 2023-10-18T19:41:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3361117925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc1406f0 0x7f9bbc142ae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3361117925 >> v2:172.21.15.88:3300/0 conn(0x7f9bbc0aa190 0x7f9bbc09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3361117925 >> 172.21.15.88:0/3361117925 conn(0x7f9bbc067ef0 msgr2=0x7f9bbc0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3361117925 shutdown_connections 2023-10-18T19:41:04.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.433+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3361117925 wait complete. 2023-10-18T19:41:04.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.435+0000 7f9bc37ff700 1 Processor -- start 2023-10-18T19:41:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.435+0000 7f9bc37ff700 1 -- start start 2023-10-18T19:41:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9bbc062ea0 0x7f9bbc0a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc0a5950 0x7f9bbc148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:04.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0a50d0 con 0x7f9bbc1406f0 2023-10-18T19:41:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc13fc70 con 0x7f9bbc0a5950 2023-10-18T19:41:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.436+0000 7f9bc37ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0a6ad0 con 0x7f9bbc062ea0 2023-10-18T19:41:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc159b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9bbc062ea0 0x7f9bbc0a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:04.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc1d9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc0a5950 0x7f9bbc148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49218/0 (socket says 172.21.15.88:49218) 2023-10-18T19:41:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 -- 172.21.15.88:0/3409909102 learned_addr learned my addr 172.21.15.88:0/3409909102 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 -- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9bbc062ea0 msgr2=0x7f9bbc0a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9bbc062ea0 0x7f9bbc0a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 -- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc0a5950 msgr2=0x7f9bbc148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc0a5950 0x7f9bbc148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 -- 172.21.15.88:0/3409909102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009a20 con 0x7f9bbc1406f0 2023-10-18T19:41:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc0d9a700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9bac00e930 tx=0x7f9bac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac012600 con 0x7f9bbc1406f0 2023-10-18T19:41:04.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac012760 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.437+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc0a5240 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.438+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac012ae0 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.438+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc13f5d0 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.439+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc0a53d0 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.439+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f9bac01b400 con 0x7f9bbc1406f0 2023-10-18T19:41:04.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.440+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f9bac055c10 con 0x7f9bbc1406f0 2023-10-18T19:41:04.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.443+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9bac035f50 con 0x7f9bbc1406f0 2023-10-18T19:41:04.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.619+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9bbc05f270 con 0x7f9bbc1406f0 2023-10-18T19:41:04.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.619+0000 7f9bb17fa700 1 -- 172.21.15.88:0/3409909102 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9bac039740 con 0x7f9bbc1406f0 2023-10-18T19:41:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 >> v1:172.21.15.88:6800/113625 conn(0x7f9ba0041bf0 legacy=0x7f9ba00440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 msgr2=0x7f9bbc1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f9bac00e930 tx=0x7f9bac0090f0).stop 2023-10-18T19:41:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 shutdown_connections 2023-10-18T19:41:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9bbc0a5950 0x7f9bbc148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9bbc062ea0 0x7f9bbc0a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 --2- 172.21.15.88:0/3409909102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9bbc1406f0 0x7f9bbc1486b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 >> 172.21.15.88:0/3409909102 conn(0x7f9bbc067ef0 msgr2=0x7f9bbc0ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:04.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 shutdown_connections 2023-10-18T19:41:04.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:04.621+0000 7f9bc37ff700 1 -- 172.21.15.88:0/3409909102 wait complete. 2023-10-18T19:41:04.639 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:07.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.836+0000 7ffb745ff700 1 Processor -- start 2023-10-18T19:41:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.836+0000 7ffb745ff700 1 -- start start 2023-10-18T19:41:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb745ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb745ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 0x7ffb6c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb745ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c0afd50 con 0x7ffb6c0af970 2023-10-18T19:41:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb745ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0a47a0 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb745ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0a3a10 con 0x7ffb6c0a1790 2023-10-18T19:41:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb7239b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffb6c0af970 0x7ffb6c135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39458/0 (socket says 172.21.15.88:39458) 2023-10-18T19:41:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb7239b700 1 -- 172.21.15.88:0/3580508524 learned_addr learned my addr 172.21.15.88:0/3580508524 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:41:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb72b9c700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 0x7ffb6c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb71b9a700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb71399700 1 -- 172.21.15.88:0/3580508524 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080821753 0 0) 0x7ffb6c0afd50 con 0x7ffb6c0af970 2023-10-18T19:41:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb71399700 1 -- 172.21.15.88:0/3580508524 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb580033f0 con 0x7ffb6c0af970 2023-10-18T19:41:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb72b9c700 1 -- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 msgr2=0x7ffb6c1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb72b9c700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c1412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb72b9c700 1 -- 172.21.15.88:0/3580508524 >> v1:172.21.15.88:6789/0 conn(0x7ffb6c0af970 legacy=0x7ffb6c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb72b9c700 1 -- 172.21.15.88:0/3580508524 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c0a32d0 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.837+0000 7ffb71b9a700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb72b9c700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 0x7ffb6c1437e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ffb64009e90 tx=0x7ffb64009780).ready entity=mon.1 client_cookie=b5cc96b3be4473b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb71399700 1 -- 172.21.15.88:0/3580508524 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400e070 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb71399700 1 -- 172.21.15.88:0/3580508524 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400bab0 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb71399700 1 -- 172.21.15.88:0/3580508524 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400be30 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 -- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 msgr2=0x7ffb6c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:07.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 0x7ffb6c1437e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ffb64009e90 tx=0x7ffb64009780).stop 2023-10-18T19:41:07.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 -- 172.21.15.88:0/3580508524 shutdown_connections 2023-10-18T19:41:07.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0a4c50 0x7ffb6c1437e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3580508524 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 -- 172.21.15.88:0/3580508524 >> 172.21.15.88:0/3580508524 conn(0x7ffb6c05eb60 msgr2=0x7ffb6c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.838+0000 7ffb745ff700 1 -- 172.21.15.88:0/3580508524 shutdown_connections 2023-10-18T19:41:07.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.839+0000 7ffb745ff700 1 -- 172.21.15.88:0/3580508524 wait complete. 2023-10-18T19:41:07.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.840+0000 7ffb745ff700 1 Processor -- start 2023-10-18T19:41:07.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.840+0000 7ffb745ff700 1 -- start start 2023-10-18T19:41:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb6c0a4c50 0x7ffb6c091b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0af970 0x7ffb6c0a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0ab4c0 con 0x7ffb6c0a4c50 2023-10-18T19:41:07.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c0ac490 con 0x7ffb6c0af970 2023-10-18T19:41:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb745ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c149060 con 0x7ffb6c0a1790 2023-10-18T19:41:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38808/0 (socket says 172.21.15.88:38808) 2023-10-18T19:41:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 -- 172.21.15.88:0/3981950692 learned_addr learned my addr 172.21.15.88:0/3981950692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:07.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb72b9c700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0af970 0x7ffb6c0a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb71b9a700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb6c0a4c50 0x7ffb6c091b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 -- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0af970 msgr2=0x7ffb6c0a8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0af970 0x7ffb6c0a8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 -- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb6c0a4c50 msgr2=0x7ffb6c091b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb6c0a4c50 0x7ffb6c091b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 -- 172.21.15.88:0/3981950692 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0092a0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.841+0000 7ffb7239b700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ffb6800c420 tx=0x7ffb68007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.842+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680070d0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.842+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68007230 con 0x7ffb6c0a1790 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.842+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680075d0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.842+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64009a20 con 0x7ffb6c0a1790 2023-10-18T19:41:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.842+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c092020 con 0x7ffb6c0a1790 2023-10-18T19:41:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.843+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c0ab7a0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.843+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7ffb680059b0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.844+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7ffb68054ec0 con 0x7ffb6c0a1790 2023-10-18T19:41:07.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:07.847+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ffb680351a0 con 0x7ffb6c0a1790 2023-10-18T19:41:08.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.014+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb6c0a3010 con 0x7ffb6c0a1790 2023-10-18T19:41:08.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.015+0000 7ffb627fc700 1 -- 172.21.15.88:0/3981950692 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ffb68038990 con 0x7ffb6c0a1790 2023-10-18T19:41:08.017 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 >> v1:172.21.15.88:6800/113625 conn(0x7ffb50041bc0 legacy=0x7ffb50044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:08.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 msgr2=0x7ffb6c0ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7ffb6800c420 tx=0x7ffb68007c80).stop 2023-10-18T19:41:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 shutdown_connections 2023-10-18T19:41:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb6c0af970 0x7ffb6c0a8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ffb6c0a1790 0x7ffb6c0ab950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:08.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 --2- 172.21.15.88:0/3981950692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb6c0a4c50 0x7ffb6c091b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 >> 172.21.15.88:0/3981950692 conn(0x7ffb6c05eb60 msgr2=0x7ffb6c137ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.016+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 shutdown_connections 2023-10-18T19:41:08.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:08.017+0000 7ffb745ff700 1 -- 172.21.15.88:0/3981950692 wait complete. 2023-10-18T19:41:08.035 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:11.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:11.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.229+0000 7ff4f4bff700 1 Processor -- start 2023-10-18T19:41:11.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.229+0000 7ff4f4bff700 1 -- start start 2023-10-18T19:41:11.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4f4bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 0x7ff4f0136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:11.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4f4bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4f006aa30 0x7ff4f0136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:11.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4f4bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00ab970 con 0x7ff4f00ab590 2023-10-18T19:41:11.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4f4bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f0135a50 con 0x7ff4f006aa30 2023-10-18T19:41:11.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4f4bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0135cf0 con 0x7ff4f006a310 2023-10-18T19:41:11.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4edd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 0x7ff4f0136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:11.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4ee59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff4f00ab590 0x7ff4f0139630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39462/0 (socket says 172.21.15.88:39462) 2023-10-18T19:41:11.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4ee59c700 1 -- 172.21.15.88:0/27017616 learned_addr learned my addr 172.21.15.88:0/27017616 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:41:11.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.230+0000 7ff4eed9d700 1 --2- 172.21.15.88:0/27017616 >> v2:172.21.15.88:3300/0 conn(0x7ff4f006aa30 0x7ff4f0136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:11.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4edd9b700 1 -- 172.21.15.88:0/27017616 >> v2:172.21.15.88:3300/0 conn(0x7ff4f006aa30 msgr2=0x7ff4f0136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:11.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4edd9b700 1 --2- 172.21.15.88:0/27017616 >> v2:172.21.15.88:3300/0 conn(0x7ff4f006aa30 0x7ff4f0136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4edd9b700 1 -- 172.21.15.88:0/27017616 >> v1:172.21.15.88:6789/0 conn(0x7ff4f00ab590 legacy=0x7ff4f0139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4edd9b700 1 -- 172.21.15.88:0/27017616 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0139d40 con 0x7ff4f006a310 2023-10-18T19:41:11.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4edd9b700 1 --2- 172.21.15.88:0/27017616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 0x7ff4f0136210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff4e4009760 tx=0x7ff4e4009060).ready entity=mon.1 client_cookie=b385dd87e51166a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:11.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4ed59a700 1 -- 172.21.15.88:0/27017616 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400f510 con 0x7ff4f006a310 2023-10-18T19:41:11.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4ed59a700 1 -- 172.21.15.88:0/27017616 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400f670 con 0x7ff4f006a310 2023-10-18T19:41:11.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.231+0000 7ff4ed59a700 1 -- 172.21.15.88:0/27017616 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400f9f0 con 0x7ff4f006a310 2023-10-18T19:41:11.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 -- 172.21.15.88:0/27017616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 msgr2=0x7ff4f0136210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/27017616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 0x7ff4f0136210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff4e4009760 tx=0x7ff4e4009060).stop 2023-10-18T19:41:11.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 -- 172.21.15.88:0/27017616 shutdown_connections 2023-10-18T19:41:11.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/27017616 >> v2:172.21.15.88:3300/0 conn(0x7ff4f006aa30 0x7ff4f0136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/27017616 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006a310 0x7ff4f0136210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 -- 172.21.15.88:0/27017616 >> 172.21.15.88:0/27017616 conn(0x7ff4f005eb30 msgr2=0x7ff4f00aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:11.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 -- 172.21.15.88:0/27017616 shutdown_connections 2023-10-18T19:41:11.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.232+0000 7ff4f4bff700 1 -- 172.21.15.88:0/27017616 wait complete. 2023-10-18T19:41:11.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.233+0000 7ff4f4bff700 1 Processor -- start 2023-10-18T19:41:11.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.233+0000 7ff4f4bff700 1 -- start start 2023-10-18T19:41:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 0x7ff4f009a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4f00ab590 0x7ff4f009e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f01339b0 con 0x7ff4f006a310 2023-10-18T19:41:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0149250 con 0x7ff4f006aa30 2023-10-18T19:41:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4f4bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0149510 con 0x7ff4f00ab590 2023-10-18T19:41:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4edd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 0x7ff4f009a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34646/0 (socket says 172.21.15.88:34646) 2023-10-18T19:41:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4ee59c700 1 -- 172.21.15.88:0/100054956 learned_addr learned my addr 172.21.15.88:0/100054956 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:11.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.234+0000 7ff4eed9d700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4f00ab590 0x7ff4f009e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:11.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 -- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4f00ab590 msgr2=0x7ff4f009e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4f00ab590 0x7ff4f009e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 -- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 msgr2=0x7ff4f009a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 0x7ff4f009a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 -- 172.21.15.88:0/100054956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40092a0 con 0x7ff4f006a310 2023-10-18T19:41:11.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4edd9b700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 0x7ff4f009a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:11.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4ee59c700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff4e0001eb0 tx=0x7ff4e0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:11.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00070d0 con 0x7ff4f006a310 2023-10-18T19:41:11.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0007230 con 0x7ff4f006a310 2023-10-18T19:41:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f01355d0 con 0x7ff4f006a310 2023-10-18T19:41:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00075d0 con 0x7ff4f006a310 2023-10-18T19:41:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.235+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f009a750 con 0x7ff4f006a310 2023-10-18T19:41:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.236+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f005f270 con 0x7ff4f006a310 2023-10-18T19:41:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.237+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7ff4e00059b0 con 0x7ff4f006a310 2023-10-18T19:41:11.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.237+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7ff4e0054e10 con 0x7ff4f006a310 2023-10-18T19:41:11.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.240+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ff4e00351b0 con 0x7ff4f006a310 2023-10-18T19:41:11.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.414+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4f006a810 con 0x7ff4f006a310 2023-10-18T19:41:11.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.414+0000 7ff4de7fc700 1 -- 172.21.15.88:0/100054956 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff4e0056070 con 0x7ff4f006a310 2023-10-18T19:41:11.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 >> v1:172.21.15.88:6800/113625 conn(0x7ff4d0041bc0 legacy=0x7ff4d0044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 msgr2=0x7ff4f01350e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:11.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff4e0001eb0 tx=0x7ff4e0007e50).stop 2023-10-18T19:41:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 shutdown_connections 2023-10-18T19:41:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff4f00ab590 0x7ff4f009e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4f006a310 0x7ff4f01350e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 --2- 172.21.15.88:0/100054956 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff4f006aa30 0x7ff4f009a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 >> 172.21.15.88:0/100054956 conn(0x7ff4f005eb30 msgr2=0x7ff4f00a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 shutdown_connections 2023-10-18T19:41:11.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:11.416+0000 7ff4f4bff700 1 -- 172.21.15.88:0/100054956 wait complete. 2023-10-18T19:41:11.436 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:14.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:14.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.632+0000 7efe5a7ff700 1 Processor -- start 2023-10-18T19:41:14.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.632+0000 7efe5a7ff700 1 -- start start 2023-10-18T19:41:14.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe5a7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54062ea0 0x7efe5409db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:14.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe5a7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:14.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe5a7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5409d700 con 0x7efe5406a0f0 2023-10-18T19:41:14.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe5a7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe54063280 con 0x7efe54062ea0 2023-10-18T19:41:14.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe5a7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe540aa620 con 0x7efe540aa190 2023-10-18T19:41:14.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe537fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:14.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe537fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:38826/0 (socket says 172.21.15.88:38826) 2023-10-18T19:41:14.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe537fe700 1 -- 172.21.15.88:0/1060739622 learned_addr learned my addr 172.21.15.88:0/1060739622 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:14.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.633+0000 7efe53fff700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54062ea0 0x7efe5409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:14.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe537fe700 1 -- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54062ea0 msgr2=0x7efe5409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:14.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe537fe700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54062ea0 0x7efe5409db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe537fe700 1 -- 172.21.15.88:0/1060739622 >> v1:172.21.15.88:6789/0 conn(0x7efe5406a0f0 legacy=0x7efe540636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe537fe700 1 -- 172.21.15.88:0/1060739622 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540aa8c0 con 0x7efe540aa190 2023-10-18T19:41:14.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe537fe700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7efe48009830 tx=0x7efe480090f0).ready entity=mon.2 client_cookie=b00649fb99afd6f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:14.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe52ffd700 1 -- 172.21.15.88:0/1060739622 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800b610 con 0x7efe540aa190 2023-10-18T19:41:14.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe52ffd700 1 -- 172.21.15.88:0/1060739622 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800b770 con 0x7efe540aa190 2023-10-18T19:41:14.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.634+0000 7efe52ffd700 1 -- 172.21.15.88:0/1060739622 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800baf0 con 0x7efe540aa190 2023-10-18T19:41:14.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 -- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 msgr2=0x7efe54069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7efe48009830 tx=0x7efe480090f0).stop 2023-10-18T19:41:14.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 -- 172.21.15.88:0/1060739622 shutdown_connections 2023-10-18T19:41:14.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54062ea0 0x7efe5409db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/1060739622 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe540aa190 0x7efe54069c00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 -- 172.21.15.88:0/1060739622 >> 172.21.15.88:0/1060739622 conn(0x7efe54067ef0 msgr2=0x7efe540625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:14.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 -- 172.21.15.88:0/1060739622 shutdown_connections 2023-10-18T19:41:14.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.635+0000 7efe5a7ff700 1 -- 172.21.15.88:0/1060739622 wait complete. 2023-10-18T19:41:14.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.636+0000 7efe5a7ff700 1 Processor -- start 2023-10-18T19:41:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.636+0000 7efe5a7ff700 1 -- start start 2023-10-18T19:41:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 0x7efe54094ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe54093690 0x7efe54148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe54094650 con 0x7efe54062ea0 2023-10-18T19:41:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe54148cb0 con 0x7efe54148820 2023-10-18T19:41:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe5a7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe540a9170 con 0x7efe54093690 2023-10-18T19:41:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe53fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe537fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 0x7efe54094ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe53fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34648/0 (socket says 172.21.15.88:34648) 2023-10-18T19:41:14.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe53fff700 1 -- 172.21.15.88:0/2246052853 learned_addr learned my addr 172.21.15.88:0/2246052853 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:14.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.637+0000 7efe58d9c700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe54093690 0x7efe54148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:14.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 -- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe54093690 msgr2=0x7efe54148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe54093690 0x7efe54148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 -- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 msgr2=0x7efe54092480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 -- 172.21.15.88:0/2246052853 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48009370 con 0x7efe54148820 2023-10-18T19:41:14.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe53fff700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:14.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe537fe700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 0x7efe54094ef0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7efe48014000 tx=0x7efe48017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:14.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800beb0 con 0x7efe54148820 2023-10-18T19:41:14.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800b8e0 con 0x7efe54148820 2023-10-18T19:41:14.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe540a88e0 con 0x7efe54148820 2023-10-18T19:41:14.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4801b660 con 0x7efe54148820 2023-10-18T19:41:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.638+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe54093cd0 con 0x7efe54148820 2023-10-18T19:41:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.639+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7efe4801ba50 con 0x7efe54148820 2023-10-18T19:41:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.639+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5405f270 con 0x7efe54148820 2023-10-18T19:41:14.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.640+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7efe48056810 con 0x7efe54148820 2023-10-18T19:41:14.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.643+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7efe4803a4c0 con 0x7efe54148820 2023-10-18T19:41:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.811+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe54065200 con 0x7efe54148820 2023-10-18T19:41:14.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.811+0000 7efe3bfff700 1 -- 172.21.15.88:0/2246052853 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7efe48021080 con 0x7efe54148820 2023-10-18T19:41:14.814 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 >> v1:172.21.15.88:6800/113625 conn(0x7efe40041bc0 legacy=0x7efe40044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 msgr2=0x7efe54094ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 0x7efe54094ef0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7efe48014000 tx=0x7efe48017000).stop 2023-10-18T19:41:14.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 shutdown_connections 2023-10-18T19:41:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7efe54093690 0x7efe54148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe54062ea0 0x7efe54092480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 --2- 172.21.15.88:0/2246052853 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7efe54148820 0x7efe54094ef0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:14.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 >> 172.21.15.88:0/2246052853 conn(0x7efe54067ef0 msgr2=0x7efe540aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 shutdown_connections 2023-10-18T19:41:14.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:14.813+0000 7efe5a7ff700 1 -- 172.21.15.88:0/2246052853 wait complete. 2023-10-18T19:41:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:17.834 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:18.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.026+0000 7f3b6f9ff700 1 Processor -- start 2023-10-18T19:41:18.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.026+0000 7f3b6f9ff700 1 -- start start 2023-10-18T19:41:18.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 0x7f3b68139630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 0x7f3b68136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 0x7f3b68136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b680ab970 con 0x7f3b680ab590 2023-10-18T19:41:18.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68135a50 con 0x7f3b6806aa30 2023-10-18T19:41:18.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.027+0000 7f3b6f9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68135cf0 con 0x7f3b6806a310 2023-10-18T19:41:18.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6d79b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 0x7f3b68139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 0x7f3b68136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6cf9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 0x7f3b68136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6d79b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 0x7f3b68139630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60548/0 (socket says 172.21.15.88:60548) 2023-10-18T19:41:18.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6d79b700 1 -- 172.21.15.88:0/1718070390 learned_addr learned my addr 172.21.15.88:0/1718070390 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:18.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 -- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 msgr2=0x7f3b68136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:18.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 0x7f3b68136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 -- 172.21.15.88:0/1718070390 >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 msgr2=0x7f3b68139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:18.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 --2- 172.21.15.88:0/1718070390 >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 0x7f3b68139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 -- 172.21.15.88:0/1718070390 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68139000 con 0x7f3b6806aa30 2023-10-18T19:41:18.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6cf9a700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 0x7f3b68136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:18.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b6df9c700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 0x7f3b68136700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3b60009e60 tx=0x7f3b60009780).ready entity=mon.1 client_cookie=8ef91415c9496e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:18.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.028+0000 7f3b5ffff700 1 -- 172.21.15.88:0/1718070390 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000e070 con 0x7f3b6806aa30 2023-10-18T19:41:18.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b5ffff700 1 -- 172.21.15.88:0/1718070390 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6000bab0 con 0x7f3b6806aa30 2023-10-18T19:41:18.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b5ffff700 1 -- 172.21.15.88:0/1718070390 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000be30 con 0x7f3b6806aa30 2023-10-18T19:41:18.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 msgr2=0x7f3b68136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:18.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 0x7f3b68136700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3b60009e60 tx=0x7f3b60009780).stop 2023-10-18T19:41:18.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/1718070390 shutdown_connections 2023-10-18T19:41:18.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806aa30 0x7f3b68136700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/1718070390 >> v2:172.21.15.88:3300/0 conn(0x7f3b680ab590 0x7f3b68139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/1718070390 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806a310 0x7f3b68136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/1718070390 >> 172.21.15.88:0/1718070390 conn(0x7f3b6805eb30 msgr2=0x7f3b680aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:18.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/1718070390 shutdown_connections 2023-10-18T19:41:18.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.029+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/1718070390 wait complete. 2023-10-18T19:41:18.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.030+0000 7f3b6f9ff700 1 Processor -- start 2023-10-18T19:41:18.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 -- start start 2023-10-18T19:41:18.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 0x7f3b68147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 0x7f3b681481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:18.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68148b40 con 0x7f3b680ab590 2023-10-18T19:41:18.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68148e00 con 0x7f3b6806a310 2023-10-18T19:41:18.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.031+0000 7f3b6f9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6813a850 con 0x7f3b6806aa30 2023-10-18T19:41:18.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6cf9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 0x7f3b68147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40474/0 (socket says 172.21.15.88:40474) 2023-10-18T19:41:18.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 -- 172.21.15.88:0/2696416031 learned_addr learned my addr 172.21.15.88:0/2696416031 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:18.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6df9c700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 0x7f3b681481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:18.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 -- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 msgr2=0x7f3b68147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:18.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 0x7f3b68147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 -- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 msgr2=0x7f3b681481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:18.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 0x7f3b681481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 -- 172.21.15.88:0/2696416031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580092a0 con 0x7f3b6806a310 2023-10-18T19:41:18.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6cf9a700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 0x7f3b68147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6df9c700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 0x7f3b681481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6d79b700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3b6400e900 tx=0x7f3b640090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012600 con 0x7f3b6806a310 2023-10-18T19:41:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64012760 con 0x7f3b6806a310 2023-10-18T19:41:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.032+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b60009a20 con 0x7f3b6806a310 2023-10-18T19:41:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.033+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012ae0 con 0x7f3b6806a310 2023-10-18T19:41:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.033+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6813ce40 con 0x7f3b6806a310 2023-10-18T19:41:18.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.034+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f3b6401b400 con 0x7f3b6806a310 2023-10-18T19:41:18.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.034+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6805f270 con 0x7f3b6806a310 2023-10-18T19:41:18.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.034+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f3b64055b70 con 0x7f3b6806a310 2023-10-18T19:41:18.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.038+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f3b64035eb0 con 0x7f3b6806a310 2023-10-18T19:41:18.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.205+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3b68096420 con 0x7f3b6806a310 2023-10-18T19:41:18.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.205+0000 7f3b5d7fa700 1 -- 172.21.15.88:0/2696416031 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3b64016070 con 0x7f3b6806a310 2023-10-18T19:41:18.208 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:18.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 >> v1:172.21.15.88:6800/113625 conn(0x7f3b4c041bc0 legacy=0x7f3b4c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:18.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 msgr2=0x7f3b68095ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:18.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3b6400e900 tx=0x7f3b640090f0).stop 2023-10-18T19:41:18.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 shutdown_connections 2023-10-18T19:41:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b680ab590 0x7f3b681481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3b6806a310 0x7f3b68095ed0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 --2- 172.21.15.88:0/2696416031 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f3b6806aa30 0x7f3b68147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 >> 172.21.15.88:0/2696416031 conn(0x7f3b6805eb30 msgr2=0x7f3b68135f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:18.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 shutdown_connections 2023-10-18T19:41:18.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:18.207+0000 7f3b6f9ff700 1 -- 172.21.15.88:0/2696416031 wait complete. 2023-10-18T19:41:18.226 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:21.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:21.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.424+0000 7f15783ff700 1 Processor -- start 2023-10-18T19:41:21.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.424+0000 7f15783ff700 1 -- start start 2023-10-18T19:41:21.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f15783ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f1570135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:21.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f15783ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 0x7f15701433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:21.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f15783ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157005ed40 con 0x7f157005e960 2023-10-18T19:41:21.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f15783ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1570136670 con 0x7f15700a3580 2023-10-18T19:41:21.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f15783ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15700a2ac0 con 0x7f15701361c0 2023-10-18T19:41:21.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f157599a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f1570135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:21.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f157699c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 0x7f15701433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:21.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f157619b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f157005e960 0x7f15700a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42816/0 (socket says 172.21.15.88:42816) 2023-10-18T19:41:21.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.425+0000 7f157619b700 1 -- 172.21.15.88:0/2368040015 learned_addr learned my addr 172.21.15.88:0/2368040015 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:41:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157599a700 1 -- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 msgr2=0x7f15701433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157599a700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 0x7f15701433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157599a700 1 -- 172.21.15.88:0/2368040015 >> v1:172.21.15.88:6789/0 conn(0x7f157005e960 legacy=0x7f15700a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157599a700 1 -- 172.21.15.88:0/2368040015 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700a2d60 con 0x7f15700a3580 2023-10-18T19:41:21.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f1575199700 1 -- 172.21.15.88:0/2368040015 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360070069 0 0) 0x7f157005ed40 con 0x7f157005e960 2023-10-18T19:41:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157699c700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 0x7f15701433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f157599a700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f1570135cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f1560009790 tx=0x7f1560009060).ready entity=mon.1 client_cookie=91d20db8a3c1cf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f1575199700 1 -- 172.21.15.88:0/2368040015 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000b590 con 0x7f15700a3580 2023-10-18T19:41:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f1575199700 1 -- 172.21.15.88:0/2368040015 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156000b6f0 con 0x7f15700a3580 2023-10-18T19:41:21.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.426+0000 7f1575199700 1 -- 172.21.15.88:0/2368040015 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000bac0 con 0x7f15700a3580 2023-10-18T19:41:21.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 -- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 msgr2=0x7f1570135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f1570135cd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f1560009790 tx=0x7f1560009060).stop 2023-10-18T19:41:21.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 -- 172.21.15.88:0/2368040015 shutdown_connections 2023-10-18T19:41:21.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f15701361c0 0x7f15701433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 --2- 172.21.15.88:0/2368040015 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f1570135cd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 -- 172.21.15.88:0/2368040015 >> 172.21.15.88:0/2368040015 conn(0x7f1570064bb0 msgr2=0x7f157005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 -- 172.21.15.88:0/2368040015 shutdown_connections 2023-10-18T19:41:21.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.427+0000 7f15783ff700 1 -- 172.21.15.88:0/2368040015 wait complete. 2023-10-18T19:41:21.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.428+0000 7f15783ff700 1 Processor -- start 2023-10-18T19:41:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.428+0000 7f15783ff700 1 -- start start 2023-10-18T19:41:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f15700a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:21.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 0x7f1570137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:21.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700a6c10 con 0x7f15701361c0 2023-10-18T19:41:21.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700a5550 con 0x7f15700a3580 2023-10-18T19:41:21.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f15783ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15700ac090 con 0x7f157005e960 2023-10-18T19:41:21.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157619b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:21.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157599a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f15700a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157699c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 0x7f1570137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157619b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52714/0 (socket says 172.21.15.88:52714) 2023-10-18T19:41:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157599a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f15700a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:40492/0 (socket says 172.21.15.88:40492) 2023-10-18T19:41:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.429+0000 7f157619b700 1 -- 172.21.15.88:0/366632337 learned_addr learned my addr 172.21.15.88:0/366632337 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:21.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 -- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 msgr2=0x7f157013fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 -- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 msgr2=0x7f15700a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f15700a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 -- 172.21.15.88:0/366632337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568009a20 con 0x7f15701361c0 2023-10-18T19:41:21.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157619b700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f157699c700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 0x7f1570137780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1568009e70 tx=0x7f156800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156800cb30 con 0x7f15701361c0 2023-10-18T19:41:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156800f040 con 0x7f15701361c0 2023-10-18T19:41:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15600092a0 con 0x7f15701361c0 2023-10-18T19:41:21.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156800cea0 con 0x7f15701361c0 2023-10-18T19:41:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.430+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15700a7d80 con 0x7f15701361c0 2023-10-18T19:41:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.431+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15700ac250 con 0x7f15701361c0 2023-10-18T19:41:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.431+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f1568013610 con 0x7f15701361c0 2023-10-18T19:41:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.432+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f1568056110 con 0x7f15701361c0 2023-10-18T19:41:21.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.435+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f1568036390 con 0x7f15701361c0 2023-10-18T19:41:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.606+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f157005f270 con 0x7f15701361c0 2023-10-18T19:41:21.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.606+0000 7f15667fc700 1 -- 172.21.15.88:0/366632337 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1568054d50 con 0x7f15701361c0 2023-10-18T19:41:21.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:21.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 >> v1:172.21.15.88:6800/113625 conn(0x7f1554041bf0 legacy=0x7f15540440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 msgr2=0x7f1570137780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 0x7f1570137780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1568009e70 tx=0x7f156800b040).stop 2023-10-18T19:41:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 shutdown_connections 2023-10-18T19:41:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15701361c0 0x7f1570137780 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f157005e960 0x7f157013fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 --2- 172.21.15.88:0/366632337 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f15700a3580 0x7f15700a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 >> 172.21.15.88:0/366632337 conn(0x7f1570064bb0 msgr2=0x7f1570139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 shutdown_connections 2023-10-18T19:41:21.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:21.608+0000 7f15783ff700 1 -- 172.21.15.88:0/366632337 wait complete. 2023-10-18T19:41:21.627 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:24.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.823+0000 7fb02a3ff700 1 Processor -- start 2023-10-18T19:41:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.823+0000 7fb02a3ff700 1 -- start start 2023-10-18T19:41:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 0x7fb0240a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0241363f0 0x7fb02413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0240a45e0 con 0x7fb0241363f0 2023-10-18T19:41:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02405ed40 con 0x7fb02405e960 2023-10-18T19:41:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.824+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240a51e0 con 0x7fb0240a4a70 2023-10-18T19:41:24.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb023fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 0x7fb0240a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52728/0 (socket says 172.21.15.88:52728) 2023-10-18T19:41:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 -- 172.21.15.88:0/1196087631 learned_addr learned my addr 172.21.15.88:0/1196087631 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb02899c700 1 --2- 172.21.15.88:0/1196087631 >> v2:172.21.15.88:3300/0 conn(0x7fb0241363f0 0x7fb02413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 -- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 msgr2=0x7fb0240a39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 0x7fb0240a39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 -- 172.21.15.88:0/1196087631 >> v2:172.21.15.88:3300/0 conn(0x7fb0241363f0 msgr2=0x7fb02413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 --2- 172.21.15.88:0/1196087631 >> v2:172.21.15.88:3300/0 conn(0x7fb0241363f0 0x7fb02413c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 -- 172.21.15.88:0/1196087631 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240a1690 con 0x7fb0240a4a70 2023-10-18T19:41:24.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb023fff700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 0x7fb0240a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.825+0000 7fb0237fe700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb018009830 tx=0x7fb0180090f0).ready entity=mon.2 client_cookie=ceb11e9161daaf10 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb022ffd700 1 -- 172.21.15.88:0/1196087631 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800f510 con 0x7fb0240a4a70 2023-10-18T19:41:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb022ffd700 1 -- 172.21.15.88:0/1196087631 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800f670 con 0x7fb0240a4a70 2023-10-18T19:41:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb022ffd700 1 -- 172.21.15.88:0/1196087631 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800f9f0 con 0x7fb0240a4a70 2023-10-18T19:41:24.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 -- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 msgr2=0x7fb024135f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb018009830 tx=0x7fb0180090f0).stop 2023-10-18T19:41:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 -- 172.21.15.88:0/1196087631 shutdown_connections 2023-10-18T19:41:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/1196087631 >> v2:172.21.15.88:3300/0 conn(0x7fb0241363f0 0x7fb02413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02405e960 0x7fb0240a39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/1196087631 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb0240a4a70 0x7fb024135f00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 -- 172.21.15.88:0/1196087631 >> 172.21.15.88:0/1196087631 conn(0x7fb024064bf0 msgr2=0x7fb02405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:24.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 -- 172.21.15.88:0/1196087631 shutdown_connections 2023-10-18T19:41:24.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.826+0000 7fb02a3ff700 1 -- 172.21.15.88:0/1196087631 wait complete. 2023-10-18T19:41:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 Processor -- start 2023-10-18T19:41:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 -- start start 2023-10-18T19:41:24.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 0x7fb02413e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 0x7fb024133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:24.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240a7150 con 0x7fb0241363f0 2023-10-18T19:41:24.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240afe20 con 0x7fb0240a4a70 2023-10-18T19:41:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.828+0000 7fb02a3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02413eb30 con 0x7fb02405e960 2023-10-18T19:41:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb023fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb023fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52730/0 (socket says 172.21.15.88:52730) 2023-10-18T19:41:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb023fff700 1 -- 172.21.15.88:0/3137836922 learned_addr learned my addr 172.21.15.88:0/3137836922 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 0x7fb024133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb0237fe700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 0x7fb02413e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 -- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 msgr2=0x7fb0240a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:24.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 -- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 msgr2=0x7fb02413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 0x7fb02413e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 -- 172.21.15.88:0/3137836922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140092a0 con 0x7fb0241363f0 2023-10-18T19:41:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb023fff700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:24.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb0237fe700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 0x7fb02413e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.829+0000 7fb02899c700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 0x7fb024133850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fb01c00ecf0 tx=0x7fb01c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.830+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00c920 con 0x7fb0241363f0 2023-10-18T19:41:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.830+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00f040 con 0x7fb0241363f0 2023-10-18T19:41:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.830+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00cc90 con 0x7fb0241363f0 2023-10-18T19:41:24.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.830+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018009370 con 0x7fb0241363f0 2023-10-18T19:41:24.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.830+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02413f070 con 0x7fb0241363f0 2023-10-18T19:41:24.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.831+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02406c8c0 con 0x7fb0241363f0 2023-10-18T19:41:24.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.831+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fb01c01d460 con 0x7fb0241363f0 2023-10-18T19:41:24.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.832+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fb01c055d10 con 0x7fb0241363f0 2023-10-18T19:41:24.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:24.835+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fb01c05c080 con 0x7fb0241363f0 2023-10-18T19:41:25.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.002+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb02413f010 con 0x7fb0241363f0 2023-10-18T19:41:25.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.003+0000 7fb00bfff700 1 -- 172.21.15.88:0/3137836922 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb01c035f90 con 0x7fb0241363f0 2023-10-18T19:41:25.007 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:25.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.004+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 >> v1:172.21.15.88:6800/113625 conn(0x7fb010041bf0 legacy=0x7fb0100440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:25.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.004+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 msgr2=0x7fb024133850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:25.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.004+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 0x7fb024133850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fb01c00ecf0 tx=0x7fb01c00b040).stop 2023-10-18T19:41:25.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 shutdown_connections 2023-10-18T19:41:25.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0241363f0 0x7fb024133850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:25.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fb02405e960 0x7fb0240a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:25.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 --2- 172.21.15.88:0/3137836922 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb0240a4a70 0x7fb02413e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:25.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 >> 172.21.15.88:0/3137836922 conn(0x7fb024064bf0 msgr2=0x7fb024139350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:25.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 shutdown_connections 2023-10-18T19:41:25.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:25.005+0000 7fb02a3ff700 1 -- 172.21.15.88:0/3137836922 wait complete. 2023-10-18T19:41:25.024 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:28.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:28.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.218+0000 7fa22e1ff700 1 Processor -- start 2023-10-18T19:41:28.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.218+0000 7fa22e1ff700 1 -- start start 2023-10-18T19:41:28.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 0x7fa228135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa22813bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280afd50 con 0x7fa2280af970 2023-10-18T19:41:28.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280a47a0 con 0x7fa2280a1790 2023-10-18T19:41:28.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.219+0000 7fa22e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280a3a10 con 0x7fa2280a4c50 2023-10-18T19:41:28.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa2277fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 0x7fa228135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa227fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa22813bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36734/0 (socket says 172.21.15.88:36734) 2023-10-18T19:41:28.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 -- 172.21.15.88:0/1190322758 learned_addr learned my addr 172.21.15.88:0/1190322758 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:28.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 -- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 msgr2=0x7fa22813bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:28.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 --2- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa22813bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 -- 172.21.15.88:0/1190322758 >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 msgr2=0x7fa228135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 --2- 172.21.15.88:0/1190322758 >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 0x7fa228135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 -- 172.21.15.88:0/1190322758 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280a32d0 con 0x7fa2280a1790 2023-10-18T19:41:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa2277fe700 1 --2- 172.21.15.88:0/1190322758 >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 0x7fa228135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa226ffd700 1 --2- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa21c006fd0 tx=0x7fa21c0090f0).ready entity=mon.1 client_cookie=f668d55c5f7fd121 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:28.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.220+0000 7fa2267fc700 1 -- 172.21.15.88:0/1190322758 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00f510 con 0x7fa2280a1790 2023-10-18T19:41:28.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa2267fc700 1 -- 172.21.15.88:0/1190322758 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c00f670 con 0x7fa2280a1790 2023-10-18T19:41:28.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa2267fc700 1 -- 172.21.15.88:0/1190322758 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00f9f0 con 0x7fa2280a1790 2023-10-18T19:41:28.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 -- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 msgr2=0x7fa228136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:28.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa21c006fd0 tx=0x7fa21c0090f0).stop 2023-10-18T19:41:28.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 -- 172.21.15.88:0/1190322758 shutdown_connections 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa22813bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/1190322758 >> v2:172.21.15.88:3300/0 conn(0x7fa2280af970 0x7fa228135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/1190322758 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280a1790 0x7fa228136220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 -- 172.21.15.88:0/1190322758 >> 172.21.15.88:0/1190322758 conn(0x7fa22805eb60 msgr2=0x7fa2280af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 -- 172.21.15.88:0/1190322758 shutdown_connections 2023-10-18T19:41:28.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.221+0000 7fa22e1ff700 1 -- 172.21.15.88:0/1190322758 wait complete. 2023-10-18T19:41:28.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.222+0000 7fa22e1ff700 1 Processor -- start 2023-10-18T19:41:28.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 -- start start 2023-10-18T19:41:28.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa2280a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 0x7fa22814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280a9be0 con 0x7fa2280a1790 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280ab850 con 0x7fa2280af970 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa22e1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280a8240 con 0x7fa2280a4c50 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.223+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa2280a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40112/0 (socket says 172.21.15.88:40112) 2023-10-18T19:41:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa2280a96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52914/0 (socket says 172.21.15.88:52914) 2023-10-18T19:41:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 -- 172.21.15.88:0/3737890135 learned_addr learned my addr 172.21.15.88:0/3737890135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa227fff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 0x7fa22814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:28.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 -- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 msgr2=0x7fa2280a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:28.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa2280a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 -- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 msgr2=0x7fa22814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:28.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 0x7fa22814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 -- 172.21.15.88:0/3737890135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180092a0 con 0x7fa2280a1790 2023-10-18T19:41:28.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa227fff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 0x7fa22814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa2277fe700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa21800e980 tx=0x7fa218009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218012600 con 0x7fa2280a1790 2023-10-18T19:41:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218012760 con 0x7fa2280a1790 2023-10-18T19:41:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c009370 con 0x7fa2280a1790 2023-10-18T19:41:28.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.224+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218012ae0 con 0x7fa2280a1790 2023-10-18T19:41:28.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.225+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280ab210 con 0x7fa2280a1790 2023-10-18T19:41:28.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.225+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228137c70 con 0x7fa2280a1790 2023-10-18T19:41:28.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.226+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fa21801b400 con 0x7fa2280a1790 2023-10-18T19:41:28.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.226+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fa218055d40 con 0x7fa2280a1790 2023-10-18T19:41:28.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.230+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fa2180361d0 con 0x7fa2280a1790 2023-10-18T19:41:28.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.400+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa2280a3010 con 0x7fa2280a1790 2023-10-18T19:41:28.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.400+0000 7fa20f7fe700 1 -- 172.21.15.88:0/3737890135 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fa2180549c0 con 0x7fa2280a1790 2023-10-18T19:41:28.403 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 >> v1:172.21.15.88:6800/113625 conn(0x7fa214041bc0 legacy=0x7fa214044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 msgr2=0x7fa2280aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fa21800e980 tx=0x7fa218009060).stop 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 shutdown_connections 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2280af970 0x7fa22814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2280a1790 0x7fa2280aaab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 --2- 172.21.15.88:0/3737890135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fa2280a4c50 0x7fa2280a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:28.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 >> 172.21.15.88:0/3737890135 conn(0x7fa22805eb60 msgr2=0x7fa228138130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:28.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 shutdown_connections 2023-10-18T19:41:28.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:28.402+0000 7fa22e1ff700 1 -- 172.21.15.88:0/3737890135 wait complete. 2023-10-18T19:41:28.421 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:31.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.616+0000 7f0bff5ff700 1 Processor -- start 2023-10-18T19:41:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.617+0000 7f0bff5ff700 1 -- start start 2023-10-18T19:41:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.617+0000 7f0bff5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.617+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 0x7f0bf8136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf813bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bff5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80afd50 con 0x7f0bf80af970 2023-10-18T19:41:31.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80a47a0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80a3a10 con 0x7f0bf80a1790 2023-10-18T19:41:31.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfd39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfd39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40120/0 (socket says 172.21.15.88:40120) 2023-10-18T19:41:31.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfcb9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 0x7f0bf8136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfd39b700 1 -- 172.21.15.88:0/589375687 learned_addr learned my addr 172.21.15.88:0/589375687 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf813bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 -- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 msgr2=0x7f0bf8136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 0x7f0bf8136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 -- 172.21.15.88:0/589375687 >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 msgr2=0x7f0bf8135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 --2- 172.21.15.88:0/589375687 >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfdb9c700 1 -- 172.21.15.88:0/589375687 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80a32d0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfd39b700 1 --2- 172.21.15.88:0/589375687 >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.618+0000 7f0bfcb9a700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 0x7f0bf8136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bfdb9c700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf813bf90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0bf0009e60 tx=0x7f0bf0009780).ready entity=mon.1 client_cookie=b8fa265d7a0360 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0beffff700 1 -- 172.21.15.88:0/589375687 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000e070 con 0x7f0bf80a4c50 2023-10-18T19:41:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0beffff700 1 -- 172.21.15.88:0/589375687 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000bab0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0beffff700 1 -- 172.21.15.88:0/589375687 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000be30 con 0x7f0bf80a4c50 2023-10-18T19:41:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 -- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 msgr2=0x7f0bf813bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf813bf90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0bf0009e60 tx=0x7f0bf0009780).stop 2023-10-18T19:41:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 -- 172.21.15.88:0/589375687 shutdown_connections 2023-10-18T19:41:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf813bf90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/589375687 >> v2:172.21.15.88:3300/0 conn(0x7f0bf80af970 0x7f0bf8135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/589375687 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80a1790 0x7f0bf8136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 -- 172.21.15.88:0/589375687 >> 172.21.15.88:0/589375687 conn(0x7f0bf805eb60 msgr2=0x7f0bf80af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 -- 172.21.15.88:0/589375687 shutdown_connections 2023-10-18T19:41:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.619+0000 7f0bff5ff700 1 -- 172.21.15.88:0/589375687 wait complete. 2023-10-18T19:41:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 Processor -- start 2023-10-18T19:41:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 -- start start 2023-10-18T19:41:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 0x7f0bf80ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf80aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.621+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80a89d0 con 0x7f0bf80a1790 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80a9db0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bff5ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80aa610 con 0x7f0bf80af970 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfdb9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfd39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 0x7f0bf80ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf80aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfd39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 0x7f0bf80ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40122/0 (socket says 172.21.15.88:40122) 2023-10-18T19:41:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfd39b700 1 -- 172.21.15.88:0/2820721574 learned_addr learned my addr 172.21.15.88:0/2820721574 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfdb9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52940/0 (socket says 172.21.15.88:52940) 2023-10-18T19:41:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 -- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 msgr2=0x7f0bf80a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 -- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 msgr2=0x7f0bf80ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 0x7f0bf80ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 -- 172.21.15.88:0/2820721574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be80092a0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfdb9c700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.622+0000 7f0bfcb9a700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf80aba50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f0be800e950 tx=0x7f0be8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.623+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8012600 con 0x7f0bf80a4c50 2023-10-18T19:41:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.623+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8012760 con 0x7f0bf80a4c50 2023-10-18T19:41:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.623+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf4009370 con 0x7f0bf80a4c50 2023-10-18T19:41:31.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.623+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8012ae0 con 0x7f0bf80a4c50 2023-10-18T19:41:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.623+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf0009a20 con 0x7f0bf80a4c50 2023-10-18T19:41:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.624+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf80a9290 con 0x7f0bf80a4c50 2023-10-18T19:41:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.624+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f0be801b400 con 0x7f0bf80a4c50 2023-10-18T19:41:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.625+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0be8055d20 con 0x7f0bf80a4c50 2023-10-18T19:41:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.628+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0bf80a9290 con 0x7f0bf80a4c50 2023-10-18T19:41:31.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.800+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0bf80a9290 con 0x7f0bf80a4c50 2023-10-18T19:41:31.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.800+0000 7f0bed7fa700 1 -- 172.21.15.88:0/2820721574 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0bf80a9290 con 0x7f0bf80a4c50 2023-10-18T19:41:31.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 >> v1:172.21.15.88:6800/113625 conn(0x7f0bdc041bf0 legacy=0x7f0bdc0440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 msgr2=0x7f0bf80aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf80aba50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f0be800e950 tx=0x7f0be8009060).stop 2023-10-18T19:41:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 shutdown_connections 2023-10-18T19:41:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0bf80af970 0x7f0bf80a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0bf80a1790 0x7f0bf80ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 --2- 172.21.15.88:0/2820721574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0bf80a4c50 0x7f0bf80aba50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 >> 172.21.15.88:0/2820721574 conn(0x7f0bf805eb60 msgr2=0x7f0bf80af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:31.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 shutdown_connections 2023-10-18T19:41:31.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:31.802+0000 7f0bff5ff700 1 -- 172.21.15.88:0/2820721574 wait complete. 2023-10-18T19:41:31.822 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:34.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:35.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.016+0000 7f54733ff700 1 Processor -- start 2023-10-18T19:41:35.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.016+0000 7f54733ff700 1 -- start start 2023-10-18T19:41:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f546c05e250 0x7f546c0a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 0x7f546c13c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0a7260 con 0x7f546c05e250 2023-10-18T19:41:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c05e630 con 0x7f546c0a8b70 2023-10-18T19:41:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f54733ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0a1a70 con 0x7f546c0a6aa0 2023-10-18T19:41:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547119b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f546c05e250 0x7f546c0a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547099a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547119b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f546c05e250 0x7f546c0a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40124/0 (socket says 172.21.15.88:40124) 2023-10-18T19:41:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547099a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:52942/0 (socket says 172.21.15.88:52942) 2023-10-18T19:41:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547119b700 1 -- 172.21.15.88:0/2318635767 learned_addr learned my addr 172.21.15.88:0/2318635767 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.017+0000 7f547199c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 0x7f546c13c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 -- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 msgr2=0x7f546c0a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 -- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 msgr2=0x7f546c13c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 0x7f546c13c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 -- 172.21.15.88:0/2318635767 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0a8060 con 0x7f546c05e250 2023-10-18T19:41:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547099a700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547199c700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 0x7f546c13c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f547119b700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c05e250 0x7f546c0a1580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f5468006fd0 tx=0x7f54680090f0).ready entity=mon.0 client_cookie=1531be8894e14459 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f5463fff700 1 -- 172.21.15.88:0/2318635767 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546800f510 con 0x7f546c05e250 2023-10-18T19:41:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f5463fff700 1 -- 172.21.15.88:0/2318635767 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546800f670 con 0x7f546c05e250 2023-10-18T19:41:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.018+0000 7f5463fff700 1 -- 172.21.15.88:0/2318635767 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546800f9f0 con 0x7f546c05e250 2023-10-18T19:41:35.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 -- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c05e250 msgr2=0x7f546c0a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:35.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c05e250 0x7f546c0a1580 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f5468006fd0 tx=0x7f54680090f0).stop 2023-10-18T19:41:35.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 -- 172.21.15.88:0/2318635767 shutdown_connections 2023-10-18T19:41:35.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c0a8b70 0x7f546c13c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c05e250 0x7f546c0a1580 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 --2- 172.21.15.88:0/2318635767 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c0a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 -- 172.21.15.88:0/2318635767 >> 172.21.15.88:0/2318635767 conn(0x7f546c0665a0 msgr2=0x7f546c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 -- 172.21.15.88:0/2318635767 shutdown_connections 2023-10-18T19:41:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.019+0000 7f54733ff700 1 -- 172.21.15.88:0/2318635767 wait complete. 2023-10-18T19:41:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.020+0000 7f54733ff700 1 Processor -- start 2023-10-18T19:41:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.020+0000 7f54733ff700 1 -- start start 2023-10-18T19:41:35.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0a8b70 0x7f546c13bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0a2e40 con 0x7f546c0a8b70 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0a4840 con 0x7f546c05e250 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f54733ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0a34f0 con 0x7f546c0a6aa0 2023-10-18T19:41:35.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f547119b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f547099a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f547119b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36762/0 (socket says 172.21.15.88:36762) 2023-10-18T19:41:35.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f547119b700 1 -- 172.21.15.88:0/2670033127 learned_addr learned my addr 172.21.15.88:0/2670033127 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:35.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.021+0000 7f547199c700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0a8b70 0x7f546c13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:35.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 -- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 msgr2=0x7f546c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 -- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0a8b70 msgr2=0x7f546c13bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0a8b70 0x7f546c13bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 -- 172.21.15.88:0/2670033127 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c0092a0 con 0x7f546c0a6aa0 2023-10-18T19:41:35.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547119b700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f547099a700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c14bb00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f545c00e950 tx=0x7f545c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00c670 con 0x7f546c0a6aa0 2023-10-18T19:41:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00c7d0 con 0x7f546c0a6aa0 2023-10-18T19:41:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5464009a20 con 0x7f546c0a6aa0 2023-10-18T19:41:35.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00cb70 con 0x7f546c0a6aa0 2023-10-18T19:41:35.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.022+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5468009370 con 0x7f546c0a6aa0 2023-10-18T19:41:35.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.023+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c05f270 con 0x7f546c0a6aa0 2023-10-18T19:41:35.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.024+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f545c01b400 con 0x7f546c0a6aa0 2023-10-18T19:41:35.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.024+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f545c055d60 con 0x7f546c0a6aa0 2023-10-18T19:41:35.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.028+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f545c05b020 con 0x7f546c0a6aa0 2023-10-18T19:41:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.199+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f546c0a0de0 con 0x7f546c0a6aa0 2023-10-18T19:41:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.199+0000 7f54617fa700 1 -- 172.21.15.88:0/2670033127 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f545c016080 con 0x7f546c0a6aa0 2023-10-18T19:41:35.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:35.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 >> v1:172.21.15.88:6800/113625 conn(0x7f5450041bc0 legacy=0x7f5450044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 msgr2=0x7f546c14bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c14bb00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f545c00e950 tx=0x7f545c009060).stop 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 shutdown_connections 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0a8b70 0x7f546c13bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f546c05e250 0x7f546c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 --2- 172.21.15.88:0/2670033127 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f546c0a6aa0 0x7f546c14bb00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 >> 172.21.15.88:0/2670033127 conn(0x7f546c0665a0 msgr2=0x7f546c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 shutdown_connections 2023-10-18T19:41:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:35.201+0000 7f54733ff700 1 -- 172.21.15.88:0/2670033127 wait complete. 2023-10-18T19:41:35.220 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:38.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:38.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.414+0000 7f0d3c1ff700 1 Processor -- start 2023-10-18T19:41:38.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.414+0000 7f0d3c1ff700 1 -- start start 2023-10-18T19:41:38.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3c1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 0x7f0d34135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:38.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3c1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:38.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3c1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340afd50 con 0x7f0d340a4c50 2023-10-18T19:41:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3c1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340a47a0 con 0x7f0d340a1790 2023-10-18T19:41:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3c1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340a3a10 con 0x7f0d340af970 2023-10-18T19:41:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:33164/0 (socket says 172.21.15.88:33164) 2023-10-18T19:41:38.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 -- 172.21.15.88:0/101550692 learned_addr learned my addr 172.21.15.88:0/101550692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d39f9b700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 0x7f0d34135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3a79c700 1 --1- 172.21.15.88:0/101550692 >> v1:172.21.15.88:6789/0 conn(0x7f0d340a4c50 0x7f0d3413bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53046/0 (socket says 172.21.15.88:53046) 2023-10-18T19:41:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 -- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 msgr2=0x7f0d34135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 0x7f0d34135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 -- 172.21.15.88:0/101550692 >> v1:172.21.15.88:6789/0 conn(0x7f0d340a4c50 legacy=0x7f0d3413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d3979a700 1 -- 172.21.15.88:0/101550692 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340a32d0 con 0x7f0d340a1790 2023-10-18T19:41:38.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d39f9b700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 0x7f0d34135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:38.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.415+0000 7f0d38f99700 1 -- 172.21.15.88:0/101550692 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101602298 0 0) 0x7f0d340afd50 con 0x7f0d340a4c50 2023-10-18T19:41:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3979a700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0d24009830 tx=0x7f0d240090f0).ready entity=mon.1 client_cookie=d6b641add44e7307 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d38f99700 1 -- 172.21.15.88:0/101550692 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400b580 con 0x7f0d340a1790 2023-10-18T19:41:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d38f99700 1 -- 172.21.15.88:0/101550692 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400b6e0 con 0x7f0d340a1790 2023-10-18T19:41:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d38f99700 1 -- 172.21.15.88:0/101550692 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400ba60 con 0x7f0d340a1790 2023-10-18T19:41:38.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 msgr2=0x7f0d34136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0d24009830 tx=0x7f0d240090f0).stop 2023-10-18T19:41:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/101550692 shutdown_connections 2023-10-18T19:41:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340af970 0x7f0d34135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/101550692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340a1790 0x7f0d34136220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/101550692 >> 172.21.15.88:0/101550692 conn(0x7f0d3405eb60 msgr2=0x7f0d340af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:38.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.416+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/101550692 shutdown_connections 2023-10-18T19:41:38.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.417+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/101550692 wait complete. 2023-10-18T19:41:38.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.418+0000 7f0d3c1ff700 1 Processor -- start 2023-10-18T19:41:38.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.418+0000 7f0d3c1ff700 1 -- start start 2023-10-18T19:41:38.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 0x7f0d3409e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:38.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:38.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 0x7f0d340a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:38.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ab8b0 con 0x7f0d340a1790 2023-10-18T19:41:38.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ac500 con 0x7f0d340af970 2023-10-18T19:41:38.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3c1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ac7c0 con 0x7f0d340a4c50 2023-10-18T19:41:38.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d39f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 0x7f0d3409e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:38.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:38.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60054/0 (socket says 172.21.15.88:60054) 2023-10-18T19:41:38.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 -- 172.21.15.88:0/1223554531 learned_addr learned my addr 172.21.15.88:0/1223554531 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:38.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3a79c700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 0x7f0d340a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:38.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 -- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 msgr2=0x7f0d340a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 0x7f0d340a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 -- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 msgr2=0x7f0d3409e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 0x7f0d3409e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3979a700 1 -- 172.21.15.88:0/1223554531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300092a0 con 0x7f0d340a4c50 2023-10-18T19:41:38.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d3a79c700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 0x7f0d340a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:38.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.419+0000 7f0d39f9b700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 0x7f0d3409e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:38.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d3979a700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0d24008000 tx=0x7f0d24017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:38.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24000bc0 con 0x7f0d340a4c50 2023-10-18T19:41:38.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400b850 con 0x7f0d340a4c50 2023-10-18T19:41:38.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24000d20 con 0x7f0d340a4c50 2023-10-18T19:41:38.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d24009370 con 0x7f0d340a4c50 2023-10-18T19:41:38.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.420+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340a8560 con 0x7f0d340a4c50 2023-10-18T19:41:38.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.421+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3405f270 con 0x7f0d340a4c50 2023-10-18T19:41:38.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.421+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f0d2401bb00 con 0x7f0d340a4c50 2023-10-18T19:41:38.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.422+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0d240572b0 con 0x7f0d340a4c50 2023-10-18T19:41:38.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.425+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0d24025be0 con 0x7f0d340a4c50 2023-10-18T19:41:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.595+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d340a3010 con 0x7f0d340a4c50 2023-10-18T19:41:38.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.595+0000 7f0d29ffb700 1 -- 172.21.15.88:0/1223554531 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0d2403ae50 con 0x7f0d340a4c50 2023-10-18T19:41:38.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 >> v1:172.21.15.88:6800/113625 conn(0x7f0d18041bc0 legacy=0x7f0d18044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 msgr2=0x7f0d340a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f0d24008000 tx=0x7f0d24017000).stop 2023-10-18T19:41:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 shutdown_connections 2023-10-18T19:41:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0d340af970 0x7f0d340a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d340a1790 0x7f0d3409e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 --2- 172.21.15.88:0/1223554531 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0d340a4c50 0x7f0d340a9fc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:38.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 >> 172.21.15.88:0/1223554531 conn(0x7f0d3405eb60 msgr2=0x7f0d340627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:38.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 shutdown_connections 2023-10-18T19:41:38.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:38.597+0000 7f0d3c1ff700 1 -- 172.21.15.88:0/1223554531 wait complete. 2023-10-18T19:41:38.616 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:41.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.811+0000 7f6ab97ff700 1 Processor -- start 2023-10-18T19:41:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.811+0000 7f6ab97ff700 1 -- start start 2023-10-18T19:41:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab97ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40ab960 0x7f6ab40a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab97ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 0x7f6ab4143820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab97ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab40a68e0 con 0x7f6ab40a75e0 2023-10-18T19:41:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab97ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40abd40 con 0x7f6ab40ab960 2023-10-18T19:41:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab97ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40a6e70 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab2ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40ab960 0x7f6ab40a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab37fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 0x7f6ab4143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab27fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ab40a75e0 0x7f6ab40a04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53050/0 (socket says 172.21.15.88:53050) 2023-10-18T19:41:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.812+0000 7f6ab27fc700 1 -- 172.21.15.88:0/185429961 learned_addr learned my addr 172.21.15.88:0/185429961 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:41:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab37fe700 1 -- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40ab960 msgr2=0x7f6ab40a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab37fe700 1 --2- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40ab960 0x7f6ab40a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab37fe700 1 -- 172.21.15.88:0/185429961 >> v1:172.21.15.88:6789/0 conn(0x7f6ab40a75e0 legacy=0x7f6ab40a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab1ffb700 1 -- 172.21.15.88:0/185429961 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718730418 0 0) 0x7f6ab40a68e0 con 0x7f6ab40a75e0 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab37fe700 1 -- 172.21.15.88:0/185429961 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40a24d0 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab37fe700 1 --2- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 0x7f6ab4143820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6aac009e90 tx=0x7f6aac009780).ready entity=mon.2 client_cookie=cdaa666725abb239 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab1ffb700 1 -- 172.21.15.88:0/185429961 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00e070 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab1ffb700 1 -- 172.21.15.88:0/185429961 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00bb60 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab1ffb700 1 -- 172.21.15.88:0/185429961 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac012410 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab97ff700 1 -- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 msgr2=0x7f6ab4143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.813+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 0x7f6ab4143820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6aac009e90 tx=0x7f6aac009780).stop 2023-10-18T19:41:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 -- 172.21.15.88:0/185429961 shutdown_connections 2023-10-18T19:41:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a0bd0 0x7f6ab4143820 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/185429961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40ab960 0x7f6ab40a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 -- 172.21.15.88:0/185429961 >> 172.21.15.88:0/185429961 conn(0x7f6ab405eb60 msgr2=0x7f6ab40ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 -- 172.21.15.88:0/185429961 shutdown_connections 2023-10-18T19:41:41.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.814+0000 7f6ab97ff700 1 -- 172.21.15.88:0/185429961 wait complete. 2023-10-18T19:41:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.815+0000 7f6ab97ff700 1 Processor -- start 2023-10-18T19:41:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.815+0000 7f6ab97ff700 1 -- start start 2023-10-18T19:41:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 0x7f6ab41479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab41193c0 con 0x7f6ab40ab960 2023-10-18T19:41:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4148910 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab97ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab4148bd0 con 0x7f6ab40a75e0 2023-10-18T19:41:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab27fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:33174/0 (socket says 172.21.15.88:33174) 2023-10-18T19:41:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 -- 172.21.15.88:0/2425458655 learned_addr learned my addr 172.21.15.88:0/2425458655 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab27fc700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60062/0 (socket says 172.21.15.88:60062) 2023-10-18T19:41:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab37fe700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 0x7f6ab41479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 -- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 msgr2=0x7f6ab4119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.816+0000 7f6ab2ffd700 1 -- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 msgr2=0x7f6ab41479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab2ffd700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 0x7f6ab41479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab2ffd700 1 -- 172.21.15.88:0/2425458655 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac009a20 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab27fc700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab37fe700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 0x7f6ab41479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab2ffd700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6aa400e8d0 tx=0x7f6aa4006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4012600 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4012760 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4012ae0 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab41195a0 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.817+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab4117b00 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.818+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f6aa401b400 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.818+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab405f270 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.819+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f6aa4055b90 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.822+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6aa4035f10 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.993+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6ab40a6b40 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.993+0000 7f6a9affd700 1 -- 172.21.15.88:0/2425458655 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6aa4016020 con 0x7f6ab40a0bd0 2023-10-18T19:41:41.997 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 >> v1:172.21.15.88:6800/113625 conn(0x7f6aa0041bc0 legacy=0x7f6aa0044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 msgr2=0x7f6ab4118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:41.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f6aa400e8d0 tx=0x7f6aa4006f40).stop 2023-10-18T19:41:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 shutdown_connections 2023-10-18T19:41:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ab40ab960 0x7f6ab41479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6ab40a0bd0 0x7f6ab4118cd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 --2- 172.21.15.88:0/2425458655 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f6ab40a75e0 0x7f6ab4119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:41.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.995+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 >> 172.21.15.88:0/2425458655 conn(0x7f6ab405eb60 msgr2=0x7f6ab40a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:42.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.996+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 shutdown_connections 2023-10-18T19:41:42.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:41.996+0000 7f6ab97ff700 1 -- 172.21.15.88:0/2425458655 wait complete. 2023-10-18T19:41:42.015 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:45.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:45.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.210+0000 7f9b787ff700 1 Processor -- start 2023-10-18T19:41:45.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.210+0000 7f9b787ff700 1 -- start start 2023-10-18T19:41:45.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b787ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:45.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b787ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b700a4a20 0x7f9b70135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:45.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b787ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7005ed40 con 0x7f9b701361c0 2023-10-18T19:41:45.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b787ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b700a3a70 con 0x7f9b700a4a20 2023-10-18T19:41:45.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b787ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b70136670 con 0x7f9b7005e960 2023-10-18T19:41:45.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b75d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b700a4a20 0x7f9b70135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:45.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b7659b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:45.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b75d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b700a4a20 0x7f9b70135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42168/0 (socket says 172.21.15.88:42168) 2023-10-18T19:41:45.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b7659b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:33188/0 (socket says 172.21.15.88:33188) 2023-10-18T19:41:45.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.211+0000 7f9b75d9a700 1 -- 172.21.15.88:0/1975676143 learned_addr learned my addr 172.21.15.88:0/1975676143 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:45.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75d9a700 1 -- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 msgr2=0x7f9b700a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:45.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75d9a700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75d9a700 1 -- 172.21.15.88:0/1975676143 >> v1:172.21.15.88:6789/0 conn(0x7f9b701361c0 legacy=0x7f9b70138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75d9a700 1 -- 172.21.15.88:0/1975676143 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700a2ac0 con 0x7f9b700a4a20 2023-10-18T19:41:45.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b7659b700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:45.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75d9a700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b700a4a20 0x7f9b70135cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f9b60006fd0 tx=0x7f9b600090f0).ready entity=mon.0 client_cookie=7fbba6b8f290a7be server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:45.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75599700 1 -- 172.21.15.88:0/1975676143 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000b610 con 0x7f9b700a4a20 2023-10-18T19:41:45.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75599700 1 -- 172.21.15.88:0/1975676143 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6000b770 con 0x7f9b700a4a20 2023-10-18T19:41:45.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.212+0000 7f9b75599700 1 -- 172.21.15.88:0/1975676143 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000baf0 con 0x7f9b700a4a20 2023-10-18T19:41:45.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 -- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b700a4a20 msgr2=0x7f9b70135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b700a4a20 0x7f9b70135cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f9b60006fd0 tx=0x7f9b600090f0).stop 2023-10-18T19:41:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 -- 172.21.15.88:0/1975676143 shutdown_connections 2023-10-18T19:41:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 --2- 172.21.15.88:0/1975676143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b700a4a20 0x7f9b70135cd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 -- 172.21.15.88:0/1975676143 >> 172.21.15.88:0/1975676143 conn(0x7f9b70064bb0 msgr2=0x7f9b7005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 -- 172.21.15.88:0/1975676143 shutdown_connections 2023-10-18T19:41:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.213+0000 7f9b787ff700 1 -- 172.21.15.88:0/1975676143 wait complete. 2023-10-18T19:41:45.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.214+0000 7f9b787ff700 1 Processor -- start 2023-10-18T19:41:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.214+0000 7f9b787ff700 1 -- start start 2023-10-18T19:41:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 0x7f9b701492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b701361c0 0x7f9b7014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:45.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700a75f0 con 0x7f9b701361c0 2023-10-18T19:41:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700a60f0 con 0x7f9b7005e960 2023-10-18T19:41:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b787ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700a77d0 con 0x7f9b700a4a20 2023-10-18T19:41:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b7659b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b75d9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 0x7f9b701492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b7659b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:33200/0 (socket says 172.21.15.88:33200) 2023-10-18T19:41:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b7659b700 1 -- 172.21.15.88:0/682340552 learned_addr learned my addr 172.21.15.88:0/682340552 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b75d9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 0x7f9b701492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:60064/0 (socket says 172.21.15.88:60064) 2023-10-18T19:41:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.215+0000 7f9b76d9c700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b701361c0 0x7f9b7014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 -- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 msgr2=0x7f9b701492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 0x7f9b701492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 -- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b701361c0 msgr2=0x7f9b7014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b701361c0 0x7f9b7014bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 -- 172.21.15.88:0/682340552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0092a0 con 0x7f9b7005e960 2023-10-18T19:41:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b7659b700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9b6c00ea20 tx=0x7f9b6c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:45.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00ee60 con 0x7f9b7005e960 2023-10-18T19:41:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00c850 con 0x7f9b7005e960 2023-10-18T19:41:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00cbd0 con 0x7f9b7005e960 2023-10-18T19:41:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b60009370 con 0x7f9b7005e960 2023-10-18T19:41:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.216+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b701497b0 con 0x7f9b7005e960 2023-10-18T19:41:45.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.217+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f9b6c01b400 con 0x7f9b7005e960 2023-10-18T19:41:45.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.217+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b700ac9a0 con 0x7f9b7005e960 2023-10-18T19:41:45.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.218+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f9b6c055e10 con 0x7f9b7005e960 2023-10-18T19:41:45.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.221+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f9b6c036090 con 0x7f9b7005e960 2023-10-18T19:41:45.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.387+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9b7005f270 con 0x7f9b7005e960 2023-10-18T19:41:45.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.387+0000 7f9b667fc700 1 -- 172.21.15.88:0/682340552 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9b6c054a50 con 0x7f9b7005e960 2023-10-18T19:41:45.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 >> v1:172.21.15.88:6800/113625 conn(0x7f9b54041bc0 legacy=0x7f9b54044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 msgr2=0x7f9b700a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9b6c00ea20 tx=0x7f9b6c009060).stop 2023-10-18T19:41:45.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 shutdown_connections 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b701361c0 0x7f9b7014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b7005e960 0x7f9b700a8190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 --2- 172.21.15.88:0/682340552 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f9b700a4a20 0x7f9b701492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 >> 172.21.15.88:0/682340552 conn(0x7f9b70064bb0 msgr2=0x7f9b70135210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 shutdown_connections 2023-10-18T19:41:45.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:45.389+0000 7f9b787ff700 1 -- 172.21.15.88:0/682340552 wait complete. 2023-10-18T19:41:45.409 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:48.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.608+0000 7fe0161ff700 1 Processor -- start 2023-10-18T19:41:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.608+0000 7fe0161ff700 1 -- start start 2023-10-18T19:41:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe0161ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe0161ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe0161ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0100afd50 con 0x7fe0100a1790 2023-10-18T19:41:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe0161ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0100a47a0 con 0x7fe0100a4c50 2023-10-18T19:41:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe0161ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100a3a10 con 0x7fe0100af970 2023-10-18T19:41:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:53472/0 (socket says 172.21.15.88:53472) 2023-10-18T19:41:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 -- 172.21.15.88:0/2230997726 learned_addr learned my addr 172.21.15.88:0/2230997726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40244/0 (socket says 172.21.15.88:40244) 2023-10-18T19:41:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 -- 172.21.15.88:0/2230997726 >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 msgr2=0x7fe010136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 --2- 172.21.15.88:0/2230997726 >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 -- 172.21.15.88:0/2230997726 >> v1:172.21.15.88:6789/0 conn(0x7fe0100a1790 legacy=0x7fe01013bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00f7fe700 1 -- 172.21.15.88:0/2230997726 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100a32d0 con 0x7fe0100af970 2023-10-18T19:41:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.609+0000 7fe00ffff700 1 --2- 172.21.15.88:0/2230997726 >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe00f7fe700 1 --2- 172.21.15.88:0/2230997726 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe000006fd0 tx=0x7fe0000090f0).ready entity=mon.2 client_cookie=b0352305a04ab206 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe00e7fc700 1 -- 172.21.15.88:0/2230997726 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000b580 con 0x7fe0100af970 2023-10-18T19:41:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe00e7fc700 1 -- 172.21.15.88:0/2230997726 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000b6e0 con 0x7fe0100af970 2023-10-18T19:41:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe00e7fc700 1 -- 172.21.15.88:0/2230997726 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000ba60 con 0x7fe0100af970 2023-10-18T19:41:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 -- 172.21.15.88:0/2230997726 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 msgr2=0x7fe010135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 --2- 172.21.15.88:0/2230997726 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe000006fd0 tx=0x7fe0000090f0).stop 2023-10-18T19:41:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 -- 172.21.15.88:0/2230997726 shutdown_connections 2023-10-18T19:41:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 --2- 172.21.15.88:0/2230997726 >> v2:172.21.15.88:3300/0 conn(0x7fe0100a4c50 0x7fe010136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 --2- 172.21.15.88:0/2230997726 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100af970 0x7fe010135d30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.610+0000 7fe0161ff700 1 -- 172.21.15.88:0/2230997726 >> 172.21.15.88:0/2230997726 conn(0x7fe01005eb60 msgr2=0x7fe0100af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.611+0000 7fe0161ff700 1 -- 172.21.15.88:0/2230997726 shutdown_connections 2023-10-18T19:41:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.611+0000 7fe0161ff700 1 -- 172.21.15.88:0/2230997726 wait complete. 2023-10-18T19:41:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.612+0000 7fe0161ff700 1 Processor -- start 2023-10-18T19:41:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.612+0000 7fe0161ff700 1 -- start start 2023-10-18T19:41:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100a4c50 0x7fe01014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0100af970 0x7fe01014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100a9920 con 0x7fe0100a1790 2023-10-18T19:41:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100a9b20 con 0x7fe0100af970 2023-10-18T19:41:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe0161ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100a69b0 con 0x7fe0100a4c50 2023-10-18T19:41:48.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40256/0 (socket says 172.21.15.88:40256) 2023-10-18T19:41:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00effd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100a4c50 0x7fe01014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0100af970 0x7fe01014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:48.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 -- 172.21.15.88:0/1080941475 learned_addr learned my addr 172.21.15.88:0/1080941475 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 -- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100a4c50 msgr2=0x7fe01014c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100a4c50 0x7fe01014c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 -- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0100af970 msgr2=0x7fe01014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0100af970 0x7fe01014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.613+0000 7fe00f7fe700 1 -- 172.21.15.88:0/1080941475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008009a20 con 0x7fe0100a1790 2023-10-18T19:41:48.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fe00f7fe700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe0100a3b50 tx=0x7fe000017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000000bc0 con 0x7fe0100a1790 2023-10-18T19:41:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000b850 con 0x7fe0100a1790 2023-10-18T19:41:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000000d20 con 0x7fe0100a1790 2023-10-18T19:41:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000009370 con 0x7fe0100a1790 2023-10-18T19:41:48.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.614+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100aa510 con 0x7fe0100a1790 2023-10-18T19:41:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.615+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe010064630 con 0x7fe0100a1790 2023-10-18T19:41:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.615+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fe00001ca90 con 0x7fe0100a1790 2023-10-18T19:41:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.616+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fe0000572f0 con 0x7fe0100a1790 2023-10-18T19:41:48.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.619+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe000026b50 con 0x7fe0100a1790 2023-10-18T19:41:48.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.791+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe01005f270 con 0x7fe0100a1790 2023-10-18T19:41:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.791+0000 7fdff77fe700 1 -- 172.21.15.88:0/1080941475 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe000055f30 con 0x7fe0100a1790 2023-10-18T19:41:48.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:48.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 >> v1:172.21.15.88:6800/113625 conn(0x7fdffc041bc0 legacy=0x7fdffc044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 msgr2=0x7fe0100aa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe0100a3b50 tx=0x7fe000017000).stop 2023-10-18T19:41:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 shutdown_connections 2023-10-18T19:41:48.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe0100af970 0x7fe01014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0100a1790 0x7fe0100aa020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 --2- 172.21.15.88:0/1080941475 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe0100a4c50 0x7fe01014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 >> 172.21.15.88:0/1080941475 conn(0x7fe01005eb60 msgr2=0x7fe010138260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 shutdown_connections 2023-10-18T19:41:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:48.793+0000 7fe0161ff700 1 -- 172.21.15.88:0/1080941475 wait complete. 2023-10-18T19:41:48.811 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:51.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:52.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.007+0000 7f70463ff700 1 Processor -- start 2023-10-18T19:41:52.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.008+0000 7f70463ff700 1 -- start start 2023-10-18T19:41:52.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f70463ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f70463ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f70463ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704005ed40 con 0x7f70400a4a20 2023-10-18T19:41:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f70463ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400a3a70 con 0x7f704005e960 2023-10-18T19:41:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f70463ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a2ac0 con 0x7f70401363e0 2023-10-18T19:41:52.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f703ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f703ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40270/0 (socket says 172.21.15.88:40270) 2023-10-18T19:41:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:49118/0 (socket says 172.21.15.88:49118) 2023-10-18T19:41:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f703ffff700 1 -- 172.21.15.88:0/3727135709 learned_addr learned my addr 172.21.15.88:0/3727135709 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:52.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 -- 172.21.15.88:0/3727135709 >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 msgr2=0x7f70400a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:52.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 --2- 172.21.15.88:0/3727135709 >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 -- 172.21.15.88:0/3727135709 >> v1:172.21.15.88:6789/0 conn(0x7f70400a4a20 legacy=0x7f7040135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 -- 172.21.15.88:0/3727135709 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400a2d60 con 0x7f70401363e0 2023-10-18T19:41:52.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f703ffff700 1 --2- 172.21.15.88:0/3727135709 >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.009+0000 7f704499c700 1 --2- 172.21.15.88:0/3727135709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7038009e90 tx=0x7f7038009780).ready entity=mon.1 client_cookie=376229d0bdc6c586 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f703effd700 1 -- 172.21.15.88:0/3727135709 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800e070 con 0x7f70401363e0 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f703effd700 1 -- 172.21.15.88:0/3727135709 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800bbb0 con 0x7f70401363e0 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f703effd700 1 -- 172.21.15.88:0/3727135709 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038012410 con 0x7f70401363e0 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 -- 172.21.15.88:0/3727135709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 msgr2=0x7f70401433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 --2- 172.21.15.88:0/3727135709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7038009e90 tx=0x7f7038009780).stop 2023-10-18T19:41:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 -- 172.21.15.88:0/3727135709 shutdown_connections 2023-10-18T19:41:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 --2- 172.21.15.88:0/3727135709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f70401433f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 --2- 172.21.15.88:0/3727135709 >> v2:172.21.15.88:3300/0 conn(0x7f704005e960 0x7f70400a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 -- 172.21.15.88:0/3727135709 >> 172.21.15.88:0/3727135709 conn(0x7f7040064bb0 msgr2=0x7f704005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 -- 172.21.15.88:0/3727135709 shutdown_connections 2023-10-18T19:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.010+0000 7f70463ff700 1 -- 172.21.15.88:0/3727135709 wait complete. 2023-10-18T19:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.012+0000 7f70463ff700 1 Processor -- start 2023-10-18T19:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.012+0000 7f70463ff700 1 -- start start 2023-10-18T19:41:52.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f70400a4a20 0x7f70400a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f7040138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040148790 con 0x7f704005e960 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040148a50 con 0x7f70401363e0 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f70463ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70400a8910 con 0x7f70400a4a20 2023-10-18T19:41:52.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40284/0 (socket says 172.21.15.88:40284) 2023-10-18T19:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 -- 172.21.15.88:0/2617172739 learned_addr learned my addr 172.21.15.88:0/2617172739 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f704499c700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f7040138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703f7fe700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f70400a4a20 0x7f70400a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:52.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 -- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f70400a4a20 msgr2=0x7f70400a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f70400a4a20 0x7f70400a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 -- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 msgr2=0x7f7040138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f7040138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 -- 172.21.15.88:0/2617172739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009370 con 0x7f704005e960 2023-10-18T19:41:52.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f704499c700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f7040138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.013+0000 7f703ffff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f703000ea20 tx=0x7f70300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.014+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000ee60 con 0x7f704005e960 2023-10-18T19:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.014+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000c850 con 0x7f704005e960 2023-10-18T19:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.014+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7038009a20 con 0x7f704005e960 2023-10-18T19:41:52.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.014+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000cbd0 con 0x7f704005e960 2023-10-18T19:41:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.014+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040139000 con 0x7f704005e960 2023-10-18T19:41:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.015+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704005f270 con 0x7f704005e960 2023-10-18T19:41:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.015+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f703001b400 con 0x7f704005e960 2023-10-18T19:41:52.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.016+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f7030055d30 con 0x7f704005e960 2023-10-18T19:41:52.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.019+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f703005a070 con 0x7f704005e960 2023-10-18T19:41:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.192+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f70400a1100 con 0x7f704005e960 2023-10-18T19:41:52.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.192+0000 7f7027fff700 1 -- 172.21.15.88:0/2617172739 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f70300160b0 con 0x7f704005e960 2023-10-18T19:41:52.194 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 >> v1:172.21.15.88:6800/113625 conn(0x7f702c041bc0 legacy=0x7f702c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 msgr2=0x7f70400a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f703000ea20 tx=0x7f70300090f0).stop 2023-10-18T19:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 shutdown_connections 2023-10-18T19:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f70401363e0 0x7f7040138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f704005e960 0x7f70400a8420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 --2- 172.21.15.88:0/2617172739 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f70400a4a20 0x7f70400a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 >> 172.21.15.88:0/2617172739 conn(0x7f7040064bb0 msgr2=0x7f7040135aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 shutdown_connections 2023-10-18T19:41:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:52.194+0000 7f70463ff700 1 -- 172.21.15.88:0/2617172739 wait complete. 2023-10-18T19:41:52.212 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:55.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.406+0000 7ff8ac1ff700 1 Processor -- start 2023-10-18T19:41:55.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.406+0000 7ff8ac1ff700 1 -- start start 2023-10-18T19:41:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8ac1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 0x7ff8a409da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8ac1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 0x7ff8a41371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:55.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8ac1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a409def0 con 0x7ff8a4068b80 2023-10-18T19:41:55.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8ac1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4063280 con 0x7ff8a4062ea0 2023-10-18T19:41:55.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8ac1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a409f430 con 0x7ff8a4136db0 2023-10-18T19:41:55.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8a9f9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 0x7ff8a409da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:55.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8aa79c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8a4068b80 0x7ff8a4069030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35680/0 (socket says 172.21.15.88:35680) 2023-10-18T19:41:55.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8a979a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 0x7ff8a41371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:55.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.407+0000 7ff8aa79c700 1 -- 172.21.15.88:0/1366566442 learned_addr learned my addr 172.21.15.88:0/1366566442 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:41:55.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a9f9b700 1 -- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 msgr2=0x7ff8a41371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:55.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a9f9b700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 0x7ff8a41371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a8f99700 1 -- 172.21.15.88:0/1366566442 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941821152 0 0) 0x7ff89c001490 con 0x7ff8a4068b80 2023-10-18T19:41:55.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a9f9b700 1 -- 172.21.15.88:0/1366566442 >> v1:172.21.15.88:6789/0 conn(0x7ff8a4068b80 legacy=0x7ff8a4069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a9f9b700 1 -- 172.21.15.88:0/1366566442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a41368f0 con 0x7ff8a4062ea0 2023-10-18T19:41:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a979a700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 0x7ff8a41371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T19:41:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a9f9b700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 0x7ff8a409da00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff8a0009790 tx=0x7ff8a0009060).ready entity=mon.1 client_cookie=8c6f611d16e644fa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a8f99700 1 -- 172.21.15.88:0/1366566442 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000b5a0 con 0x7ff8a4062ea0 2023-10-18T19:41:55.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a8f99700 1 -- 172.21.15.88:0/1366566442 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a000b700 con 0x7ff8a4062ea0 2023-10-18T19:41:55.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.408+0000 7ff8a8f99700 1 -- 172.21.15.88:0/1366566442 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000ba80 con 0x7ff8a4062ea0 2023-10-18T19:41:55.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 msgr2=0x7ff8a409da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 0x7ff8a409da00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff8a0009790 tx=0x7ff8a0009060).stop 2023-10-18T19:41:55.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/1366566442 shutdown_connections 2023-10-18T19:41:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4062ea0 0x7ff8a409da00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/1366566442 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4136db0 0x7ff8a41371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/1366566442 >> 172.21.15.88:0/1366566442 conn(0x7ff8a4067ef0 msgr2=0x7ff8a40625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/1366566442 shutdown_connections 2023-10-18T19:41:55.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.409+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/1366566442 wait complete. 2023-10-18T19:41:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.410+0000 7ff8ac1ff700 1 Processor -- start 2023-10-18T19:41:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.410+0000 7ff8ac1ff700 1 -- start start 2023-10-18T19:41:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4062ea0 0x7ff8a40a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:55.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:55.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4136db0 0x7ff8a4134a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:55.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4093430 con 0x7ff8a4068b80 2023-10-18T19:41:55.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4065550 con 0x7ff8a4136db0 2023-10-18T19:41:55.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8ac1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4094010 con 0x7ff8a4062ea0 2023-10-18T19:41:55.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8aa79c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4136db0 0x7ff8a4134a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8a979a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8a9f9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4062ea0 0x7ff8a40a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8a979a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40336/0 (socket says 172.21.15.88:40336) 2023-10-18T19:41:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.411+0000 7ff8a979a700 1 -- 172.21.15.88:0/3968365007 learned_addr learned my addr 172.21.15.88:0/3968365007 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:55.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 -- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4062ea0 msgr2=0x7ff8a40a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4062ea0 0x7ff8a40a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 -- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4136db0 msgr2=0x7ff8a4134a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4136db0 0x7ff8a4134a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 -- 172.21.15.88:0/3968365007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a00092a0 con 0x7ff8a4068b80 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8a979a700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff89400d890 tx=0x7ff894008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:55.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894011590 con 0x7ff8a4068b80 2023-10-18T19:41:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8940116f0 con 0x7ff8a4068b80 2023-10-18T19:41:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a4091f70 con 0x7ff8a4068b80 2023-10-18T19:41:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894011a70 con 0x7ff8a4068b80 2023-10-18T19:41:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.412+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a4091c60 con 0x7ff8a4068b80 2023-10-18T19:41:55.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.414+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a405f270 con 0x7ff8a4068b80 2023-10-18T19:41:55.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.414+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7ff894012420 con 0x7ff8a4068b80 2023-10-18T19:41:55.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.415+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7ff8940552d0 con 0x7ff8a4068b80 2023-10-18T19:41:55.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.418+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7ff894035550 con 0x7ff8a4068b80 2023-10-18T19:41:55.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.600+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8a409ee90 con 0x7ff8a4068b80 2023-10-18T19:41:55.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.600+0000 7ff899ffb700 1 -- 172.21.15.88:0/3968365007 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff894053f10 con 0x7ff8a4068b80 2023-10-18T19:41:55.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:55.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 >> v1:172.21.15.88:6800/113625 conn(0x7ff888041bc0 legacy=0x7ff888044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 msgr2=0x7ff8a4093b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:55.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff89400d890 tx=0x7ff894008040).stop 2023-10-18T19:41:55.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 shutdown_connections 2023-10-18T19:41:55.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff8a4136db0 0x7ff8a4134a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7ff8a4062ea0 0x7ff8a40a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 --2- 172.21.15.88:0/3968365007 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8a4068b80 0x7ff8a4093b20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:55.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 >> 172.21.15.88:0/3968365007 conn(0x7ff8a4067ef0 msgr2=0x7ff8a4069030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:55.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 shutdown_connections 2023-10-18T19:41:55.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:55.602+0000 7ff8ac1ff700 1 -- 172.21.15.88:0/3968365007 wait complete. 2023-10-18T19:41:55.621 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2023-10-18T19:41:58.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:41:58.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.818+0000 7fd339bff700 1 Processor -- start 2023-10-18T19:41:58.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.819+0000 7fd339bff700 1 -- start start 2023-10-18T19:41:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.819+0000 7fd339bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.819+0000 7fd339bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:58.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd339bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33405ed40 con 0x7fd3341361c0 2023-10-18T19:41:58.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd339bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3340a3a70 con 0x7fd3340a4a20 2023-10-18T19:41:58.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd339bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd334136670 con 0x7fd33405e960 2023-10-18T19:41:58.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:58.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd332ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:45898/0 (socket says 172.21.15.88:45898) 2023-10-18T19:41:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 -- 172.21.15.88:0/3084488023 learned_addr learned my addr 172.21.15.88:0/3084488023 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd332ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60968/0 (socket says 172.21.15.88:60968) 2023-10-18T19:41:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 -- 172.21.15.88:0/3084488023 >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 msgr2=0x7fd334135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:41:58.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 --2- 172.21.15.88:0/3084488023 >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 -- 172.21.15.88:0/3084488023 >> v1:172.21.15.88:6789/0 conn(0x7fd3341361c0 legacy=0x7fd334138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 -- 172.21.15.88:0/3084488023 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3340a2ac0 con 0x7fd33405e960 2023-10-18T19:41:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd332ffd700 1 --2- 172.21.15.88:0/3084488023 >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:41:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.820+0000 7fd3337fe700 1 --2- 172.21.15.88:0/3084488023 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd324009830 tx=0x7fd3240090f0).ready entity=mon.1 client_cookie=3fb0f758f7bacf5b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:58.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd3327fc700 1 -- 172.21.15.88:0/3084488023 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400b610 con 0x7fd33405e960 2023-10-18T19:41:58.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd3327fc700 1 -- 172.21.15.88:0/3084488023 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b770 con 0x7fd33405e960 2023-10-18T19:41:58.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd3327fc700 1 -- 172.21.15.88:0/3084488023 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400baf0 con 0x7fd33405e960 2023-10-18T19:41:58.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 -- 172.21.15.88:0/3084488023 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 msgr2=0x7fd3340a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:58.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 --2- 172.21.15.88:0/3084488023 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fd324009830 tx=0x7fd3240090f0).stop 2023-10-18T19:41:58.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 -- 172.21.15.88:0/3084488023 shutdown_connections 2023-10-18T19:41:58.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 --2- 172.21.15.88:0/3084488023 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd33405e960 0x7fd3340a3580 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:58.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 --2- 172.21.15.88:0/3084488023 >> v2:172.21.15.88:3300/0 conn(0x7fd3340a4a20 0x7fd334135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:58.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 -- 172.21.15.88:0/3084488023 >> 172.21.15.88:0/3084488023 conn(0x7fd334064bb0 msgr2=0x7fd33405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 -- 172.21.15.88:0/3084488023 shutdown_connections 2023-10-18T19:41:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.821+0000 7fd339bff700 1 -- 172.21.15.88:0/3084488023 wait complete. 2023-10-18T19:41:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.823+0000 7fd339bff700 1 Processor -- start 2023-10-18T19:41:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.823+0000 7fd339bff700 1 -- start start 2023-10-18T19:41:58.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.823+0000 7fd339bff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.823+0000 7fd339bff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3340a4a20 0x7fd3340a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd339bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3341361c0 0x7fd33414be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:41:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd339bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340a8250 con 0x7fd3341361c0 2023-10-18T19:41:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd339bff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33414c7f0 con 0x7fd3340a4a20 2023-10-18T19:41:58.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd339bff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd33414cab0 con 0x7fd33405e960 2023-10-18T19:41:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd333fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3341361c0 0x7fd33414be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:54514/0 (socket says 172.21.15.88:54514) 2023-10-18T19:41:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 -- 172.21.15.88:0/4014898582 learned_addr learned my addr 172.21.15.88:0/4014898582 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:41:58.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd332ffd700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3340a4a20 0x7fd3340a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 -- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3340a4a20 msgr2=0x7fd3340a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3340a4a20 0x7fd3340a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 -- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3341361c0 msgr2=0x7fd33414be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3341361c0 0x7fd33414be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 -- 172.21.15.88:0/4014898582 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280092a0 con 0x7fd33405e960 2023-10-18T19:41:58.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.824+0000 7fd3337fe700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd324008000 tx=0x7fd324017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:41:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.825+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400beb0 con 0x7fd33405e960 2023-10-18T19:41:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.825+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b8e0 con 0x7fd33405e960 2023-10-18T19:41:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.825+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32401c670 con 0x7fd33405e960 2023-10-18T19:41:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.825+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324009370 con 0x7fd33405e960 2023-10-18T19:41:58.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.825+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341390e0 con 0x7fd33405e960 2023-10-18T19:41:58.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.826+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33405f270 con 0x7fd33405e960 2023-10-18T19:41:58.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.826+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fd32401c9e0 con 0x7fd33405e960 2023-10-18T19:41:58.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.826+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fd324057370 con 0x7fd33405e960 2023-10-18T19:41:58.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.830+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fd324005dd0 con 0x7fd33405e960 2023-10-18T19:41:58.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.997+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd3340a9590 con 0x7fd33405e960 2023-10-18T19:41:59.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:58.998+0000 7fd31b7fe700 1 -- 172.21.15.88:0/4014898582 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7fd32400ba50 con 0x7fd33405e960 2023-10-18T19:41:59.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:41:59.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 >> v1:172.21.15.88:6800/113625 conn(0x7fd320041bc0 legacy=0x7fd320044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:59.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 msgr2=0x7fd334138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:41:59.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd324008000 tx=0x7fd324017000).stop 2023-10-18T19:41:59.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 shutdown_connections 2023-10-18T19:41:59.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3341361c0 0x7fd33414be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:59.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fd33405e960 0x7fd334138650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:59.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 --2- 172.21.15.88:0/4014898582 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd3340a4a20 0x7fd3340a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:41:59.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 >> 172.21.15.88:0/4014898582 conn(0x7fd334064bb0 msgr2=0x7fd3340a0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:41:59.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 shutdown_connections 2023-10-18T19:41:59.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:41:59.000+0000 7fd339bff700 1 -- 172.21.15.88:0/4014898582 wait complete. 2023-10-18T19:41:59.019 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:02.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:02.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.212+0000 7f8bb03ff700 1 Processor -- start 2023-10-18T19:42:02.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 -- start start 2023-10-18T19:42:02.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ba809db80 0x7f8ba80aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:02.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:02.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba806a320 con 0x7f8ba8062ea0 2023-10-18T19:42:02.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba8063280 con 0x7f8ba809db80 2023-10-18T19:42:02.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.213+0000 7f8bb03ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba806ab10 con 0x7f8ba8069b40 2023-10-18T19:42:02.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ba809db80 0x7f8ba80aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:02.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bae99c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:02.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ba809db80 0x7f8ba80aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60980/0 (socket says 172.21.15.88:60980) 2023-10-18T19:42:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 -- 172.21.15.88:0/4123353071 learned_addr learned my addr 172.21.15.88:0/4123353071 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 -- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 msgr2=0x7f8ba8063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 -- 172.21.15.88:0/4123353071 >> v1:172.21.15.88:6789/0 conn(0x7f8ba8062ea0 legacy=0x7f8ba80636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 -- 172.21.15.88:0/4123353071 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba806a080 con 0x7f8ba809db80 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bae99c700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.214+0000 7f8bad99a700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba809db80 0x7f8ba80aa700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b98006fd0 tx=0x7f8b980090f0).ready entity=mon.0 client_cookie=3f0ec24d47b296e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bad199700 1 -- 172.21.15.88:0/4123353071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800b580 con 0x7f8ba809db80 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bad199700 1 -- 172.21.15.88:0/4123353071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800b6e0 con 0x7f8ba809db80 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bad199700 1 -- 172.21.15.88:0/4123353071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800ba60 con 0x7f8ba809db80 2023-10-18T19:42:02.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 -- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba809db80 msgr2=0x7f8ba80aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba809db80 0x7f8ba80aa700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b98006fd0 tx=0x7f8b980090f0).stop 2023-10-18T19:42:02.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 -- 172.21.15.88:0/4123353071 shutdown_connections 2023-10-18T19:42:02.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/4123353071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba809db80 0x7f8ba80aa700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 -- 172.21.15.88:0/4123353071 >> 172.21.15.88:0/4123353071 conn(0x7f8ba8067ef0 msgr2=0x7f8ba80625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:02.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 -- 172.21.15.88:0/4123353071 shutdown_connections 2023-10-18T19:42:02.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.215+0000 7f8bb03ff700 1 -- 172.21.15.88:0/4123353071 wait complete. 2023-10-18T19:42:02.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.217+0000 7f8bb03ff700 1 Processor -- start 2023-10-18T19:42:02.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.217+0000 7f8bb03ff700 1 -- start start 2023-10-18T19:42:02.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.217+0000 7f8bb03ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 0x7f8ba8095230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bb03ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bb03ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ba809db80 0x7f8ba813ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bb03ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8093860 con 0x7f8ba8062ea0 2023-10-18T19:42:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bb03ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8094b50 con 0x7f8ba8069b40 2023-10-18T19:42:02.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bb03ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba80a7d30 con 0x7f8ba809db80 2023-10-18T19:42:02.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bae19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 0x7f8ba8095230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:02.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:02.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bae19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 0x7f8ba8095230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60990/0 (socket says 172.21.15.88:60990) 2023-10-18T19:42:02.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bae99c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ba809db80 0x7f8ba813ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:02.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:45920/0 (socket says 172.21.15.88:45920) 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bae19b700 1 -- 172.21.15.88:0/1679940791 learned_addr learned my addr 172.21.15.88:0/1679940791 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 -- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ba809db80 msgr2=0x7f8ba813ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ba809db80 0x7f8ba813ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 -- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 msgr2=0x7f8ba8095230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 0x7f8ba8095230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 -- 172.21.15.88:0/1679940791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba0009a20 con 0x7f8ba8069b40 2023-10-18T19:42:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.218+0000 7f8bad99a700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8b98014000 tx=0x7f8b98017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.219+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98000bc0 con 0x7f8ba8069b40 2023-10-18T19:42:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.219+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800b850 con 0x7f8ba8069b40 2023-10-18T19:42:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.219+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98009370 con 0x7f8ba8069b40 2023-10-18T19:42:02.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.219+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98000d20 con 0x7f8ba8069b40 2023-10-18T19:42:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.219+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba8091c40 con 0x7f8ba8069b40 2023-10-18T19:42:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.220+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba805f270 con 0x7f8ba8069b40 2023-10-18T19:42:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.220+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f8b9801b8f0 con 0x7f8ba8069b40 2023-10-18T19:42:02.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.220+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f8b98056f90 con 0x7f8ba8069b40 2023-10-18T19:42:02.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.224+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f8b9803ae70 con 0x7f8ba8069b40 2023-10-18T19:42:02.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.398+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ba8068ba0 con 0x7f8ba8069b40 2023-10-18T19:42:02.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.398+0000 7f8b9e7fc700 1 -- 172.21.15.88:0/1679940791 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f8b9800b9c0 con 0x7f8ba8069b40 2023-10-18T19:42:02.402 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:02.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 >> v1:172.21.15.88:6800/113625 conn(0x7f8b8c041bf0 legacy=0x7f8b8c0440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 msgr2=0x7f8ba8092e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:02.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8b98014000 tx=0x7f8b98017000).stop 2023-10-18T19:42:02.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 shutdown_connections 2023-10-18T19:42:02.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8ba809db80 0x7f8ba813ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ba8062ea0 0x7f8ba8095230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 --2- 172.21.15.88:0/1679940791 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ba8069b40 0x7f8ba8092e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:02.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 >> 172.21.15.88:0/1679940791 conn(0x7f8ba8067ef0 msgr2=0x7f8ba80ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:02.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 shutdown_connections 2023-10-18T19:42:02.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:02.400+0000 7f8bb03ff700 1 -- 172.21.15.88:0/1679940791 wait complete. 2023-10-18T19:42:02.420 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:05.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:05.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.616+0000 7f070f7ff700 1 Processor -- start 2023-10-18T19:42:05.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.616+0000 7f070f7ff700 1 -- start start 2023-10-18T19:42:05.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070f7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080a1790 0x7f07081412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070f7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a4c50 0x7f07081437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070f7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080afd50 con 0x7f07080af970 2023-10-18T19:42:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070f7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080a47a0 con 0x7f07080a4c50 2023-10-18T19:42:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070f7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07080a3a10 con 0x7f07080a1790 2023-10-18T19:42:05.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a4c50 0x7f07081437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070cd9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080a1790 0x7f07081412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f07080a4c50 0x7f07081437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60994/0 (socket says 172.21.15.88:60994) 2023-10-18T19:42:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 -- 172.21.15.88:0/2967383135 learned_addr learned my addr 172.21.15.88:0/2967383135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 -- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080a1790 msgr2=0x7f07081412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:05.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 --2- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080a1790 0x7f07081412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 -- 172.21.15.88:0/2967383135 >> v1:172.21.15.88:6789/0 conn(0x7f07080af970 legacy=0x7f0708135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 -- 172.21.15.88:0/2967383135 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080a32d0 con 0x7f07080a4c50 2023-10-18T19:42:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.617+0000 7f070dd9c700 1 --2- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a4c50 0x7f07081437e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0700009f20 tx=0x7f0700009840).ready entity=mon.0 client_cookie=d8a0d667ec38a0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f06fffff700 1 -- 172.21.15.88:0/2967383135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000e070 con 0x7f07080a4c50 2023-10-18T19:42:05.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f06fffff700 1 -- 172.21.15.88:0/2967383135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070000b9d0 con 0x7f07080a4c50 2023-10-18T19:42:05.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f06fffff700 1 -- 172.21.15.88:0/2967383135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000bd50 con 0x7f07080a4c50 2023-10-18T19:42:05.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 -- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a4c50 msgr2=0x7f07081437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 --2- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a4c50 0x7f07081437e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0700009f20 tx=0x7f0700009840).stop 2023-10-18T19:42:05.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 -- 172.21.15.88:0/2967383135 shutdown_connections 2023-10-18T19:42:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 --2- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a4c50 0x7f07081437e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 --2- 172.21.15.88:0/2967383135 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080a1790 0x7f07081412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 -- 172.21.15.88:0/2967383135 >> 172.21.15.88:0/2967383135 conn(0x7f070805eb60 msgr2=0x7f07080af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 -- 172.21.15.88:0/2967383135 shutdown_connections 2023-10-18T19:42:05.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.618+0000 7f070f7ff700 1 -- 172.21.15.88:0/2967383135 wait complete. 2023-10-18T19:42:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 Processor -- start 2023-10-18T19:42:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 -- start start 2023-10-18T19:42:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f07080a4c50 0x7f070814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:05.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080af970 0x7f07080ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.620+0000 7f070f7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070814cd10 con 0x7f07080a1790 2023-10-18T19:42:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070f7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080aade0 con 0x7f07080a4c50 2023-10-18T19:42:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070f7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07080abfe0 con 0x7f07080af970 2023-10-18T19:42:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:05.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:32774/0 (socket says 172.21.15.88:32774) 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 -- 172.21.15.88:0/3287726206 learned_addr learned my addr 172.21.15.88:0/3287726206 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070cd9a700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f07080a4c50 0x7f070814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070dd9c700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080af970 0x7f07080ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 -- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080af970 msgr2=0x7f07080ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080af970 0x7f07080ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 -- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f07080a4c50 msgr2=0x7f070814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f07080a4c50 0x7f070814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 -- 172.21.15.88:0/3287726206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009ae0 con 0x7f07080a1790 2023-10-18T19:42:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.621+0000 7f070d59b700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f070400c440 tx=0x7f0704007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.622+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704007020 con 0x7f07080a1790 2023-10-18T19:42:05.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.622+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704007180 con 0x7f07080a1790 2023-10-18T19:42:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.622+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080a8bd0 con 0x7f07080a1790 2023-10-18T19:42:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.622+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704007520 con 0x7f07080a1790 2023-10-18T19:42:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.622+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07080aaaf0 con 0x7f07080a1790 2023-10-18T19:42:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.623+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070805f270 con 0x7f07080a1790 2023-10-18T19:42:05.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.623+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f07040068b0 con 0x7f07080a1790 2023-10-18T19:42:05.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.624+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0704054b10 con 0x7f07080a1790 2023-10-18T19:42:05.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.627+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0704034eb0 con 0x7f07080a1790 2023-10-18T19:42:05.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.796+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07080a3010 con 0x7f07080a1790 2023-10-18T19:42:05.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.796+0000 7f06fd7fa700 1 -- 172.21.15.88:0/3287726206 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f07040386a0 con 0x7f07080a1790 2023-10-18T19:42:05.799 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 >> v1:172.21.15.88:6800/113625 conn(0x7f06ec041bc0 legacy=0x7f06ec044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 msgr2=0x7f070814c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f070400c440 tx=0x7f0704007e00).stop 2023-10-18T19:42:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 shutdown_connections 2023-10-18T19:42:05.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f07080af970 0x7f07080ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f07080a1790 0x7f070814c820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 --2- 172.21.15.88:0/3287726206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f07080a4c50 0x7f070814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 >> 172.21.15.88:0/3287726206 conn(0x7f070805eb60 msgr2=0x7f07080ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 shutdown_connections 2023-10-18T19:42:05.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:05.798+0000 7f070f7ff700 1 -- 172.21.15.88:0/3287726206 wait complete. 2023-10-18T19:42:05.817 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:08.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.012+0000 7f72979ff700 1 Processor -- start 2023-10-18T19:42:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.012+0000 7f72979ff700 1 -- start start 2023-10-18T19:42:09.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.013+0000 7f72979ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72900a13d0 0x7f72900ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:09.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.013+0000 7f72979ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 0x7f7290136110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:09.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.013+0000 7f72979ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900a0fc0 con 0x7f72900af1e0 2023-10-18T19:42:09.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.013+0000 7f72979ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72900af5c0 con 0x7f72900a13d0 2023-10-18T19:42:09.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.013+0000 7f72979ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7290136600 con 0x7f7290135cb0 2023-10-18T19:42:09.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72900a13d0 0x7f72900ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:09.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7295f9c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 0x7f7290136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:09.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f72900a13d0 0x7f72900ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54042/0 (socket says 172.21.15.88:54042) 2023-10-18T19:42:09.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 -- 172.21.15.88:0/703209084 learned_addr learned my addr 172.21.15.88:0/703209084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:09.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 -- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 msgr2=0x7f7290136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:09.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 0x7f7290136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 -- 172.21.15.88:0/703209084 >> v1:172.21.15.88:6789/0 conn(0x7f72900af1e0 legacy=0x7f72900a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 -- 172.21.15.88:0/703209084 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900a4980 con 0x7f72900a13d0 2023-10-18T19:42:09.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7295f9c700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 0x7f7290136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:09.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7294f9a700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72900a13d0 0x7f72900ac830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7280006fd0 tx=0x7f72800090f0).ready entity=mon.0 client_cookie=25f7b0ef39241c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:09.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.014+0000 7f7287fff700 1 -- 172.21.15.88:0/703209084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000b610 con 0x7f72900a13d0 2023-10-18T19:42:09.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f7287fff700 1 -- 172.21.15.88:0/703209084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728000b770 con 0x7f72900a13d0 2023-10-18T19:42:09.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f7287fff700 1 -- 172.21.15.88:0/703209084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000baf0 con 0x7f72900a13d0 2023-10-18T19:42:09.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 -- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72900a13d0 msgr2=0x7f72900ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72900a13d0 0x7f72900ac830 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7280006fd0 tx=0x7f72800090f0).stop 2023-10-18T19:42:09.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 -- 172.21.15.88:0/703209084 shutdown_connections 2023-10-18T19:42:09.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7290135cb0 0x7f7290136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 --2- 172.21.15.88:0/703209084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72900a13d0 0x7f72900ac830 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 -- 172.21.15.88:0/703209084 >> 172.21.15.88:0/703209084 conn(0x7f7290064d50 msgr2=0x7f7290062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:09.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 -- 172.21.15.88:0/703209084 shutdown_connections 2023-10-18T19:42:09.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.015+0000 7f72979ff700 1 -- 172.21.15.88:0/703209084 wait complete. 2023-10-18T19:42:09.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.016+0000 7f72979ff700 1 Processor -- start 2023-10-18T19:42:09.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 -- start start 2023-10-18T19:42:09.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:09.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f72900af1e0 0x7f729013bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:09.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7290135cb0 0x7f729013a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:09.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7290134970 con 0x7f7290135cb0 2023-10-18T19:42:09.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729014bed0 con 0x7f72900a13d0 2023-10-18T19:42:09.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.017+0000 7f72979ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f729013b5b0 con 0x7f72900af1e0 2023-10-18T19:42:09.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:09.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f7294f9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f72900af1e0 0x7f729013bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:09.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:43312/0 (socket says 172.21.15.88:43312) 2023-10-18T19:42:09.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 -- 172.21.15.88:0/1569142386 learned_addr learned my addr 172.21.15.88:0/1569142386 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:09.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f7295f9c700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7290135cb0 0x7f729013a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 -- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f72900af1e0 msgr2=0x7f729013bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f72900af1e0 0x7f729013bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 -- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7290135cb0 msgr2=0x7f729013a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7290135cb0 0x7f729013a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 -- 172.21.15.88:0/1569142386 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7288009a20 con 0x7f72900a13d0 2023-10-18T19:42:09.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f729579b700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f728c00c4c0 tx=0x7f728c007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:09.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c007020 con 0x7f72900a13d0 2023-10-18T19:42:09.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.018+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c001e90 con 0x7f72900a13d0 2023-10-18T19:42:09.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.019+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7280009370 con 0x7f72900a13d0 2023-10-18T19:42:09.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.019+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c0073d0 con 0x7f72900a13d0 2023-10-18T19:42:09.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.019+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729013b300 con 0x7f72900a13d0 2023-10-18T19:42:09.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.020+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729013a7b0 con 0x7f72900a13d0 2023-10-18T19:42:09.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.020+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f728c0068b0 con 0x7f72900a13d0 2023-10-18T19:42:09.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.021+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f728c055170 con 0x7f72900a13d0 2023-10-18T19:42:09.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.024+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f728c035620 con 0x7f72900a13d0 2023-10-18T19:42:09.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.194+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f729005f270 con 0x7f72900a13d0 2023-10-18T19:42:09.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.194+0000 7f72857fa700 1 -- 172.21.15.88:0/1569142386 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f728c038c40 con 0x7f72900a13d0 2023-10-18T19:42:09.197 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:09.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 >> v1:172.21.15.88:6800/113625 conn(0x7f7274041bc0 legacy=0x7f7274044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 msgr2=0x7f729013c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:09.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f728c00c4c0 tx=0x7f728c007e00).stop 2023-10-18T19:42:09.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 shutdown_connections 2023-10-18T19:42:09.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7290135cb0 0x7f729013a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f72900a13d0 0x7f729013c970 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 --2- 172.21.15.88:0/1569142386 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f72900af1e0 0x7f729013bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:09.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.196+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 >> 172.21.15.88:0/1569142386 conn(0x7f7290064d50 msgr2=0x7f7290136a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:09.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.197+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 shutdown_connections 2023-10-18T19:42:09.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:09.197+0000 7f72979ff700 1 -- 172.21.15.88:0/1569142386 wait complete. 2023-10-18T19:42:09.216 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:12.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:12.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.411+0000 7f1786dff700 1 Processor -- start 2023-10-18T19:42:12.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.412+0000 7f1786dff700 1 -- start start 2023-10-18T19:42:12.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1786dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1780068150 0x7f1780069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:12.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1786dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f178013fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:12.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1786dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1780069a30 con 0x7f178006a220 2023-10-18T19:42:12.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1786dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1780069840 con 0x7f1780068150 2023-10-18T19:42:12.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1786dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1780068530 con 0x7f17800670d0 2023-10-18T19:42:12.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1784b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1780068150 0x7f1780069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1784b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1780068150 0x7f1780069350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54072/0 (socket says 172.21.15.88:54072) 2023-10-18T19:42:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f1784b9b700 1 -- 172.21.15.88:0/1937898788 learned_addr learned my addr 172.21.15.88:0/1937898788 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.413+0000 7f178539c700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f178013fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f1784b9b700 1 -- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 msgr2=0x7f178013fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:12.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f1784b9b700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f178013fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f1784b9b700 1 -- 172.21.15.88:0/1937898788 >> v1:172.21.15.88:6789/0 conn(0x7f178006a220 legacy=0x7f17800669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f1784b9b700 1 -- 172.21.15.88:0/1937898788 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178009c500 con 0x7f1780068150 2023-10-18T19:42:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f1784b9b700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1780068150 0x7f1780069350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f1774006fd0 tx=0x7f17740090f0).ready entity=mon.0 client_cookie=fc33122e0914a020 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f177f7fe700 1 -- 172.21.15.88:0/1937898788 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400b610 con 0x7f1780068150 2023-10-18T19:42:12.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f177f7fe700 1 -- 172.21.15.88:0/1937898788 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400b770 con 0x7f1780068150 2023-10-18T19:42:12.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.414+0000 7f177f7fe700 1 -- 172.21.15.88:0/1937898788 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400baf0 con 0x7f1780068150 2023-10-18T19:42:12.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 -- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1780068150 msgr2=0x7f1780069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1780068150 0x7f1780069350 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f1774006fd0 tx=0x7f17740090f0).stop 2023-10-18T19:42:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 -- 172.21.15.88:0/1937898788 shutdown_connections 2023-10-18T19:42:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f178013fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 --2- 172.21.15.88:0/1937898788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1780068150 0x7f1780069350 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 -- 172.21.15.88:0/1937898788 >> 172.21.15.88:0/1937898788 conn(0x7f178005eb30 msgr2=0x7f17800aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 -- 172.21.15.88:0/1937898788 shutdown_connections 2023-10-18T19:42:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.415+0000 7f1786dff700 1 -- 172.21.15.88:0/1937898788 wait complete. 2023-10-18T19:42:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.416+0000 7f1786dff700 1 Processor -- start 2023-10-18T19:42:12.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.416+0000 7f1786dff700 1 -- start start 2023-10-18T19:42:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1780068150 0x7f1780134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 0x7f1780134d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178009a6c0 con 0x7f178006a220 2023-10-18T19:42:12.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178009e6e0 con 0x7f1780068150 2023-10-18T19:42:12.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1786dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178009f250 con 0x7f17800670d0 2023-10-18T19:42:12.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1784b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:12.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1784b9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:51534/0 (socket says 172.21.15.88:51534) 2023-10-18T19:42:12.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1784b9b700 1 -- 172.21.15.88:0/3386353548 learned_addr learned my addr 172.21.15.88:0/3386353548 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:12.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f178539c700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 0x7f1780134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f177ffff700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1780068150 0x7f1780134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.417+0000 7f1784b9b700 1 -- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1780068150 msgr2=0x7f1780134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1784b9b700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1780068150 0x7f1780134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1784b9b700 1 -- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 msgr2=0x7f1780134d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1784b9b700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 0x7f1780134d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1784b9b700 1 -- 172.21.15.88:0/3386353548 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009370 con 0x7f17800670d0 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f178539c700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 0x7f1780134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1784b9b700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f178005fde0 tx=0x7f1774017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400beb0 con 0x7f17800670d0 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400b8e0 con 0x7f17800670d0 2023-10-18T19:42:12.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178009f4f0 con 0x7f17800670d0 2023-10-18T19:42:12.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177401c670 con 0x7f17800670d0 2023-10-18T19:42:12.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.418+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1780135220 con 0x7f17800670d0 2023-10-18T19:42:12.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.419+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f177401ca20 con 0x7f17800670d0 2023-10-18T19:42:12.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.419+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178005f270 con 0x7f17800670d0 2023-10-18T19:42:12.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.420+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f1774057330 con 0x7f17800670d0 2023-10-18T19:42:12.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.423+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f177400ba50 con 0x7f17800670d0 2023-10-18T19:42:12.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.592+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f178009c7c0 con 0x7f17800670d0 2023-10-18T19:42:12.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.592+0000 7f177cff9700 1 -- 172.21.15.88:0/3386353548 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f177400ba50 con 0x7f17800670d0 2023-10-18T19:42:12.596 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:12.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 >> v1:172.21.15.88:6800/113625 conn(0x7f1764041bc0 legacy=0x7f1764044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 msgr2=0x7f17800a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:12.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f178005fde0 tx=0x7f1774017000).stop 2023-10-18T19:42:12.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 shutdown_connections 2023-10-18T19:42:12.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006a220 0x7f1780134d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f17800670d0 0x7f17800a0ad0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 --2- 172.21.15.88:0/3386353548 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1780068150 0x7f1780134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:12.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.594+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 >> 172.21.15.88:0/3386353548 conn(0x7f178005eb30 msgr2=0x7f17800ab370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:12.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.595+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 shutdown_connections 2023-10-18T19:42:12.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:12.595+0000 7f1786dff700 1 -- 172.21.15.88:0/3386353548 wait complete. 2023-10-18T19:42:12.614 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:15.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:15.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.808+0000 7fdfc79ff700 1 Processor -- start 2023-10-18T19:42:15.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.809+0000 7fdfc79ff700 1 -- start start 2023-10-18T19:42:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.809+0000 7fdfc79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 0x7fdfc01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:15.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfc00a4c50 0x7fdfc01437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc79ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00afd50 con 0x7fdfc00af970 2023-10-18T19:42:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00a47a0 con 0x7fdfc00a4c50 2023-10-18T19:42:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00a3a10 con 0x7fdfc00a1790 2023-10-18T19:42:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 0x7fdfc01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:15.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc579b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdfc00af970 0x7fdfc0135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45372/0 (socket says 172.21.15.88:45372) 2023-10-18T19:42:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc579b700 1 -- 172.21.15.88:0/3488262451 learned_addr learned my addr 172.21.15.88:0/3488262451 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc5f9c700 1 --2- 172.21.15.88:0/3488262451 >> v2:172.21.15.88:3300/0 conn(0x7fdfc00a4c50 0x7fdfc01437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 -- 172.21.15.88:0/3488262451 >> v2:172.21.15.88:3300/0 conn(0x7fdfc00a4c50 msgr2=0x7fdfc01437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 --2- 172.21.15.88:0/3488262451 >> v2:172.21.15.88:3300/0 conn(0x7fdfc00a4c50 0x7fdfc01437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 -- 172.21.15.88:0/3488262451 >> v1:172.21.15.88:6789/0 conn(0x7fdfc00af970 legacy=0x7fdfc0135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 -- 172.21.15.88:0/3488262451 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00a32d0 con 0x7fdfc00a1790 2023-10-18T19:42:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.810+0000 7fdfc4f9a700 1 --2- 172.21.15.88:0/3488262451 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 0x7fdfc01412e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdfb0009760 tx=0x7fdfb0009060).ready entity=mon.2 client_cookie=886f60156e5f1e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfb7fff700 1 -- 172.21.15.88:0/3488262451 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000f510 con 0x7fdfc00a1790 2023-10-18T19:42:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfb7fff700 1 -- 172.21.15.88:0/3488262451 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000f670 con 0x7fdfc00a1790 2023-10-18T19:42:15.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfb7fff700 1 -- 172.21.15.88:0/3488262451 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000f9f0 con 0x7fdfc00a1790 2023-10-18T19:42:15.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 -- 172.21.15.88:0/3488262451 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 msgr2=0x7fdfc01412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/3488262451 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 0x7fdfc01412e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdfb0009760 tx=0x7fdfb0009060).stop 2023-10-18T19:42:15.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 -- 172.21.15.88:0/3488262451 shutdown_connections 2023-10-18T19:42:15.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/3488262451 >> v2:172.21.15.88:3300/0 conn(0x7fdfc00a4c50 0x7fdfc01437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/3488262451 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00a1790 0x7fdfc01412e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 -- 172.21.15.88:0/3488262451 >> 172.21.15.88:0/3488262451 conn(0x7fdfc005eb60 msgr2=0x7fdfc00af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:15.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 -- 172.21.15.88:0/3488262451 shutdown_connections 2023-10-18T19:42:15.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.811+0000 7fdfc79ff700 1 -- 172.21.15.88:0/3488262451 wait complete. 2023-10-18T19:42:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 Processor -- start 2023-10-18T19:42:15.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 -- start start 2023-10-18T19:42:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdfc00a1790 0x7fdfc00aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 0x7fdfc00a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:15.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0134c90 con 0x7fdfc00a4c50 2023-10-18T19:42:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00ab0f0 con 0x7fdfc00a1790 2023-10-18T19:42:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.813+0000 7fdfc79ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0134a00 con 0x7fdfc00af970 2023-10-18T19:42:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc579b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdfc00a1790 0x7fdfc00aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:15.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc4f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 0x7fdfc00a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:51560/0 (socket says 172.21.15.88:51560) 2023-10-18T19:42:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 -- 172.21.15.88:0/4030897174 learned_addr learned my addr 172.21.15.88:0/4030897174 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 -- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdfc00a1790 msgr2=0x7fdfc00aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdfc00a1790 0x7fdfc00aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 -- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 msgr2=0x7fdfc00a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 0x7fdfc00a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 -- 172.21.15.88:0/4030897174 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00092a0 con 0x7fdfc00af970 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc4f9a700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 0x7fdfc00a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfc5f9c700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdfb8009ef0 tx=0x7fdfb800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:15.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8009c50 con 0x7fdfc00af970 2023-10-18T19:42:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800f040 con 0x7fdfc00af970 2023-10-18T19:42:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.814+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800cda0 con 0x7fdfc00af970 2023-10-18T19:42:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.815+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc00a6dc0 con 0x7fdfc00af970 2023-10-18T19:42:15.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.815+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc009e920 con 0x7fdfc00af970 2023-10-18T19:42:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.816+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc005f270 con 0x7fdfc00af970 2023-10-18T19:42:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.816+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fdfb8013610 con 0x7fdfc00af970 2023-10-18T19:42:15.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.817+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fdfb8056040 con 0x7fdfc00af970 2023-10-18T19:42:15.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.820+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fdfb8036380 con 0x7fdfc00af970 2023-10-18T19:42:15.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.991+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdfc013cdf0 con 0x7fdfc00af970 2023-10-18T19:42:15.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.991+0000 7fdfb57fa700 1 -- 172.21.15.88:0/4030897174 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7fdfb8039b70 con 0x7fdfc00af970 2023-10-18T19:42:15.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.992+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 >> v1:172.21.15.88:6800/113625 conn(0x7fdfa4041bc0 legacy=0x7fdfa4044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.992+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 msgr2=0x7fdfc014c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.992+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdfb8009ef0 tx=0x7fdfb800b040).stop 2023-10-18T19:42:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 shutdown_connections 2023-10-18T19:42:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fdfc00af970 0x7fdfc014c490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdfc00a1790 0x7fdfc00aac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 --2- 172.21.15.88:0/4030897174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc00a4c50 0x7fdfc00a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 >> 172.21.15.88:0/4030897174 conn(0x7fdfc005eb60 msgr2=0x7fdfc01382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 shutdown_connections 2023-10-18T19:42:15.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:15.993+0000 7fdfc79ff700 1 -- 172.21.15.88:0/4030897174 wait complete. 2023-10-18T19:42:16.012 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:19.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:19.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.227+0000 7f87eb3ff700 1 Processor -- start 2023-10-18T19:42:19.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.228+0000 7f87eb3ff700 1 -- start start 2023-10-18T19:42:19.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87eb3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87e40a1790 0x7f87e41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:19.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87eb3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a4c50 0x7f87e41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:19.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87eb3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40afd50 con 0x7f87e40af970 2023-10-18T19:42:19.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87eb3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40a47a0 con 0x7f87e40a1790 2023-10-18T19:42:19.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87eb3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40a3a10 con 0x7f87e40a4c50 2023-10-18T19:42:19.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87e899a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87e40a1790 0x7f87e41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:19.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87e899a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87e40a1790 0x7f87e41412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47570/0 (socket says 172.21.15.88:47570) 2023-10-18T19:42:19.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87e899a700 1 -- 172.21.15.88:0/2979067999 learned_addr learned my addr 172.21.15.88:0/2979067999 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:19.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.229+0000 7f87e999c700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a4c50 0x7f87e41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:19.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87e899a700 1 -- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a4c50 msgr2=0x7f87e41437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:19.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87e899a700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a4c50 0x7f87e41437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87e899a700 1 -- 172.21.15.88:0/2979067999 >> v1:172.21.15.88:6789/0 conn(0x7f87e40af970 legacy=0x7f87e4135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87e899a700 1 -- 172.21.15.88:0/2979067999 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40a32d0 con 0x7f87e40a1790 2023-10-18T19:42:19.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87e899a700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40a1790 0x7f87e41412e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f87d4006fd0 tx=0x7f87d40090f0).ready entity=mon.0 client_cookie=6491dda536973019 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:19.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87dbfff700 1 -- 172.21.15.88:0/2979067999 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400b580 con 0x7f87e40a1790 2023-10-18T19:42:19.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87dbfff700 1 -- 172.21.15.88:0/2979067999 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400b6e0 con 0x7f87e40a1790 2023-10-18T19:42:19.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.230+0000 7f87dbfff700 1 -- 172.21.15.88:0/2979067999 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400ba60 con 0x7f87e40a1790 2023-10-18T19:42:19.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 -- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40a1790 msgr2=0x7f87e41412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40a1790 0x7f87e41412e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f87d4006fd0 tx=0x7f87d40090f0).stop 2023-10-18T19:42:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 -- 172.21.15.88:0/2979067999 shutdown_connections 2023-10-18T19:42:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a4c50 0x7f87e41437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/2979067999 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40a1790 0x7f87e41412e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 -- 172.21.15.88:0/2979067999 >> 172.21.15.88:0/2979067999 conn(0x7f87e405eb60 msgr2=0x7f87e40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 -- 172.21.15.88:0/2979067999 shutdown_connections 2023-10-18T19:42:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.231+0000 7f87eb3ff700 1 -- 172.21.15.88:0/2979067999 wait complete. 2023-10-18T19:42:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.232+0000 7f87eb3ff700 1 Processor -- start 2023-10-18T19:42:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.232+0000 7f87eb3ff700 1 -- start start 2023-10-18T19:42:19.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87e40a4c50 0x7f87e40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 0x7f87e413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:19.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40a8d10 con 0x7f87e40af970 2023-10-18T19:42:19.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40a7640 con 0x7f87e40a1790 2023-10-18T19:42:19.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87eb3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40a7900 con 0x7f87e40a4c50 2023-10-18T19:42:19.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87e919b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:19.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87e999c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 0x7f87e413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:19.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87e919b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:59662/0 (socket says 172.21.15.88:59662) 2023-10-18T19:42:19.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87e919b700 1 -- 172.21.15.88:0/3496298803 learned_addr learned my addr 172.21.15.88:0/3496298803 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:19.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.233+0000 7f87e899a700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87e40a4c50 0x7f87e40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:19.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 -- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87e40a4c50 msgr2=0x7f87e40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87e40a4c50 0x7f87e40abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 -- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 msgr2=0x7f87e413c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 0x7f87e413c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 -- 172.21.15.88:0/3496298803 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009370 con 0x7f87e40a1790 2023-10-18T19:42:19.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e999c700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 0x7f87e413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:19.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87e919b700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f87e000c440 tx=0x7f87e0007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:19.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0007020 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0007180 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e413ca50 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0007520 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.234+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e40a6730 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.235+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e40a9b40 con 0x7f87e40a1790 2023-10-18T19:42:19.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.235+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f87e00068b0 con 0x7f87e40a1790 2023-10-18T19:42:19.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.236+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f87e0054bd0 con 0x7f87e40a1790 2023-10-18T19:42:19.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.239+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f87e0035080 con 0x7f87e40a1790 2023-10-18T19:42:19.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.413+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f87e40ae070 con 0x7f87e40a1790 2023-10-18T19:42:19.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.414+0000 7f87d97fa700 1 -- 172.21.15.88:0/3496298803 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f87e0054e60 con 0x7f87e40a1790 2023-10-18T19:42:19.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 >> v1:172.21.15.88:6800/113625 conn(0x7f87c8041bf0 legacy=0x7f87c80440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 msgr2=0x7f87e40a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f87e000c440 tx=0x7f87e0007e00).stop 2023-10-18T19:42:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 shutdown_connections 2023-10-18T19:42:19.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e40af970 0x7f87e413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87e40a1790 0x7f87e40a9cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 --2- 172.21.15.88:0/3496298803 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f87e40a4c50 0x7f87e40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 >> 172.21.15.88:0/3496298803 conn(0x7f87e405eb60 msgr2=0x7f87e40ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 shutdown_connections 2023-10-18T19:42:19.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:19.416+0000 7f87eb3ff700 1 -- 172.21.15.88:0/3496298803 wait complete. 2023-10-18T19:42:19.435 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:22.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:22.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.631+0000 7f876e7ff700 1 Processor -- start 2023-10-18T19:42:22.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.631+0000 7f876e7ff700 1 -- start start 2023-10-18T19:42:22.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.632+0000 7f876e7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:22.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.632+0000 7f876e7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 0x7f87680a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:22.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.632+0000 7f876e7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876805e630 con 0x7f87680a8b70 2023-10-18T19:42:22.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.632+0000 7f876e7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680a7260 con 0x7f87680a6aa0 2023-10-18T19:42:22.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.632+0000 7f876e7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87680a1a70 con 0x7f876805e250 2023-10-18T19:42:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f876cd9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87680a8b70 0x7f876813c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38024/0 (socket says 172.21.15.88:38024) 2023-10-18T19:42:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f876cd9c700 1 -- 172.21.15.88:0/1535029089 learned_addr learned my addr 172.21.15.88:0/1535029089 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f87677fe700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 0x7f87680a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 -- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 msgr2=0x7f87680a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 0x7f87680a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 -- 172.21.15.88:0/1535029089 >> v1:172.21.15.88:6789/0 conn(0x7f87680a8b70 legacy=0x7f876813c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8766ffd700 1 -- 172.21.15.88:0/1535029089 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002094805 0 0) 0x7f876805e630 con 0x7f87680a8b70 2023-10-18T19:42:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 -- 172.21.15.88:0/1535029089 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680a8060 con 0x7f876805e250 2023-10-18T19:42:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f87677fe700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 0x7f87680a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8767fff700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a1580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8758009790 tx=0x7f8758009060).ready entity=mon.2 client_cookie=5656c684dcacd09b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8766ffd700 1 -- 172.21.15.88:0/1535029089 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800f510 con 0x7f876805e250 2023-10-18T19:42:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.633+0000 7f8766ffd700 1 -- 172.21.15.88:0/1535029089 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800f670 con 0x7f876805e250 2023-10-18T19:42:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f8766ffd700 1 -- 172.21.15.88:0/1535029089 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800f9f0 con 0x7f876805e250 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 -- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 msgr2=0x7f87680a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a1580 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8758009790 tx=0x7f8758009060).stop 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 -- 172.21.15.88:0/1535029089 shutdown_connections 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a1580 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1535029089 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a6aa0 0x7f87680a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 -- 172.21.15.88:0/1535029089 >> 172.21.15.88:0/1535029089 conn(0x7f87680665a0 msgr2=0x7f87680625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 -- 172.21.15.88:0/1535029089 shutdown_connections 2023-10-18T19:42:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.634+0000 7f876e7ff700 1 -- 172.21.15.88:0/1535029089 wait complete. 2023-10-18T19:42:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.636+0000 7f876e7ff700 1 Processor -- start 2023-10-18T19:42:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.636+0000 7f876e7ff700 1 -- start start 2023-10-18T19:42:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87680a6aa0 0x7f87681483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a8b70 0x7f87681488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87680a41d0 con 0x7f87680a6aa0 2023-10-18T19:42:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8768134720 con 0x7f87680a8b70 2023-10-18T19:42:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876e7ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87680a3b10 con 0x7f876805e250 2023-10-18T19:42:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f8767fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f87677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87680a6aa0 0x7f87681483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f8767fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:39578/0 (socket says 172.21.15.88:39578) 2023-10-18T19:42:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f8767fff700 1 -- 172.21.15.88:0/1363883000 learned_addr learned my addr 172.21.15.88:0/1363883000 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.637+0000 7f876cd9c700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a8b70 0x7f87681488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 -- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a8b70 msgr2=0x7f87681488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a8b70 0x7f87681488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 -- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87680a6aa0 msgr2=0x7f87681483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87680a6aa0 0x7f87681483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 -- 172.21.15.88:0/1363883000 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0092a0 con 0x7f876805e250 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f8767fff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8758009e30 tx=0x7f8758017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875800f7e0 con 0x7f876805e250 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875800f940 con 0x7f876805e250 2023-10-18T19:42:22.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87580092a0 con 0x7f876805e250 2023-10-18T19:42:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.638+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875801b640 con 0x7f876805e250 2023-10-18T19:42:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.639+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87680a52d0 con 0x7f876805e250 2023-10-18T19:42:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.640+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f875801ba70 con 0x7f876805e250 2023-10-18T19:42:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.640+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680a4ef0 con 0x7f876805e250 2023-10-18T19:42:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.640+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f8758057320 con 0x7f876805e250 2023-10-18T19:42:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.643+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f8758024b50 con 0x7f876805e250 2023-10-18T19:42:22.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.815+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f876805f270 con 0x7f876805e250 2023-10-18T19:42:22.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.816+0000 7f874ffff700 1 -- 172.21.15.88:0/1363883000 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f875803ae70 con 0x7f876805e250 2023-10-18T19:42:22.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:22.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 >> v1:172.21.15.88:6800/113625 conn(0x7f8754041bc0 legacy=0x7f8754044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 msgr2=0x7f87680a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:22.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f8758009e30 tx=0x7f8758017000).stop 2023-10-18T19:42:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 shutdown_connections 2023-10-18T19:42:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f87680a8b70 0x7f87681488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f876805e250 0x7f87680a2b90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 --2- 172.21.15.88:0/1363883000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87680a6aa0 0x7f87681483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 >> 172.21.15.88:0/1363883000 conn(0x7f87680665a0 msgr2=0x7f8768062d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:22.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 shutdown_connections 2023-10-18T19:42:22.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:22.818+0000 7f876e7ff700 1 -- 172.21.15.88:0/1363883000 wait complete. 2023-10-18T19:42:22.837 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:25.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:26.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.033+0000 7f01267ff700 1 Processor -- start 2023-10-18T19:42:26.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.033+0000 7f01267ff700 1 -- start start 2023-10-18T19:42:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f01267ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f01200a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f01267ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f01267ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012005ed40 con 0x7f01200a34a0 2023-10-18T19:42:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f01267ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01200a2fb0 con 0x7f01200a38c0 2023-10-18T19:42:26.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f01267ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01200a49d0 con 0x7f012005e960 2023-10-18T19:42:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f0124d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f011ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f01200a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f0124d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35852/0 (socket says 172.21.15.88:35852) 2023-10-18T19:42:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.034+0000 7f0124d9c700 1 -- 172.21.15.88:0/4166839109 learned_addr learned my addr 172.21.15.88:0/4166839109 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:26.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011ffff700 1 -- 172.21.15.88:0/4166839109 >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 msgr2=0x7f01201362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:26.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011ffff700 1 --2- 172.21.15.88:0/4166839109 >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011ffff700 1 -- 172.21.15.88:0/4166839109 >> v1:172.21.15.88:6789/0 conn(0x7f01200a34a0 legacy=0x7f0120135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011ffff700 1 -- 172.21.15.88:0/4166839109 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01200a4c70 con 0x7f012005e960 2023-10-18T19:42:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f0124d9c700 1 --2- 172.21.15.88:0/4166839109 >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011ffff700 1 --2- 172.21.15.88:0/4166839109 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f01200a2ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0110009760 tx=0x7f0110009060).ready entity=mon.1 client_cookie=414dcbab2fb6aa03 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011effd700 1 -- 172.21.15.88:0/4166839109 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000f510 con 0x7f012005e960 2023-10-18T19:42:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011effd700 1 -- 172.21.15.88:0/4166839109 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000f670 con 0x7f012005e960 2023-10-18T19:42:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.035+0000 7f011effd700 1 -- 172.21.15.88:0/4166839109 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000f9f0 con 0x7f012005e960 2023-10-18T19:42:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 -- 172.21.15.88:0/4166839109 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 msgr2=0x7f01200a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 --2- 172.21.15.88:0/4166839109 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f01200a2ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0110009760 tx=0x7f0110009060).stop 2023-10-18T19:42:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 -- 172.21.15.88:0/4166839109 shutdown_connections 2023-10-18T19:42:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 --2- 172.21.15.88:0/4166839109 >> v2:172.21.15.88:3300/0 conn(0x7f01200a38c0 0x7f01201362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 --2- 172.21.15.88:0/4166839109 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f01200a2ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 -- 172.21.15.88:0/4166839109 >> 172.21.15.88:0/4166839109 conn(0x7f0120064bb0 msgr2=0x7f012005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 -- 172.21.15.88:0/4166839109 shutdown_connections 2023-10-18T19:42:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.036+0000 7f01267ff700 1 -- 172.21.15.88:0/4166839109 wait complete. 2023-10-18T19:42:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.038+0000 7f01267ff700 1 Processor -- start 2023-10-18T19:42:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.038+0000 7f01267ff700 1 -- start start 2023-10-18T19:42:26.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200a34a0 0x7f0120092c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f01200a38c0 0x7f0120148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200ac350 con 0x7f01200a34a0 2023-10-18T19:42:26.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01200ac4c0 con 0x7f012005e960 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f01267ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0120093b40 con 0x7f01200a38c0 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:49234/0 (socket says 172.21.15.88:49234) 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 -- 172.21.15.88:0/2580358206 learned_addr learned my addr 172.21.15.88:0/2580358206 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011f7fe700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200a34a0 0x7f0120092c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:26.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f0124d9c700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f01200a38c0 0x7f0120148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:26.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 -- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f01200a38c0 msgr2=0x7f0120148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f01200a38c0 0x7f0120148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 -- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200a34a0 msgr2=0x7f0120092c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200a34a0 0x7f0120092c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.039+0000 7f011ffff700 1 -- 172.21.15.88:0/2580358206 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118009ae0 con 0x7f012005e960 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f011ffff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0110009e00 tx=0x7f0110017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000f7e0 con 0x7f012005e960 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000f960 con 0x7f012005e960 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01100092a0 con 0x7f012005e960 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011001b660 con 0x7f012005e960 2023-10-18T19:42:26.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.040+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0120094090 con 0x7f012005e960 2023-10-18T19:42:26.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.041+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0120064780 con 0x7f012005e960 2023-10-18T19:42:26.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.041+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f011001b9d0 con 0x7f012005e960 2023-10-18T19:42:26.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.042+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0110057110 con 0x7f012005e960 2023-10-18T19:42:26.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.045+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0110007a40 con 0x7f012005e960 2023-10-18T19:42:26.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.213+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f01200a3d00 con 0x7f012005e960 2023-10-18T19:42:26.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.213+0000 7f0107fff700 1 -- 172.21.15.88:0/2580358206 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f011001f130 con 0x7f012005e960 2023-10-18T19:42:26.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:26.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 >> v1:172.21.15.88:6800/113625 conn(0x7f010c041bc0 legacy=0x7f010c044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 msgr2=0x7f0120094870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:26.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0110009e00 tx=0x7f0110017000).stop 2023-10-18T19:42:26.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 shutdown_connections 2023-10-18T19:42:26.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f01200a38c0 0x7f0120148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f012005e960 0x7f0120094870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 --2- 172.21.15.88:0/2580358206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200a34a0 0x7f0120092c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:26.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 >> 172.21.15.88:0/2580358206 conn(0x7f0120064bb0 msgr2=0x7f01200af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:26.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 shutdown_connections 2023-10-18T19:42:26.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:26.215+0000 7f01267ff700 1 -- 172.21.15.88:0/2580358206 wait complete. 2023-10-18T19:42:26.235 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:29.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.432+0000 7f08243ff700 1 Processor -- start 2023-10-18T19:42:29.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.433+0000 7f08243ff700 1 -- start start 2023-10-18T19:42:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f08243ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:29.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f08243ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 0x7f081c1433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f08243ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c05e630 con 0x7f081c05e250 2023-10-18T19:42:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f08243ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0a7260 con 0x7f081c0a8b70 2023-10-18T19:42:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f08243ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081c0a8060 con 0x7f081c0a1580 2023-10-18T19:42:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:29.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082219b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f081c05e250 0x7f081c0a6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59300/0 (socket says 172.21.15.88:59300) 2023-10-18T19:42:29.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082219b700 1 -- 172.21.15.88:0/274266374 learned_addr learned my addr 172.21.15.88:0/274266374 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:29.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082299c700 1 --2- 172.21.15.88:0/274266374 >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 0x7f081c1433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:29.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 -- 172.21.15.88:0/274266374 >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 msgr2=0x7f081c1433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:29.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 --2- 172.21.15.88:0/274266374 >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 0x7f081c1433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 -- 172.21.15.88:0/274266374 >> v1:172.21.15.88:6789/0 conn(0x7f081c05e250 legacy=0x7f081c0a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 -- 172.21.15.88:0/274266374 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c0a2350 con 0x7f081c0a1580 2023-10-18T19:42:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082299c700 1 --2- 172.21.15.88:0/274266374 >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 0x7f081c1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.434+0000 7f082199a700 1 --2- 172.21.15.88:0/274266374 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c0a8680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f080c009760 tx=0x7f080c009060).ready entity=mon.2 client_cookie=e32d2e35c9b87720 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:29.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f0821199700 1 -- 172.21.15.88:0/274266374 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00f510 con 0x7f081c0a1580 2023-10-18T19:42:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f0821199700 1 -- 172.21.15.88:0/274266374 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c00f670 con 0x7f081c0a1580 2023-10-18T19:42:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f0821199700 1 -- 172.21.15.88:0/274266374 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00f9f0 con 0x7f081c0a1580 2023-10-18T19:42:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 -- 172.21.15.88:0/274266374 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 msgr2=0x7f081c0a8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 --2- 172.21.15.88:0/274266374 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c0a8680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f080c009760 tx=0x7f080c009060).stop 2023-10-18T19:42:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 -- 172.21.15.88:0/274266374 shutdown_connections 2023-10-18T19:42:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 --2- 172.21.15.88:0/274266374 >> v2:172.21.15.88:3300/0 conn(0x7f081c0a8b70 0x7f081c1433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 --2- 172.21.15.88:0/274266374 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c0a8680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 -- 172.21.15.88:0/274266374 >> 172.21.15.88:0/274266374 conn(0x7f081c0665a0 msgr2=0x7f081c0625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 -- 172.21.15.88:0/274266374 shutdown_connections 2023-10-18T19:42:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.435+0000 7f08243ff700 1 -- 172.21.15.88:0/274266374 wait complete. 2023-10-18T19:42:29.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 Processor -- start 2023-10-18T19:42:29.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 -- start start 2023-10-18T19:42:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 0x7f081c0ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c1182a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c1351b0 con 0x7f081c0a8b70 2023-10-18T19:42:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c118a60 con 0x7f081c05e250 2023-10-18T19:42:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.437+0000 7f08243ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081c118d70 con 0x7f081c0a1580 2023-10-18T19:42:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082219b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 0x7f081c0ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35890/0 (socket says 172.21.15.88:35890) 2023-10-18T19:42:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 -- 172.21.15.88:0/248049123 learned_addr learned my addr 172.21.15.88:0/248049123 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082199a700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c1182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 -- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 msgr2=0x7f081c1182a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c1182a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 -- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 msgr2=0x7f081c0ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 0x7f081c0ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 -- 172.21.15.88:0/248049123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814009a20 con 0x7f081c0a8b70 2023-10-18T19:42:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082219b700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 0x7f081c0ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082199a700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c1182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f082299c700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f0814009ef0 tx=0x7f081400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.438+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400cb70 con 0x7f081c0a8b70 2023-10-18T19:42:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.439+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081400f040 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.439+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c0092a0 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.439+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0814013400 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.439+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c148a50 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.440+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c05f270 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.440+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f0814013770 con 0x7f081c0a8b70 2023-10-18T19:42:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.440+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0814055e90 con 0x7f081c0a8b70 2023-10-18T19:42:29.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.444+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0814036270 con 0x7f081c0a8b70 2023-10-18T19:42:29.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.617+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f081c148a50 con 0x7f081c0a8b70 2023-10-18T19:42:29.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.617+0000 7f08127fc700 1 -- 172.21.15.88:0/248049123 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f081c148a50 con 0x7f081c0a8b70 2023-10-18T19:42:29.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 >> v1:172.21.15.88:6800/113625 conn(0x7f0800041bc0 legacy=0x7f0800044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 msgr2=0x7f081c148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f0814009ef0 tx=0x7f081400b040).stop 2023-10-18T19:42:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 shutdown_connections 2023-10-18T19:42:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f081c0a8b70 0x7f081c148e20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f081c05e250 0x7f081c0ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 --2- 172.21.15.88:0/248049123 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f081c0a1580 0x7f081c1182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 >> 172.21.15.88:0/248049123 conn(0x7f081c0665a0 msgr2=0x7f081c136060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 shutdown_connections 2023-10-18T19:42:29.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:29.619+0000 7f08243ff700 1 -- 172.21.15.88:0/248049123 wait complete. 2023-10-18T19:42:29.638 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:32.640 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.832+0000 7f26cfbff700 1 Processor -- start 2023-10-18T19:42:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.832+0000 7f26cfbff700 1 -- start start 2023-10-18T19:42:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c809d700 con 0x7f26c806a0f0 2023-10-18T19:42:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8063280 con 0x7f26c8062ea0 2023-10-18T19:42:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.833+0000 7f26cfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80aa620 con 0x7f26c80aa190 2023-10-18T19:42:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26ce19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd19a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:49246/0 (socket says 172.21.15.88:49246) 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26ce19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35896/0 (socket says 172.21.15.88:35896) 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd19a700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:41360/0 (socket says 172.21.15.88:41360) 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 -- 172.21.15.88:0/2909164233 learned_addr learned my addr 172.21.15.88:0/2909164233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 -- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 msgr2=0x7f26c8069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 -- 172.21.15.88:0/2909164233 >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 msgr2=0x7f26c80636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 --2- 172.21.15.88:0/2909164233 >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 -- 172.21.15.88:0/2909164233 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80aa8c0 con 0x7f26c8062ea0 2023-10-18T19:42:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26ce19c700 1 --2- 172.21.15.88:0/2909164233 >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd19a700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cd99b700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f26c4006fd0 tx=0x7f26c40090f0).ready entity=mon.1 client_cookie=78f97c52a2be2d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cc999700 1 -- 172.21.15.88:0/2909164233 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400b530 con 0x7f26c8062ea0 2023-10-18T19:42:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cc999700 1 -- 172.21.15.88:0/2909164233 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400b690 con 0x7f26c8062ea0 2023-10-18T19:42:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.834+0000 7f26cc999700 1 -- 172.21.15.88:0/2909164233 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400ba10 con 0x7f26c8062ea0 2023-10-18T19:42:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 -- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 msgr2=0x7f26c809db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f26c4006fd0 tx=0x7f26c40090f0).stop 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 -- 172.21.15.88:0/2909164233 shutdown_connections 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 --2- 172.21.15.88:0/2909164233 >> v2:172.21.15.88:3300/0 conn(0x7f26c806a0f0 0x7f26c80636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8062ea0 0x7f26c809db50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 --2- 172.21.15.88:0/2909164233 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c80aa190 0x7f26c8069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 -- 172.21.15.88:0/2909164233 >> 172.21.15.88:0/2909164233 conn(0x7f26c8067ef0 msgr2=0x7f26c80625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 -- 172.21.15.88:0/2909164233 shutdown_connections 2023-10-18T19:42:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.835+0000 7f26cfbff700 1 -- 172.21.15.88:0/2909164233 wait complete. 2023-10-18T19:42:32.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.836+0000 7f26cfbff700 1 Processor -- start 2023-10-18T19:42:32.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.836+0000 7f26cfbff700 1 -- start start 2023-10-18T19:42:32.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8092d10 0x7f26c8093130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c813abe0 0x7f26c813b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c80949f0 con 0x7f26c813abe0 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8095640 con 0x7f26c8092d10 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cfbff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8094230 con 0x7f26c8062ea0 2023-10-18T19:42:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.837+0000 7f26cd99b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:41370/0 (socket says 172.21.15.88:41370) 2023-10-18T19:42:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 -- 172.21.15.88:0/654970624 learned_addr learned my addr 172.21.15.88:0/654970624 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26ce19c700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c813abe0 0x7f26c813b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd19a700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8092d10 0x7f26c8093130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 -- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8092d10 msgr2=0x7f26c8093130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8092d10 0x7f26c8093130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 -- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c813abe0 msgr2=0x7f26c813b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c813abe0 0x7f26c813b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 -- 172.21.15.88:0/654970624 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009a20 con 0x7f26c8062ea0 2023-10-18T19:42:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cd99b700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f26c40092f0 tx=0x7f26c4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c400be50 con 0x7f26c8062ea0 2023-10-18T19:42:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c400b800 con 0x7f26c8062ea0 2023-10-18T19:42:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80092a0 con 0x7f26c8062ea0 2023-10-18T19:42:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.838+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c401c670 con 0x7f26c8062ea0 2023-10-18T19:42:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.839+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c4009370 con 0x7f26c8062ea0 2023-10-18T19:42:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.840+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c805f270 con 0x7f26c8062ea0 2023-10-18T19:42:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.840+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f26c401c9e0 con 0x7f26c8062ea0 2023-10-18T19:42:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.840+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f26c4057250 con 0x7f26c8062ea0 2023-10-18T19:42:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:32.844+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f26c403ae20 con 0x7f26c8062ea0 2023-10-18T19:42:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.010+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26c8092b60 con 0x7f26c8062ea0 2023-10-18T19:42:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.011+0000 7f26bdffb700 1 -- 172.21.15.88:0/654970624 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f26c400b970 con 0x7f26c8062ea0 2023-10-18T19:42:33.014 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 >> v1:172.21.15.88:6800/113625 conn(0x7f26ac041bf0 legacy=0x7f26ac0440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 msgr2=0x7f26c8093d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f26c40092f0 tx=0x7f26c4017000).stop 2023-10-18T19:42:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 shutdown_connections 2023-10-18T19:42:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c813abe0 0x7f26c813b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c8062ea0 0x7f26c8093d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 --2- 172.21.15.88:0/654970624 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c8092d10 0x7f26c8093130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 >> 172.21.15.88:0/654970624 conn(0x7f26c8067ef0 msgr2=0x7f26c813c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 shutdown_connections 2023-10-18T19:42:33.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:33.013+0000 7f26cfbff700 1 -- 172.21.15.88:0/654970624 wait complete. 2023-10-18T19:42:33.032 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:36.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.229+0000 7f8c7a9ff700 1 Processor -- start 2023-10-18T19:42:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.230+0000 7f8c7a9ff700 1 -- start start 2023-10-18T19:42:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c7a9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 0x7f8c740a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c7a9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c741433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c7a9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7405ed40 con 0x7f8c740a4a20 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c7a9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a3a70 con 0x7f8c7405e960 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c7a9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a2ac0 con 0x7f8c741363e0 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 0x7f8c740a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c78f9c700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c741433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c737fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c740a4a20 0x7f8c74135cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35606/0 (socket says 172.21.15.88:35606) 2023-10-18T19:42:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c737fe700 1 -- 172.21.15.88:0/2940225635 learned_addr learned my addr 172.21.15.88:0/2940225635 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c78f9c700 1 -- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 msgr2=0x7f8c740a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c78f9c700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 0x7f8c740a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c78f9c700 1 -- 172.21.15.88:0/2940225635 >> v1:172.21.15.88:6789/0 conn(0x7f8c740a4a20 legacy=0x7f8c74135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c78f9c700 1 -- 172.21.15.88:0/2940225635 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740a2d60 con 0x7f8c741363e0 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c73fff700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 0x7f8c740a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.231+0000 7f8c72ffd700 1 -- 172.21.15.88:0/2940225635 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737638309 0 0) 0x7f8c7405ed40 con 0x7f8c740a4a20 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c78f9c700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c741433f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8c6c009e90 tx=0x7f8c6c009780).ready entity=mon.2 client_cookie=be93bdc2b0d2740b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c72ffd700 1 -- 172.21.15.88:0/2940225635 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00e070 con 0x7f8c741363e0 2023-10-18T19:42:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c72ffd700 1 -- 172.21.15.88:0/2940225635 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c00bbf0 con 0x7f8c741363e0 2023-10-18T19:42:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c72ffd700 1 -- 172.21.15.88:0/2940225635 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c012410 con 0x7f8c741363e0 2023-10-18T19:42:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 msgr2=0x7f8c741433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c741433f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f8c6c009e90 tx=0x7f8c6c009780).stop 2023-10-18T19:42:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/2940225635 shutdown_connections 2023-10-18T19:42:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c741433f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/2940225635 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c7405e960 0x7f8c740a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/2940225635 >> 172.21.15.88:0/2940225635 conn(0x7f8c74064bb0 msgr2=0x7f8c7405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/2940225635 shutdown_connections 2023-10-18T19:42:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.232+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/2940225635 wait complete. 2023-10-18T19:42:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.234+0000 7f8c7a9ff700 1 Processor -- start 2023-10-18T19:42:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.234+0000 7f8c7a9ff700 1 -- start start 2023-10-18T19:42:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c740a4a20 0x7f8c740a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c74138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a6230 con 0x7f8c7405e960 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a8090 con 0x7f8c740a4a20 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c7a9ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740a7e20 con 0x7f8c741363e0 2023-10-18T19:42:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49274/0 (socket says 172.21.15.88:49274) 2023-10-18T19:42:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 -- 172.21.15.88:0/3707929517 learned_addr learned my addr 172.21.15.88:0/3707929517 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c737fe700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c740a4a20 0x7f8c740a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c78f9c700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c74138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 -- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 msgr2=0x7f8c74138b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c74138b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 -- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c740a4a20 msgr2=0x7f8c740a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c740a4a20 0x7f8c740a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 -- 172.21.15.88:0/3707929517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640092a0 con 0x7f8c7405e960 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.235+0000 7f8c73fff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f8c6400e980 tx=0x7f8c64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.236+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64012600 con 0x7f8c7405e960 2023-10-18T19:42:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.236+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64012760 con 0x7f8c7405e960 2023-10-18T19:42:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.236+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64012ae0 con 0x7f8c7405e960 2023-10-18T19:42:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.236+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c009a20 con 0x7f8c7405e960 2023-10-18T19:42:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.236+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c740a78c0 con 0x7f8c7405e960 2023-10-18T19:42:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.237+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f8c6401b400 con 0x7f8c7405e960 2023-10-18T19:42:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.237+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7405f270 con 0x7f8c7405e960 2023-10-18T19:42:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.237+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f8c64055c70 con 0x7f8c7405e960 2023-10-18T19:42:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.241+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f8c64035fb0 con 0x7f8c7405e960 2023-10-18T19:42:36.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.415+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c740a1100 con 0x7f8c7405e960 2023-10-18T19:42:36.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.415+0000 7f8c5bfff700 1 -- 172.21.15.88:0/3707929517 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f8c640397a0 con 0x7f8c7405e960 2023-10-18T19:42:36.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 >> v1:172.21.15.88:6800/113625 conn(0x7f8c60041bc0 legacy=0x7f8c60044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 msgr2=0x7f8c740a73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f8c6400e980 tx=0x7f8c64009060).stop 2023-10-18T19:42:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 shutdown_connections 2023-10-18T19:42:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8c741363e0 0x7f8c74138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.417+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c7405e960 0x7f8c740a73d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.418+0000 7f8c7a9ff700 1 --2- 172.21.15.88:0/3707929517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c740a4a20 0x7f8c740a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.418+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 >> 172.21.15.88:0/3707929517 conn(0x7f8c74064bb0 msgr2=0x7f8c74135aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.418+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 shutdown_connections 2023-10-18T19:42:36.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:36.418+0000 7f8c7a9ff700 1 -- 172.21.15.88:0/3707929517 wait complete. 2023-10-18T19:42:36.437 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:39.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:39.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.634+0000 7f84249ff700 1 Processor -- start 2023-10-18T19:42:39.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.634+0000 7f84249ff700 1 -- start start 2023-10-18T19:42:39.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f84249ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f842009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f84249ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 0x7f8420069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f84249ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842009d700 con 0x7f842006a0f0 2023-10-18T19:42:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f84249ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8420063280 con 0x7f8420062ea0 2023-10-18T19:42:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f84249ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84200aa620 con 0x7f84200aa190 2023-10-18T19:42:39.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f841e59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f842009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f841dd9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 0x7f8420069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f841ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f842006a0f0 0x7f84200636e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35616/0 (socket says 172.21.15.88:35616) 2023-10-18T19:42:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.635+0000 7f841ed9d700 1 -- 172.21.15.88:0/486482952 learned_addr learned my addr 172.21.15.88:0/486482952 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841d59a700 1 -- 172.21.15.88:0/486482952 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521391982 0 0) 0x7f842009d700 con 0x7f842006a0f0 2023-10-18T19:42:39.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841e59c700 1 -- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 msgr2=0x7f8420069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841e59c700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 0x7f8420069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841e59c700 1 -- 172.21.15.88:0/486482952 >> v1:172.21.15.88:6789/0 conn(0x7f842006a0f0 legacy=0x7f84200636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841e59c700 1 -- 172.21.15.88:0/486482952 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200aa8c0 con 0x7f8420062ea0 2023-10-18T19:42:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841dd9b700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 0x7f8420069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:39.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841e59c700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f842009db50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8410009790 tx=0x7f8410009060).ready entity=mon.1 client_cookie=9a873debdfca1445 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841d59a700 1 -- 172.21.15.88:0/486482952 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000b590 con 0x7f8420062ea0 2023-10-18T19:42:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841d59a700 1 -- 172.21.15.88:0/486482952 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b6f0 con 0x7f8420062ea0 2023-10-18T19:42:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.636+0000 7f841d59a700 1 -- 172.21.15.88:0/486482952 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000ba70 con 0x7f8420062ea0 2023-10-18T19:42:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 -- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 msgr2=0x7f842009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f842009db50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f8410009790 tx=0x7f8410009060).stop 2023-10-18T19:42:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 -- 172.21.15.88:0/486482952 shutdown_connections 2023-10-18T19:42:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f842009db50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 --2- 172.21.15.88:0/486482952 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f84200aa190 0x7f8420069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 -- 172.21.15.88:0/486482952 >> 172.21.15.88:0/486482952 conn(0x7f8420067ef0 msgr2=0x7f84200625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:39.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 -- 172.21.15.88:0/486482952 shutdown_connections 2023-10-18T19:42:39.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.637+0000 7f84249ff700 1 -- 172.21.15.88:0/486482952 wait complete. 2023-10-18T19:42:39.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.638+0000 7f84249ff700 1 Processor -- start 2023-10-18T19:42:39.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.638+0000 7f84249ff700 1 -- start start 2023-10-18T19:42:39.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f84200969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:39.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 0x7f8420147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8420148270 0x7f842014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84201494d0 con 0x7f8420148270 2023-10-18T19:42:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8420148ac0 con 0x7f8420062ea0 2023-10-18T19:42:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f84249ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8420148d60 con 0x7f8420095990 2023-10-18T19:42:39.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f841dd9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 0x7f8420147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f841e59c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f84200969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f841dd9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 0x7f8420147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35744/0 (socket says 172.21.15.88:35744) 2023-10-18T19:42:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f841dd9b700 1 -- 172.21.15.88:0/2552399218 learned_addr learned my addr 172.21.15.88:0/2552399218 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.639+0000 7f841ed9d700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8420148270 0x7f842014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:39.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 -- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 msgr2=0x7f8420147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 0x7f8420147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 -- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8420148270 msgr2=0x7f842014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8420148270 0x7f842014bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 -- 172.21.15.88:0/2552399218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140092a0 con 0x7f8420062ea0 2023-10-18T19:42:39.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f841e59c700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f84200969b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8410014000 tx=0x7f8410017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:39.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410009e60 con 0x7f8420062ea0 2023-10-18T19:42:39.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b860 con 0x7f8420062ea0 2023-10-18T19:42:39.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100092a0 con 0x7f8420062ea0 2023-10-18T19:42:39.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841001b640 con 0x7f8420062ea0 2023-10-18T19:42:39.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.640+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8420095480 con 0x7f8420062ea0 2023-10-18T19:42:39.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.641+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842005f270 con 0x7f8420062ea0 2023-10-18T19:42:39.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.642+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f841001b9f0 con 0x7f8420062ea0 2023-10-18T19:42:39.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.642+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f8410056f30 con 0x7f8420062ea0 2023-10-18T19:42:39.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.645+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f841003aed0 con 0x7f8420062ea0 2023-10-18T19:42:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.812+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8420065200 con 0x7f8420062ea0 2023-10-18T19:42:39.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.813+0000 7f840e7fc700 1 -- 172.21.15.88:0/2552399218 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f841000b9d0 con 0x7f8420062ea0 2023-10-18T19:42:39.816 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:39.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 >> v1:172.21.15.88:6800/113625 conn(0x7f8400041bf0 legacy=0x7f84000440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 msgr2=0x7f84200969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f84200969b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8410014000 tx=0x7f8410017000).stop 2023-10-18T19:42:39.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 shutdown_connections 2023-10-18T19:42:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8420148270 0x7f842014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8420062ea0 0x7f84200969b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 --2- 172.21.15.88:0/2552399218 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f8420095990 0x7f8420147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:39.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 >> 172.21.15.88:0/2552399218 conn(0x7f8420067ef0 msgr2=0x7f842013ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:39.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 shutdown_connections 2023-10-18T19:42:39.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:39.815+0000 7f84249ff700 1 -- 172.21.15.88:0/2552399218 wait complete. 2023-10-18T19:42:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:42.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:43.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.033+0000 7f0b9a3ff700 1 Processor -- start 2023-10-18T19:42:43.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.033+0000 7f0b9a3ff700 1 -- start start 2023-10-18T19:42:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9a3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9a3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b940a4c50 0x7f0b94136220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9a3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940afd50 con 0x7f0b940a1790 2023-10-18T19:42:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9a3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940a47a0 con 0x7f0b940a4c50 2023-10-18T19:42:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9a3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940a3a10 con 0x7f0b940af970 2023-10-18T19:42:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9899c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b940a4c50 0x7f0b94136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9899c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b940a4c50 0x7f0b94136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49286/0 (socket says 172.21.15.88:49286) 2023-10-18T19:42:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:38560/0 (socket says 172.21.15.88:38560) 2023-10-18T19:42:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b9899c700 1 -- 172.21.15.88:0/2785737439 learned_addr learned my addr 172.21.15.88:0/2785737439 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.034+0000 7f0b937fe700 1 --1- 172.21.15.88:0/2785737439 >> v1:172.21.15.88:6789/0 conn(0x7f0b940a1790 0x7f0b9413bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35620/0 (socket says 172.21.15.88:35620) 2023-10-18T19:42:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b9899c700 1 -- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 msgr2=0x7f0b94135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b9899c700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b9899c700 1 -- 172.21.15.88:0/2785737439 >> v1:172.21.15.88:6789/0 conn(0x7f0b940a1790 legacy=0x7f0b9413bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b9899c700 1 -- 172.21.15.88:0/2785737439 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940a32d0 con 0x7f0b940a4c50 2023-10-18T19:42:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b93fff700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b9899c700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940a4c50 0x7f0b94136220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f0b8c009f20 tx=0x7f0b8c009840).ready entity=mon.0 client_cookie=16fa05ce153e70c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b92ffd700 1 -- 172.21.15.88:0/2785737439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00e070 con 0x7f0b940a4c50 2023-10-18T19:42:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b92ffd700 1 -- 172.21.15.88:0/2785737439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c00b9d0 con 0x7f0b940a4c50 2023-10-18T19:42:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.035+0000 7f0b92ffd700 1 -- 172.21.15.88:0/2785737439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c00bd50 con 0x7f0b940a4c50 2023-10-18T19:42:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940a4c50 msgr2=0x7f0b94136220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940a4c50 0x7f0b94136220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f0b8c009f20 tx=0x7f0b8c009840).stop 2023-10-18T19:42:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2785737439 shutdown_connections 2023-10-18T19:42:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940a4c50 0x7f0b94136220 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2785737439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940af970 0x7f0b94135d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2785737439 >> 172.21.15.88:0/2785737439 conn(0x7f0b9405eb60 msgr2=0x7f0b940af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2785737439 shutdown_connections 2023-10-18T19:42:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.036+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2785737439 wait complete. 2023-10-18T19:42:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.037+0000 7f0b9a3ff700 1 Processor -- start 2023-10-18T19:42:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.037+0000 7f0b9a3ff700 1 -- start start 2023-10-18T19:42:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940a4c50 0x7f0b940ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940af970 0x7f0b9414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9414c070 con 0x7f0b940af970 2023-10-18T19:42:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940a7e00 con 0x7f0b940a4c50 2023-10-18T19:42:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9a3ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94149720 con 0x7f0b940a1790 2023-10-18T19:42:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b93fff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:35752/0 (socket says 172.21.15.88:35752) 2023-10-18T19:42:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b93fff700 1 -- 172.21.15.88:0/2365494357 learned_addr learned my addr 172.21.15.88:0/2365494357 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b937fe700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940a4c50 0x7f0b940ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.038+0000 7f0b9899c700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940af970 0x7f0b9414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 -- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940a4c50 msgr2=0x7f0b940ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940a4c50 0x7f0b940ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 -- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940af970 msgr2=0x7f0b9414c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940af970 0x7f0b9414c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 -- 172.21.15.88:0/2365494357 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b840092a0 con 0x7f0b940a1790 2023-10-18T19:42:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b93fff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0b8400e980 tx=0x7f0b84009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84012600 con 0x7f0b940a1790 2023-10-18T19:42:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b84012760 con 0x7f0b940a1790 2023-10-18T19:42:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c009ae0 con 0x7f0b940a1790 2023-10-18T19:42:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84012ae0 con 0x7f0b940a1790 2023-10-18T19:42:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.039+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940a95f0 con 0x7f0b940a1790 2023-10-18T19:42:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.040+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940a7fc0 con 0x7f0b940a1790 2023-10-18T19:42:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.040+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f0b8401b400 con 0x7f0b940a1790 2023-10-18T19:42:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.041+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f0b84055cc0 con 0x7f0b940a1790 2023-10-18T19:42:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.044+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f0b84036000 con 0x7f0b940a1790 2023-10-18T19:42:43.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.215+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0b9405f270 con 0x7f0b940a1790 2023-10-18T19:42:43.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.215+0000 7f0b7bfff700 1 -- 172.21.15.88:0/2365494357 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f0b840397f0 con 0x7f0b940a1790 2023-10-18T19:42:43.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:43.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 >> v1:172.21.15.88:6800/113625 conn(0x7f0b80041bc0 legacy=0x7f0b80044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 msgr2=0x7f0b94149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f0b8400e980 tx=0x7f0b84009060).stop 2023-10-18T19:42:43.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 shutdown_connections 2023-10-18T19:42:43.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b940af970 0x7f0b9414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f0b940a1790 0x7f0b94149230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 --2- 172.21.15.88:0/2365494357 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0b940a4c50 0x7f0b940ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.217+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 >> 172.21.15.88:0/2365494357 conn(0x7f0b9405eb60 msgr2=0x7f0b940ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:43.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.218+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 shutdown_connections 2023-10-18T19:42:43.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:43.218+0000 7f0b9a3ff700 1 -- 172.21.15.88:0/2365494357 wait complete. 2023-10-18T19:42:43.236 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:46.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:46.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.435+0000 7fe2e4b9d700 1 Processor -- start 2023-10-18T19:42:46.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.435+0000 7fe2e4b9d700 1 -- start start 2023-10-18T19:42:46.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2e4b9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 0x7fe2e00a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:46.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2e4b9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2e0139090 0x7fe2e0139540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:46.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2e4b9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e00ab9e0 con 0x7fe2e00ab600 2023-10-18T19:42:46.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2e4b9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e009eda0 con 0x7fe2e0139090 2023-10-18T19:42:46.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2e4b9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e006ac50 con 0x7fe2e00a0250 2023-10-18T19:42:46.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 0x7fe2e00a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:46.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2df7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe2e00ab600 0x7fe2e009e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33566/0 (socket says 172.21.15.88:33566) 2023-10-18T19:42:46.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2df7fe700 1 -- 172.21.15.88:0/66421029 learned_addr learned my addr 172.21.15.88:0/66421029 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:46.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.436+0000 7fe2dffff700 1 --2- 172.21.15.88:0/66421029 >> v2:172.21.15.88:3300/0 conn(0x7fe2e0139090 0x7fe2e0139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2deffd700 1 -- 172.21.15.88:0/66421029 >> v2:172.21.15.88:3300/0 conn(0x7fe2e0139090 msgr2=0x7fe2e0139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2de7fc700 1 -- 172.21.15.88:0/66421029 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731422663 0 0) 0x7fe2e00ab9e0 con 0x7fe2e00ab600 2023-10-18T19:42:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2deffd700 1 --2- 172.21.15.88:0/66421029 >> v2:172.21.15.88:3300/0 conn(0x7fe2e0139090 0x7fe2e0139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2deffd700 1 -- 172.21.15.88:0/66421029 >> v1:172.21.15.88:6789/0 conn(0x7fe2e00ab600 legacy=0x7fe2e009e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2deffd700 1 -- 172.21.15.88:0/66421029 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e009ef80 con 0x7fe2e00a0250 2023-10-18T19:42:46.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2deffd700 1 --2- 172.21.15.88:0/66421029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 0x7fe2e00a7ec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe2d4009760 tx=0x7fe2d4009060).ready entity=mon.1 client_cookie=53d596038782841a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:46.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2de7fc700 1 -- 172.21.15.88:0/66421029 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400f510 con 0x7fe2e00a0250 2023-10-18T19:42:46.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2de7fc700 1 -- 172.21.15.88:0/66421029 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400f670 con 0x7fe2e00a0250 2023-10-18T19:42:46.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.437+0000 7fe2de7fc700 1 -- 172.21.15.88:0/66421029 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400f9f0 con 0x7fe2e00a0250 2023-10-18T19:42:46.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/66421029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 msgr2=0x7fe2e00a7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/66421029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 0x7fe2e00a7ec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe2d4009760 tx=0x7fe2d4009060).stop 2023-10-18T19:42:46.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/66421029 shutdown_connections 2023-10-18T19:42:46.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/66421029 >> v2:172.21.15.88:3300/0 conn(0x7fe2e0139090 0x7fe2e0139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/66421029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e00a0250 0x7fe2e00a7ec0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/66421029 >> 172.21.15.88:0/66421029 conn(0x7fe2e005eb60 msgr2=0x7fe2e00aab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:46.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/66421029 shutdown_connections 2023-10-18T19:42:46.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.438+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/66421029 wait complete. 2023-10-18T19:42:46.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.439+0000 7fe2e4b9d700 1 Processor -- start 2023-10-18T19:42:46.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.439+0000 7fe2e4b9d700 1 -- start start 2023-10-18T19:42:46.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 0x7fe2e01323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:46.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:46.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e0139090 0x7fe2e00a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:46.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e009d400 con 0x7fe2e00a0250 2023-10-18T19:42:46.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0131bf0 con 0x7fe2e0139090 2023-10-18T19:42:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2e4b9d700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01329a0 con 0x7fe2e00ab600 2023-10-18T19:42:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2df7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 0x7fe2e01323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47268/0 (socket says 172.21.15.88:47268) 2023-10-18T19:42:46.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2dffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e0139090 0x7fe2e00a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:46.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.440+0000 7fe2deffd700 1 -- 172.21.15.88:0/1088473573 learned_addr learned my addr 172.21.15.88:0/1088473573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:46.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 -- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e0139090 msgr2=0x7fe2e00a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e0139090 0x7fe2e00a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 -- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 msgr2=0x7fe2e01323d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 0x7fe2e01323d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 -- 172.21.15.88:0/1088473573 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40092a0 con 0x7fe2e00ab600 2023-10-18T19:42:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2df7fe700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 0x7fe2e01323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2deffd700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe2e0047600 tx=0x7fe2d4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400f7e0 con 0x7fe2e00ab600 2023-10-18T19:42:46.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400f940 con 0x7fe2e00ab600 2023-10-18T19:42:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e0130dc0 con 0x7fe2e00ab600 2023-10-18T19:42:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d401b660 con 0x7fe2e00ab600 2023-10-18T19:42:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.441+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e00aa1b0 con 0x7fe2e00ab600 2023-10-18T19:42:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.442+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7fe2d401b9d0 con 0x7fe2e00ab600 2023-10-18T19:42:46.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.442+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0067e40 con 0x7fe2e00ab600 2023-10-18T19:42:46.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.443+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7fe2d4057110 con 0x7fe2e00ab600 2023-10-18T19:42:46.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.447+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7fe2d4007a40 con 0x7fe2e00ab600 2023-10-18T19:42:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.614+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2e005f890 con 0x7fe2e00ab600 2023-10-18T19:42:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.614+0000 7fe2c77fe700 1 -- 172.21.15.88:0/1088473573 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7fe2d403ac20 con 0x7fe2e00ab600 2023-10-18T19:42:46.616 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 >> v1:172.21.15.88:6800/113625 conn(0x7fe2cc041bc0 legacy=0x7fe2cc044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 msgr2=0x7fe2e012eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fe2e0047600 tx=0x7fe2d4017000).stop 2023-10-18T19:42:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 shutdown_connections 2023-10-18T19:42:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2e0139090 0x7fe2e00a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2e00a0250 0x7fe2e01323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 --2- 172.21.15.88:0/1088473573 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7fe2e00ab600 0x7fe2e012eae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 >> 172.21.15.88:0/1088473573 conn(0x7fe2e005eb60 msgr2=0x7fe2e01406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 shutdown_connections 2023-10-18T19:42:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:46.616+0000 7fe2e4b9d700 1 -- 172.21.15.88:0/1088473573 wait complete. 2023-10-18T19:42:46.635 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:49.636 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:49.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.831+0000 7f26ca1ff700 1 Processor -- start 2023-10-18T19:42:49.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.831+0000 7f26ca1ff700 1 -- start start 2023-10-18T19:42:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26ca1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 0x7f26c4135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26ca1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 0x7f26c41433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26ca1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c405ed40 con 0x7f26c405e960 2023-10-18T19:42:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26ca1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c4136670 con 0x7f26c41361c0 2023-10-18T19:42:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26ca1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40a2ac0 con 0x7f26c40a3580 2023-10-18T19:42:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26c37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f26c405e960 0x7f26c40a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:33568/0 (socket says 172.21.15.88:33568) 2023-10-18T19:42:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26c2ffd700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 0x7f26c4135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26c37fe700 1 -- 172.21.15.88:0/3433362536 learned_addr learned my addr 172.21.15.88:0/3433362536 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-18T19:42:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.832+0000 7f26c3fff700 1 --2- 172.21.15.88:0/3433362536 >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 0x7f26c41433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c2ffd700 1 -- 172.21.15.88:0/3433362536 >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 msgr2=0x7f26c41433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c2ffd700 1 --2- 172.21.15.88:0/3433362536 >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 0x7f26c41433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c2ffd700 1 -- 172.21.15.88:0/3433362536 >> v1:172.21.15.88:6789/0 conn(0x7f26c405e960 legacy=0x7f26c40a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c2ffd700 1 -- 172.21.15.88:0/3433362536 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40a2d60 con 0x7f26c40a3580 2023-10-18T19:42:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c3fff700 1 --2- 172.21.15.88:0/3433362536 >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 0x7f26c41433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c2ffd700 1 --2- 172.21.15.88:0/3433362536 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 0x7f26c4135cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f26b8009760 tx=0x7f26b8009060).ready entity=mon.2 client_cookie=4c908d4e1a1917ae server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c27fc700 1 -- 172.21.15.88:0/3433362536 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800b590 con 0x7f26c40a3580 2023-10-18T19:42:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c27fc700 1 -- 172.21.15.88:0/3433362536 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b6f0 con 0x7f26c40a3580 2023-10-18T19:42:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.833+0000 7f26c27fc700 1 -- 172.21.15.88:0/3433362536 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800ba70 con 0x7f26c40a3580 2023-10-18T19:42:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 -- 172.21.15.88:0/3433362536 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 msgr2=0x7f26c4135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/3433362536 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 0x7f26c4135cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f26b8009760 tx=0x7f26b8009060).stop 2023-10-18T19:42:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 -- 172.21.15.88:0/3433362536 shutdown_connections 2023-10-18T19:42:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/3433362536 >> v2:172.21.15.88:3300/0 conn(0x7f26c41361c0 0x7f26c41433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/3433362536 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c40a3580 0x7f26c4135cd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 -- 172.21.15.88:0/3433362536 >> 172.21.15.88:0/3433362536 conn(0x7f26c4064bb0 msgr2=0x7f26c405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 -- 172.21.15.88:0/3433362536 shutdown_connections 2023-10-18T19:42:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.834+0000 7f26ca1ff700 1 -- 172.21.15.88:0/3433362536 wait complete. 2023-10-18T19:42:49.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.835+0000 7f26ca1ff700 1 Processor -- start 2023-10-18T19:42:49.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.835+0000 7f26ca1ff700 1 -- start start 2023-10-18T19:42:49.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 0x7f26c40a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:49.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:49.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c41361c0 0x7f26c40a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:49.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40a7030 con 0x7f26c40a3580 2023-10-18T19:42:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40a6c80 con 0x7f26c405e960 2023-10-18T19:42:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26ca1ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c414cb10 con 0x7f26c41361c0 2023-10-18T19:42:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 0x7f26c40a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55514/0 (socket says 172.21.15.88:55514) 2023-10-18T19:42:49.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26c2ffd700 1 -- 172.21.15.88:0/1488215704 learned_addr learned my addr 172.21.15.88:0/1488215704 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:49.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.836+0000 7f26c3fff700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c41361c0 0x7f26c40a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:49.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 -- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c41361c0 msgr2=0x7f26c40a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:49.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c41361c0 0x7f26c40a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:49.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 -- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 msgr2=0x7f26c40a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:49.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 0x7f26c40a7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:49.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 -- 172.21.15.88:0/1488215704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc009a20 con 0x7f26c40a3580 2023-10-18T19:42:49.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c37fe700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 0x7f26c40a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:49.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26c2ffd700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f26c40a2c00 tx=0x7f26b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:49.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800b860 con 0x7f26c40a3580 2023-10-18T19:42:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b9c0 con 0x7f26c40a3580 2023-10-18T19:42:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80092a0 con 0x7f26c40a3580 2023-10-18T19:42:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b801b660 con 0x7f26c40a3580 2023-10-18T19:42:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.837+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40a7210 con 0x7f26c40a3580 2023-10-18T19:42:49.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.838+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c405f270 con 0x7f26c40a3580 2023-10-18T19:42:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.838+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f26b801ba50 con 0x7f26c40a3580 2023-10-18T19:42:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.839+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f26b80570f0 con 0x7f26c40a3580 2023-10-18T19:42:49.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:49.843+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f26b803afd0 con 0x7f26c40a3580 2023-10-18T19:42:50.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.010+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26c40a1100 con 0x7f26c40a3580 2023-10-18T19:42:50.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.011+0000 7f26ab7fe700 1 -- 172.21.15.88:0/1488215704 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f26b803abc0 con 0x7f26c40a3580 2023-10-18T19:42:50.013 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:50.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 >> v1:172.21.15.88:6800/113625 conn(0x7f26b0041bf0 legacy=0x7f26b00440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:50.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 msgr2=0x7f26c414c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:50.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f26c40a2c00 tx=0x7f26b8017000).stop 2023-10-18T19:42:50.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 shutdown_connections 2023-10-18T19:42:50.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f26c41361c0 0x7f26c40a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:50.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f26c405e960 0x7f26c40a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:50.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 --2- 172.21.15.88:0/1488215704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f26c40a3580 0x7f26c414c140 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:50.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 >> 172.21.15.88:0/1488215704 conn(0x7f26c4064bb0 msgr2=0x7f26c4139e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:50.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 shutdown_connections 2023-10-18T19:42:50.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:50.012+0000 7f26ca1ff700 1 -- 172.21.15.88:0/1488215704 wait complete. 2023-10-18T19:42:50.031 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:53.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.230+0000 7f2ab91ff700 1 Processor -- start 2023-10-18T19:42:53.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.230+0000 7f2ab91ff700 1 -- start start 2023-10-18T19:42:53.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab91ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:53.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab91ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab41363e0 0x7f2ab41433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:53.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab91ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab405ed40 con 0x7f2ab40a4a20 2023-10-18T19:42:53.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab91ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab40a3a70 con 0x7f2ab41363e0 2023-10-18T19:42:53.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab91ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40a2ac0 con 0x7f2ab405e960 2023-10-18T19:42:53.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab41363e0 0x7f2ab41433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:53.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:53.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ab41363e0 0x7f2ab41433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55524/0 (socket says 172.21.15.88:55524) 2023-10-18T19:42:53.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47284/0 (socket says 172.21.15.88:47284) 2023-10-18T19:42:53.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.231+0000 7f2ab359e700 1 -- 172.21.15.88:0/570878532 learned_addr learned my addr 172.21.15.88:0/570878532 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:53.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab359e700 1 -- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 msgr2=0x7f2ab40a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:53.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab359e700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab359e700 1 -- 172.21.15.88:0/570878532 >> v1:172.21.15.88:6789/0 conn(0x7f2ab40a4a20 legacy=0x7f2ab4135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab359e700 1 -- 172.21.15.88:0/570878532 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab40a2d60 con 0x7f2ab41363e0 2023-10-18T19:42:53.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab2d9d700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:53.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab359e700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41433f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f2aac009f20 tx=0x7f2aac009840).ready entity=mon.0 client_cookie=31b7bf1065e36291 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:53.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab1d9b700 1 -- 172.21.15.88:0/570878532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00e070 con 0x7f2ab41363e0 2023-10-18T19:42:53.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab1d9b700 1 -- 172.21.15.88:0/570878532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac00ba60 con 0x7f2ab41363e0 2023-10-18T19:42:53.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab1d9b700 1 -- 172.21.15.88:0/570878532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00bde0 con 0x7f2ab41363e0 2023-10-18T19:42:53.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab91ff700 1 -- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 msgr2=0x7f2ab41433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.232+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41433f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f2aac009f20 tx=0x7f2aac009840).stop 2023-10-18T19:42:53.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 -- 172.21.15.88:0/570878532 shutdown_connections 2023-10-18T19:42:53.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41433f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/570878532 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 -- 172.21.15.88:0/570878532 >> 172.21.15.88:0/570878532 conn(0x7f2ab4064bb0 msgr2=0x7f2ab405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:53.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 -- 172.21.15.88:0/570878532 shutdown_connections 2023-10-18T19:42:53.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.233+0000 7f2ab91ff700 1 -- 172.21.15.88:0/570878532 wait complete. 2023-10-18T19:42:53.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.234+0000 7f2ab91ff700 1 Processor -- start 2023-10-18T19:42:53.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.234+0000 7f2ab91ff700 1 -- start start 2023-10-18T19:42:53.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:53.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ab40a4a20 0x7f2ab40a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40a5f20 con 0x7f2ab41363e0 2023-10-18T19:42:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40a55c0 con 0x7f2ab40a4a20 2023-10-18T19:42:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab91ff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab40a5860 con 0x7f2ab405e960 2023-10-18T19:42:53.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab2d9d700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:47286/0 (socket says 172.21.15.88:47286) 2023-10-18T19:42:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab2d9d700 1 -- 172.21.15.88:0/1706023384 learned_addr learned my addr 172.21.15.88:0/1706023384 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab259c700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ab40a4a20 0x7f2ab40a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.235+0000 7f2ab359e700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:53.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 -- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ab40a4a20 msgr2=0x7f2ab40a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ab40a4a20 0x7f2ab40a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 -- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 msgr2=0x7f2ab41327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41327e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 -- 172.21.15.88:0/1706023384 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40092a0 con 0x7f2ab405e960 2023-10-18T19:42:53.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab2d9d700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2aa400ea20 tx=0x7f2aa4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:53.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400ee60 con 0x7f2ab405e960 2023-10-18T19:42:53.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa400c850 con 0x7f2ab405e960 2023-10-18T19:42:53.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac009ae0 con 0x7f2ab405e960 2023-10-18T19:42:53.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400cbd0 con 0x7f2ab405e960 2023-10-18T19:42:53.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.236+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab40a7e60 con 0x7f2ab405e960 2023-10-18T19:42:53.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.237+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab405f270 con 0x7f2ab405e960 2023-10-18T19:42:53.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.237+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f2aa401b400 con 0x7f2ab405e960 2023-10-18T19:42:53.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.238+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2aa4055e10 con 0x7f2ab405e960 2023-10-18T19:42:53.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.241+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2aa4036090 con 0x7f2ab405e960 2023-10-18T19:42:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.408+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2ab40a1100 con 0x7f2ab405e960 2023-10-18T19:42:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.408+0000 7f2a9affd700 1 -- 172.21.15.88:0/1706023384 <== mon.2 v2:172.21.15.88:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f2aa4054a50 con 0x7f2ab405e960 2023-10-18T19:42:53.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 >> v1:172.21.15.88:6800/113625 conn(0x7f2aa0041bc0 legacy=0x7f2aa0044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 msgr2=0x7f2ab40a6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2aa400ea20 tx=0x7f2aa4009060).stop 2023-10-18T19:42:53.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 shutdown_connections 2023-10-18T19:42:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ab41363e0 0x7f2ab41327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ab405e960 0x7f2ab40a6840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 --2- 172.21.15.88:0/1706023384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ab40a4a20 0x7f2ab40a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 >> 172.21.15.88:0/1706023384 conn(0x7f2ab4064bb0 msgr2=0x7f2ab4139e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:53.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 shutdown_connections 2023-10-18T19:42:53.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:53.410+0000 7f2ab91ff700 1 -- 172.21.15.88:0/1706023384 wait complete. 2023-10-18T19:42:53.430 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:56.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:42:56.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.628+0000 7f612ddff700 1 Processor -- start 2023-10-18T19:42:56.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.628+0000 7f612ddff700 1 -- start start 2023-10-18T19:42:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f612ddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:56.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f612ddff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 0x7f61280a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:56.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f612ddff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612805e630 con 0x7f61280a8b70 2023-10-18T19:42:56.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f612ddff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280a7260 con 0x7f61280a6aa0 2023-10-18T19:42:56.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f612ddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61280a1a70 con 0x7f612805e250 2023-10-18T19:42:56.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f61277fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:56.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f6126ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 0x7f61280a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:56.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f61277fe700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49458/0 (socket says 172.21.15.88:49458) 2023-10-18T19:42:56.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f61277fe700 1 -- 172.21.15.88:0/2821548935 learned_addr learned my addr 172.21.15.88:0/2821548935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:56.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.629+0000 7f6127fff700 1 --1- 172.21.15.88:0/2821548935 >> v1:172.21.15.88:6789/0 conn(0x7f61280a8b70 0x7f612813c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44268/0 (socket says 172.21.15.88:44268) 2023-10-18T19:42:56.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61277fe700 1 -- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 msgr2=0x7f61280a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:42:56.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61277fe700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 0x7f61280a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61277fe700 1 -- 172.21.15.88:0/2821548935 >> v1:172.21.15.88:6789/0 conn(0x7f61280a8b70 legacy=0x7f612813c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61267fc700 1 -- 172.21.15.88:0/2821548935 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339391779 0 0) 0x7f612805e630 con 0x7f61280a8b70 2023-10-18T19:42:56.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61277fe700 1 -- 172.21.15.88:0/2821548935 --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280a8060 con 0x7f612805e250 2023-10-18T19:42:56.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f6126ffd700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 0x7f61280a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:42:56.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61277fe700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6118009830 tx=0x7f61180090f0).ready entity=mon.2 client_cookie=87a2ac10f314c696 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:56.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61267fc700 1 -- 172.21.15.88:0/2821548935 <== mon.2 v2:172.21.15.88:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800b520 con 0x7f612805e250 2023-10-18T19:42:56.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61267fc700 1 -- 172.21.15.88:0/2821548935 <== mon.2 v2:172.21.15.88:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800b680 con 0x7f612805e250 2023-10-18T19:42:56.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.630+0000 7f61267fc700 1 -- 172.21.15.88:0/2821548935 <== mon.2 v2:172.21.15.88:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800ba00 con 0x7f612805e250 2023-10-18T19:42:56.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 -- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 msgr2=0x7f61280a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6118009830 tx=0x7f61180090f0).stop 2023-10-18T19:42:56.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 -- 172.21.15.88:0/2821548935 shutdown_connections 2023-10-18T19:42:56.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f612805e250 0x7f61280a1580 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 --2- 172.21.15.88:0/2821548935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f61280a6aa0 0x7f61280a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 -- 172.21.15.88:0/2821548935 >> 172.21.15.88:0/2821548935 conn(0x7f61280665a0 msgr2=0x7f61280625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:56.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 -- 172.21.15.88:0/2821548935 shutdown_connections 2023-10-18T19:42:56.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.631+0000 7f612ddff700 1 -- 172.21.15.88:0/2821548935 wait complete. 2023-10-18T19:42:56.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.632+0000 7f612ddff700 1 Processor -- start 2023-10-18T19:42:56.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.632+0000 7f612ddff700 1 -- start start 2023-10-18T19:42:56.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:56.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f61280a6aa0 0x7f6128148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:56.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61280a8b70 0x7f612814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128117510 con 0x7f61280a8b70 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280a4a30 con 0x7f612805e250 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f612ddff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61281486c0 con 0x7f61280a6aa0 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f61277fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f61277fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:55094/0 (socket says 172.21.15.88:55094) 2023-10-18T19:42:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f61277fe700 1 -- 172.21.15.88:0/1831614356 learned_addr learned my addr 172.21.15.88:0/1831614356 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:42:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f6126ffd700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f61280a6aa0 0x7f6128148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.633+0000 7f6127fff700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61280a8b70 0x7f612814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:42:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 -- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f61280a6aa0 msgr2=0x7f6128148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f61280a6aa0 0x7f6128148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 -- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61280a8b70 msgr2=0x7f612814bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61280a8b70 0x7f612814bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 -- 172.21.15.88:0/1831614356 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0092a0 con 0x7f612805e250 2023-10-18T19:42:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f61277fe700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f612806a4c0 tx=0x7f6118017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:42:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118000bc0 con 0x7f612805e250 2023-10-18T19:42:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800b7f0 con 0x7f612805e250 2023-10-18T19:42:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118009370 con 0x7f612805e250 2023-10-18T19:42:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118000d20 con 0x7f612805e250 2023-10-18T19:42:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.634+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612813c970 con 0x7f612805e250 2023-10-18T19:42:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.635+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612805f270 con 0x7f612805e250 2023-10-18T19:42:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.635+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f611801c880 con 0x7f612805e250 2023-10-18T19:42:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.636+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f61180572c0 con 0x7f612805e250 2023-10-18T19:42:56.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.639+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f6118005dd0 con 0x7f612805e250 2023-10-18T19:42:56.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.807+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f612813cf10 con 0x7f612805e250 2023-10-18T19:42:56.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.808+0000 7f610f7fe700 1 -- 172.21.15.88:0/1831614356 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f6118055f80 con 0x7f612805e250 2023-10-18T19:42:56.811 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:42:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.809+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 >> v1:172.21.15.88:6800/113625 conn(0x7f6114041bc0 legacy=0x7f6114044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.809+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 msgr2=0x7f6128148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:42:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f612806a4c0 tx=0x7f6118017000).stop 2023-10-18T19:42:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 shutdown_connections 2023-10-18T19:42:56.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61280a8b70 0x7f612814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f612805e250 0x7f6128148940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 --2- 172.21.15.88:0/1831614356 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f61280a6aa0 0x7f6128148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:42:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 >> 172.21.15.88:0/1831614356 conn(0x7f61280665a0 msgr2=0x7f6128062d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:42:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 shutdown_connections 2023-10-18T19:42:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:42:56.810+0000 7f612ddff700 1 -- 172.21.15.88:0/1831614356 wait complete. 2023-10-18T19:42:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:42:59.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T19:43:00.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.025+0000 7f2ec8dff700 1 Processor -- start 2023-10-18T19:43:00.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.025+0000 7f2ec8dff700 1 -- start start 2023-10-18T19:43:00.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ec40ab590 0x7f2ec4139630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 0x7f2ec4136700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec40ab970 con 0x7f2ec40ab590 2023-10-18T19:43:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4135a50 con 0x7f2ec406aa30 2023-10-18T19:43:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec8dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4135cf0 con 0x7f2ec406a310 2023-10-18T19:43:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec1d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ec40ab590 0x7f2ec4139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec1d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49464/0 (socket says 172.21.15.88:49464) 2023-10-18T19:43:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec1d9b700 1 -- 172.21.15.88:0/958412025 learned_addr learned my addr 172.21.15.88:0/958412025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:43:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.026+0000 7f2ec2d9d700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 0x7f2ec4136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 -- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 msgr2=0x7f2ec4136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:43:00.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 -- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 msgr2=0x7f2ec4136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T19:43:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 0x7f2ec4136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 -- 172.21.15.88:0/958412025 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4139000 con 0x7f2ec40ab590 2023-10-18T19:43:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec1d9b700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:43:00.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec2d9d700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 0x7f2ec4136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-18T19:43:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec259c700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4139630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f2eb4009760 tx=0x7f2eb4009060).ready entity=mon.0 client_cookie=c3e3b892a749ab45 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:43:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec159a700 1 -- 172.21.15.88:0/958412025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400d4a0 con 0x7f2ec40ab590 2023-10-18T19:43:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec159a700 1 -- 172.21.15.88:0/958412025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb400d600 con 0x7f2ec40ab590 2023-10-18T19:43:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.027+0000 7f2ec159a700 1 -- 172.21.15.88:0/958412025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400d980 con 0x7f2ec40ab590 2023-10-18T19:43:00.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 -- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 msgr2=0x7f2ec4139630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:43:00.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4139630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f2eb4009760 tx=0x7f2eb4009060).stop 2023-10-18T19:43:00.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 -- 172.21.15.88:0/958412025 shutdown_connections 2023-10-18T19:43:00.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406aa30 0x7f2ec4136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4139630 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/958412025 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406a310 0x7f2ec4136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 -- 172.21.15.88:0/958412025 >> 172.21.15.88:0/958412025 conn(0x7f2ec405eb30 msgr2=0x7f2ec40aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:43:00.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 -- 172.21.15.88:0/958412025 shutdown_connections 2023-10-18T19:43:00.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.028+0000 7f2ec8dff700 1 -- 172.21.15.88:0/958412025 wait complete. 2023-10-18T19:43:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.029+0000 7f2ec8dff700 1 Processor -- start 2023-10-18T19:43:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.029+0000 7f2ec8dff700 1 -- start start 2023-10-18T19:43:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 0x7f2ec4094510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4091cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-18T19:43:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4091a50 con 0x7f2ec40ab590 2023-10-18T19:43:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4138370 con 0x7f2ec406a310 2023-10-18T19:43:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec8dff700 1 -- --> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4093370 con 0x7f2ec406aa30 2023-10-18T19:43:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec1d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 0x7f2ec4094510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:55110/0 (socket says 172.21.15.88:55110) 2023-10-18T19:43:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec1d9b700 1 --2- >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 0x7f2ec4094510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.88:3302/0 says I am v2:172.21.15.88:49466/0 (socket says 172.21.15.88:49466) 2023-10-18T19:43:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4091cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-18T19:43:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.030+0000 7f2ec259c700 1 -- 172.21.15.88:0/884950762 learned_addr learned my addr 172.21.15.88:0/884950762 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-18T19:43:00.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 -- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 msgr2=0x7f2ec4094510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:43:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 0x7f2ec4094510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 -- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 msgr2=0x7f2ec4091cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:43:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4091cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 -- 172.21.15.88:0/884950762 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8009370 con 0x7f2ec406a310 2023-10-18T19:43:00.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec259c700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f2eb4009d50 tx=0x7f2eb4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T19:43:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400dd30 con 0x7f2ec406a310 2023-10-18T19:43:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb400de90 con 0x7f2ec406a310 2023-10-18T19:43:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc009a20 con 0x7f2ec406a310 2023-10-18T19:43:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400d980 con 0x7f2ec406a310 2023-10-18T19:43:00.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.031+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40092a0 con 0x7f2ec406a310 2023-10-18T19:43:00.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.032+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec41369d0 con 0x7f2ec406a310 2023-10-18T19:43:00.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.032+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 9) v1 ==== 48540+0+0 (secure 0 0 0) 0x7f2eb401d640 con 0x7f2ec406a310 2023-10-18T19:43:00.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.033+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4198+0+0 (secure 0 0 0) 0x7f2eb4056ed0 con 0x7f2ec406a310 2023-10-18T19:43:00.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.036+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+131043 (secure 0 0 0) 0x7f2eb4002950 con 0x7f2ec406a310 2023-10-18T19:43:00.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.206+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2ec406a810 con 0x7f2ec406a310 2023-10-18T19:43:00.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.206+0000 7f2eb27fc700 1 -- 172.21.15.88:0/884950762 <== mon.1 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+282 (secure 0 0 0) 0x7f2eb4058070 con 0x7f2ec406a310 2023-10-18T19:43:00.209 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-18T19:43:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 >> v1:172.21.15.88:6800/113625 conn(0x7f2ea4041bc0 legacy=0x7f2ea4044080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:43:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 msgr2=0x7f2ec4137e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T19:43:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f2eb4009d50 tx=0x7f2eb4016000).stop 2023-10-18T19:43:00.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 shutdown_connections 2023-10-18T19:43:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec40ab590 0x7f2ec4091cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ec406a310 0x7f2ec4137e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 --2- 172.21.15.88:0/884950762 >> [v2:172.21.15.88:3302/0,v1:172.21.15.88:6791/0] conn(0x7f2ec406aa30 0x7f2ec4094510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-18T19:43:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 >> 172.21.15.88:0/884950762 conn(0x7f2ec405eb30 msgr2=0x7f2ec4135f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T19:43:00.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 shutdown_connections 2023-10-18T19:43:00.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-18T19:43:00.208+0000 7f2ec8dff700 1 -- 172.21.15.88:0/884950762 wait complete. 2023-10-18T19:43:00.228 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false},"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"3 daemons have recently crashed","count":3},"muted":false}},"mutes":[]} 2023-10-18T19:43:00.228 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3168, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-10-18T19:43:00.293 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e3407868e8b242babde954ade692d2f1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph.py", line 1482, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_b4ddd52ca4ac2ca6dc3b66adb82565f632d0f5a5/qa/tasks/ceph_manager.py", line 3168, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-10-18T19:43:00.296 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-18T19:43:00.311 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-18T19:43:00.339 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-18T19:43:00.392 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-18T19:43:00.442 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-18T19:43:00.493 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-18T19:43:00.542 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-18T19:43:00.542 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-18T19:43:00.543 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-18T19:43:00.543 DEBUG:teuthology.orchestra.run.smithi184:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-18T19:43:00.623 INFO:teuthology.orchestra.run.smithi184.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-10-18T19:43:00.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T19:43:00.626 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi184.front.sepia.ceph.com, aborting... 2023-10-18T19:43:00.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-18T19:43:00.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-18T19:58:00.681 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-10-18T19:58:00.689 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-10-18T22:34:05.446 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-18T22:34:05.474 DEBUG:teuthology.task.console_log:Killing console logger for smithi088 2023-10-18T22:34:05.474 DEBUG:teuthology.task.console_log:Killing console logger for smithi184 2023-10-18T22:34:05.475 DEBUG:teuthology.task.console_log:Killing console logger for smithi192 2023-10-18T22:34:05.475 DEBUG:teuthology.exit:Finished running handlers